Nov 09 03:32:13 user nova-compute[75378]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75378) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 09 03:32:13 user nova-compute[75378]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75378) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 09 03:32:13 user nova-compute[75378]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75378) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 09 03:32:13 user nova-compute[75378]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:32:14 user nova-compute[75378]: INFO nova.virt.driver [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 09 03:32:14 user nova-compute[75378]: INFO nova.compute.provider_config [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] Acquiring lock "singleton_lock" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] Acquired lock "singleton_lock" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] Releasing lock "singleton_lock" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] Full set of CONF: {{(pid=75378) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ******************************************************************************** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] Configuration options gathered from: {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ================================================================================ {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] allow_resize_to_same_host      = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] arq_binding_timeout            = 300 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] backdoor_port                  = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] backdoor_socket                = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] block_device_allocate_retries  = 300 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] block_device_allocate_retries_interval = 5 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cert                           = self.pem {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] compute_monitors               = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] config_dir                     = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] config_drive_format            = iso9660 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] config_source                  = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] console_host                   = user {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] control_exchange               = nova {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cpu_allocation_ratio           = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] daemon                         = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] debug                          = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] default_access_ip_network_name = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] default_availability_zone      = nova {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] default_ephemeral_format       = ext4 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] default_green_pool_size        = 1000 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] default_schedule_zone          = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] disk_allocation_ratio          = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] enable_new_services            = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] enabled_ssl_apis               = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] flat_injected                  = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] force_config_drive             = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] force_raw_images               = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] graceful_shutdown_timeout      = 5 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] heal_instance_info_cache_interval = 60 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] host                           = user {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] instance_build_timeout         = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] instance_delete_interval       = 300 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] instance_name_template         = instance-%08x {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] instance_usage_audit           = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] instance_usage_audit_period    = month {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] internal_service_availability_zone = internal {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] key                            = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] live_migration_retry_count     = 30 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] log_config_append              = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] log_dir                        = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] log_file                       = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] log_options                    = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] log_rotate_interval            = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] log_rotate_interval_type       = days {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] log_rotation_type              = none {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] long_rpc_timeout               = 1800 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] max_concurrent_builds          = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] max_concurrent_live_migrations = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] max_concurrent_snapshots       = 5 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] max_local_block_devices        = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] max_logfile_count              = 30 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] max_logfile_size_mb            = 200 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] maximum_instance_delete_attempts = 5 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] metadata_listen                = 0.0.0.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] metadata_listen_port           = 8775 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] metadata_workers               = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] migrate_max_retries            = -1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] mkisofs_cmd                    = genisoimage {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] my_ip                          = 10.0.0.210 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] network_allocate_retries       = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] osapi_compute_listen_port      = 8774 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] osapi_compute_unique_server_name_scope =  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] osapi_compute_workers          = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] password_length                = 12 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] periodic_enable                = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] periodic_fuzzy_delay           = 60 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] pointer_model                  = ps2mouse {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] preallocate_images             = none {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] publish_errors                 = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] pybasedir                      = /opt/stack/nova {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ram_allocation_ratio           = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] rate_limit_burst               = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] rate_limit_except_level        = CRITICAL {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] rate_limit_interval            = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] reboot_timeout                 = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] reclaim_instance_interval      = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] record                         = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] reimage_timeout_per_gb         = 60 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] report_interval                = 120 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] rescue_timeout                 = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] reserved_host_cpus             = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] reserved_host_disk_mb          = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] reserved_host_memory_mb        = 512 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] reserved_huge_pages            = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] resize_confirm_window          = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] resize_fs_using_block_device   = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] resume_guests_state_on_host_boot = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] rpc_response_timeout           = 60 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] run_external_periodic_tasks    = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] running_deleted_instance_action = reap {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] running_deleted_instance_timeout = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] scheduler_instance_sync_interval = 120 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] service_down_time              = 720 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] servicegroup_driver            = db {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] shelved_offload_time           = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] shelved_poll_interval          = 3600 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] shutdown_timeout               = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] source_is_ipv6                 = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ssl_only                       = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] state_path                     = /opt/stack/data/nova {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] sync_power_state_interval      = 600 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] sync_power_state_pool_size     = 1000 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] syslog_log_facility            = LOG_USER {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] tempdir                        = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] timeout_nbd                    = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] transport_url                  = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] update_resources_interval      = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] use_cow_images                 = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] use_eventlog                   = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] use_journal                    = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] use_json                       = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] use_rootwrap_daemon            = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] use_stderr                     = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] use_syslog                     = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vcpu_pin_set                   = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vif_plugging_is_fatal          = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vif_plugging_timeout           = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] virt_mkfs                      = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] volume_usage_poll_interval     = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] watch_log_file                 = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] web                            = /usr/share/spice-html5 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_concurrency.disable_process_locking = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.auth_strategy              = keystone {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.compute_link_prefix        = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.dhcp_domain                = novalocal {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.enable_instance_password   = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.glance_link_prefix         = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.instance_list_per_project_cells = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.list_records_by_skipping_down_cells = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.local_metadata_per_cell    = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.max_limit                  = 1000 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.metadata_cache_expiration  = 15 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.neutron_default_tenant_id  = default {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.use_forwarded_for          = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.use_neutron_default_nets   = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.vendordata_dynamic_targets = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.vendordata_jsonfile_path   = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.backend_argument         = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.config_prefix            = cache.oslo {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.dead_timeout             = 60.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.debug_cache_backend      = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.enable_retry_client      = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.enable_socket_keepalive  = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.enabled                  = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.expiration_time          = 600 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.hashclient_retry_attempts = 2 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.memcache_dead_retry      = 300 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.memcache_password        =  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.memcache_sasl_enabled    = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.memcache_username        =  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.proxies                  = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.retry_attempts           = 2 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.retry_delay              = 0.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.socket_keepalive_count   = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.socket_keepalive_idle    = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.socket_keepalive_interval = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.tls_allowed_ciphers      = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.tls_cafile               = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.tls_certfile             = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.tls_enabled              = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cache.tls_keyfile              = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cinder.auth_section            = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cinder.auth_type               = password {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cinder.cafile                  = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cinder.certfile                = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cinder.collect_timing          = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cinder.cross_az_attach         = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cinder.debug                   = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cinder.endpoint_template       = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cinder.http_retries            = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cinder.insecure                = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cinder.keyfile                 = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cinder.os_region_name          = RegionOne {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cinder.split_loggers           = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cinder.timeout                 = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] compute.cpu_dedicated_set      = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] compute.cpu_shared_set         = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] compute.image_type_exclude_list = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] compute.resource_provider_association_refresh = 300 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] compute.shutdown_retry_interval = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] conductor.workers              = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] console.allowed_origins        = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] console.ssl_ciphers            = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] console.ssl_minimum_version    = default {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] consoleauth.token_ttl          = 600 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cyborg.cafile                  = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cyborg.certfile                = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cyborg.collect_timing          = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cyborg.connect_retries         = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cyborg.connect_retry_delay     = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cyborg.endpoint_override       = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cyborg.insecure                = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cyborg.keyfile                 = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cyborg.max_version             = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cyborg.min_version             = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cyborg.region_name             = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cyborg.service_name            = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cyborg.service_type            = accelerator {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cyborg.split_loggers           = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cyborg.status_code_retries     = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cyborg.status_code_retry_delay = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cyborg.timeout                 = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] cyborg.version                 = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] database.backend               = sqlalchemy {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] database.connection            = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] database.connection_debug      = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] database.connection_parameters =  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] database.connection_recycle_time = 3600 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] database.connection_trace      = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] database.db_inc_retry_interval = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] database.db_max_retries        = 20 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] database.db_max_retry_interval = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] database.db_retry_interval     = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] database.max_overflow          = 50 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] database.max_pool_size         = 5 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] database.max_retries           = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] database.mysql_wsrep_sync_wait = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] database.pool_timeout          = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] database.retry_interval        = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] database.slave_connection      = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] database.sqlite_synchronous    = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api_database.backend           = sqlalchemy {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api_database.connection        = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api_database.connection_debug  = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api_database.connection_parameters =  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api_database.connection_recycle_time = 3600 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api_database.connection_trace  = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api_database.db_inc_retry_interval = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api_database.db_max_retries    = 20 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api_database.db_max_retry_interval = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api_database.db_retry_interval = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api_database.max_overflow      = 50 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api_database.max_pool_size     = 5 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api_database.max_retries       = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api_database.pool_timeout      = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api_database.retry_interval    = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api_database.slave_connection  = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] api_database.sqlite_synchronous = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] devices.enabled_mdev_types     = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ephemeral_storage_encryption.enabled = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.api_servers             = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.cafile                  = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.certfile                = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.collect_timing          = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.connect_retries         = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.connect_retry_delay     = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.debug                   = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.default_trusted_certificate_ids = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.enable_certificate_validation = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.enable_rbd_download     = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.endpoint_override       = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.insecure                = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.keyfile                 = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.max_version             = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.min_version             = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.num_retries             = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.rbd_ceph_conf           =  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.rbd_connect_timeout     = 5 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.rbd_pool                =  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.rbd_user                =  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.region_name             = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.service_name            = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.service_type            = image {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.split_loggers           = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.status_code_retries     = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.status_code_retry_delay = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.timeout                 = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.verify_glance_signatures = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] glance.version                 = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] guestfs.debug                  = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] hyperv.config_drive_cdrom      = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] hyperv.config_drive_inject_password = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] hyperv.enable_remotefx         = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] hyperv.instances_path_share    =  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] hyperv.limit_cpu_features      = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] hyperv.use_multipath_io        = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] hyperv.vswitch_name            = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] mks.enabled                    = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] image_cache.manager_interval   = 2400 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] image_cache.precache_concurrency = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] image_cache.remove_unused_base_images = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] image_cache.subdirectory_name  = _base {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.api_max_retries         = 60 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.api_retry_interval      = 2 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.auth_section            = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.auth_type               = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.cafile                  = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.certfile                = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.collect_timing          = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.conductor_group         = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.connect_retries         = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.connect_retry_delay     = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.endpoint_override       = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.insecure                = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.keyfile                 = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.max_version             = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.min_version             = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.peer_list               = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.region_name             = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.serial_console_state_timeout = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.service_name            = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.service_type            = baremetal {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.split_loggers           = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.status_code_retries     = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.status_code_retry_delay = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.timeout                 = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ironic.version                 = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] key_manager.fixed_key          = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican.barbican_api_version  = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican.barbican_endpoint     = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican.barbican_endpoint_type = public {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican.barbican_region_name  = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican.cafile                = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican.certfile              = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican.collect_timing        = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican.insecure              = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican.keyfile               = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican.number_of_retries     = 60 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican.retry_delay           = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican.send_service_user_token = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican.split_loggers         = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican.timeout               = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican.verify_ssl            = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican.verify_ssl_path       = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican_service_user.auth_section = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican_service_user.auth_type = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican_service_user.cafile   = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican_service_user.certfile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican_service_user.collect_timing = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican_service_user.insecure = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican_service_user.keyfile  = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican_service_user.split_loggers = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] barbican_service_user.timeout  = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vault.approle_role_id          = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vault.approle_secret_id        = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vault.cafile                   = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vault.certfile                 = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vault.collect_timing           = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vault.insecure                 = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vault.keyfile                  = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vault.kv_mountpoint            = secret {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vault.kv_path                  = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vault.kv_version               = 2 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vault.namespace                = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vault.root_token_id            = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vault.split_loggers            = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vault.ssl_ca_crt_file          = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vault.timeout                  = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vault.use_ssl                  = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] keystone.auth_section          = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] keystone.auth_type             = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] keystone.cafile                = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] keystone.certfile              = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] keystone.collect_timing        = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] keystone.connect_retries       = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] keystone.connect_retry_delay   = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] keystone.endpoint_override     = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] keystone.insecure              = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] keystone.keyfile               = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] keystone.max_version           = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] keystone.min_version           = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] keystone.region_name           = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] keystone.service_name          = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] keystone.service_type          = identity {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] keystone.split_loggers         = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] keystone.status_code_retries   = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] keystone.status_code_retry_delay = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] keystone.timeout               = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] keystone.version               = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.connection_uri         =  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.cpu_mode               = custom {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: WARNING oslo_config.cfg [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.cpu_power_governor_high = performance {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.cpu_power_management   = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.device_detach_attempts = 8 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.device_detach_timeout  = 20 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.disk_cachemodes        = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.disk_prefix            = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.enabled_perf_events    = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.file_backed_memory     = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.gid_maps               = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.hw_disk_discard        = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.hw_machine_type        = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.images_rbd_pool        = rbd {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.images_type            = default {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.images_volume_group    = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.inject_key             = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.inject_partition       = -2 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.inject_password        = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.iscsi_iface            = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.iser_use_multipath     = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.live_migration_downtime = 500 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.live_migration_inbound_addr = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.live_migration_scheme  = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.live_migration_timeout_action = abort {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.live_migration_tunnelled = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: WARNING oslo_config.cfg [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 09 03:32:14 user nova-compute[75378]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 09 03:32:14 user nova-compute[75378]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 09 03:32:14 user nova-compute[75378]: and ``live_migration_inbound_addr`` respectively.
Nov 09 03:32:14 user nova-compute[75378]: ).  Its value may be silently ignored in the future.
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.live_migration_with_native_tls = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.max_queues             = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.nfs_mount_options      = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.num_pcie_ports         = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.pmem_namespaces        = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.quobyte_client_cfg     = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.rbd_secret_uuid        = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.rbd_user               = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.rescue_image_id        = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.rescue_kernel_id       = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.rx_queue_size          = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.smbfs_mount_options    =  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.snapshot_compression   = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.snapshot_image_format  = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.sparse_logical_volumes = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.swtpm_enabled          = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.swtpm_group            = tss {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.swtpm_user             = tss {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.sysinfo_serial         = unique {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.tb_cache_size          = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.tx_queue_size          = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.uid_maps               = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.use_virtio_for_bridges = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.virt_type              = kvm {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.volume_clear           = zero {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.volume_clear_size      = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.volume_use_multipath   = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.vzstorage_cache_path   = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.auth_section           = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.auth_type              = password {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.cafile                 = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.certfile               = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.collect_timing         = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.connect_retries        = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.connect_retry_delay    = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.default_floating_pool  = public {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.endpoint_override      = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.extension_sync_interval = 600 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.http_retries           = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.insecure               = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.keyfile                = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.max_version            = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.min_version            = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.ovs_bridge             = br-int {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.physnets               = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.region_name            = RegionOne {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.service_metadata_proxy = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.service_name           = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.service_type           = network {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.split_loggers          = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.status_code_retries    = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.status_code_retry_delay = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.timeout                = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] neutron.version                = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] notifications.bdms_in_notifications = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] notifications.default_level    = INFO {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] notifications.notification_format = unversioned {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] notifications.notify_on_state_change = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] pci.alias                      = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] pci.device_spec                = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] pci.report_in_placement        = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.auth_section         = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.auth_type            = password {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.cafile               = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.certfile             = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.collect_timing       = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.connect_retries      = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.connect_retry_delay  = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.default_domain_id    = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.default_domain_name  = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.domain_id            = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.domain_name          = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.endpoint_override    = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.insecure             = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.keyfile              = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.max_version          = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.min_version          = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.password             = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.project_domain_id    = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.project_domain_name  = Default {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.project_id           = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.project_name         = service {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.region_name          = RegionOne {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.service_name         = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.service_type         = placement {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.split_loggers        = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.status_code_retries  = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.status_code_retry_delay = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.system_scope         = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.timeout              = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.trust_id             = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.user_domain_id       = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.user_domain_name     = Default {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.user_id              = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.username             = placement {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] placement.version              = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] quota.cores                    = 20 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] quota.count_usage_from_placement = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] quota.injected_file_content_bytes = 10240 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] quota.injected_file_path_length = 255 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] quota.injected_files           = 5 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] quota.instances                = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] quota.key_pairs                = 100 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] quota.metadata_items           = 128 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] quota.ram                      = 51200 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] quota.recheck_quota            = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] quota.server_group_members     = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] quota.server_groups            = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] rdp.enabled                    = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] scheduler.image_metadata_prefilter = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] scheduler.max_attempts         = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] scheduler.max_placement_results = 1000 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] scheduler.workers              = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.host_subset_size = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.isolated_hosts = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.isolated_images = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.pci_in_placement = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.track_instance_changes = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] metrics.required               = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] metrics.weight_multiplier      = 1.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] metrics.weight_setting         = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] serial_console.enabled         = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] serial_console.port_range      = 10000:20000 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] serial_console.serialproxy_port = 6083 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] service_user.auth_section      = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] service_user.auth_type         = password {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] service_user.cafile            = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] service_user.certfile          = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] service_user.collect_timing    = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] service_user.insecure          = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] service_user.keyfile           = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] service_user.send_service_user_token = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] service_user.split_loggers     = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] service_user.timeout           = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] spice.agent_enabled            = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] spice.enabled                  = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] spice.html5proxy_port          = 6082 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] spice.image_compression        = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] spice.jpeg_compression         = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] spice.playback_compression     = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] spice.server_listen            = 127.0.0.1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] spice.streaming_mode           = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] spice.zlib_compression         = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] upgrade_levels.baseapi         = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] upgrade_levels.cert            = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] upgrade_levels.compute         = auto {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] upgrade_levels.conductor       = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] upgrade_levels.scheduler       = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vendordata_dynamic_auth.cafile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vendordata_dynamic_auth.certfile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vendordata_dynamic_auth.insecure = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vendordata_dynamic_auth.timeout = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.api_retry_count         = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.ca_file                 = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.cache_prefix            = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.cluster_name            = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.connection_pool_size    = 10 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.console_delay_seconds   = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.datastore_regex         = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.host_ip                 = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.host_password           = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.host_port               = 443 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.host_username           = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.insecure                = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.integration_bridge      = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.maximum_objects         = 100 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.pbm_default_policy      = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.pbm_enabled             = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.pbm_wsdl_location       = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.serial_port_proxy_uri   = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.serial_port_service_uri = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.task_poll_interval      = 0.5 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.use_linked_clone        = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.vnc_keymap              = en-us {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.vnc_port                = 5900 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vmware.vnc_port_total          = 10000 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vnc.auth_schemes               = ['none'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vnc.enabled                    = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vnc.novncproxy_port            = 6080 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vnc.vencrypt_ca_certs          = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vnc.vencrypt_client_cert       = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vnc.vencrypt_client_key        = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] workarounds.disable_rootwrap   = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] workarounds.enable_numa_live_migration = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] workarounds.libvirt_disable_apic = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] wsgi.client_socket_timeout     = 900 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] wsgi.default_pool_size         = 1000 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] wsgi.keep_alive                = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] wsgi.max_header_line           = 16384 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] wsgi.ssl_ca_file               = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] wsgi.ssl_cert_file             = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] wsgi.ssl_key_file              = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] wsgi.tcp_keepidle              = 600 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] zvm.ca_file                    = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] zvm.cloud_connector_url        = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] zvm.reachable_timeout          = 300 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_policy.enforce_new_defaults = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_policy.enforce_scope      = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_policy.policy_default_rule = default {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] profiler.connection_string     = messaging:// {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] profiler.enabled               = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] profiler.es_doc_type           = notification {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] profiler.es_scroll_size        = 10000 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] profiler.es_scroll_time        = 2m {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] profiler.filter_error_trace    = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] profiler.hmac_keys             = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] profiler.sentinel_service_name = mymaster {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] profiler.socket_timeout        = 0.1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] profiler.trace_requests        = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] profiler.trace_sqlalchemy      = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] profiler_jaeger.process_tags   = {} {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] profiler_jaeger.service_name_prefix = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] profiler_otlp.service_name_prefix = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] remote_debug.host              = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] remote_debug.port              = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_notifications.retry = -1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.auth_section        = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.auth_type           = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.cafile              = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.certfile            = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.collect_timing      = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.connect_retries     = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.connect_retry_delay = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.endpoint_id         = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.endpoint_override   = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.insecure            = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.keyfile             = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.max_version         = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.min_version         = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.region_name         = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.service_name        = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.service_type        = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.split_loggers       = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.status_code_retries = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.status_code_retry_delay = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.timeout             = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.valid_interfaces    = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_limit.version             = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_reports.file_event_handler = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] oslo_reports.log_dir           = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vif_plug_ovs_privileged.group  = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] vif_plug_ovs_privileged.user   = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] os_vif_ovs.isolate_vif         = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] os_brick.lock_path             = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] privsep_osbrick.capabilities   = [21] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] privsep_osbrick.group          = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] privsep_osbrick.helper_command = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] privsep_osbrick.user           = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] nova_sys_admin.group           = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] nova_sys_admin.helper_command  = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] nova_sys_admin.user            = None {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG oslo_service.service [None req-f3079c7c-3647-4175-b9e9-54acb94184a6 None None] ******************************************************************************** {{(pid=75378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 09 03:32:14 user nova-compute[75378]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 09 03:32:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Connecting to libvirt: qemu:///system {{(pid=75378) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7ff3d11e6e90> {{(pid=75378) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 09 03:32:14 user nova-compute[75378]: libvirt:  error : internal error: could not initialize domain event timer
Nov 09 03:32:14 user nova-compute[75378]: WARNING nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 09 03:32:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7ff3d11e6e90> {{(pid=75378) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Starting native event thread {{(pid=75378) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Starting green dispatch thread {{(pid=75378) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 09 03:32:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Starting connection event dispatch thread {{(pid=75378) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 09 03:32:14 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Connection event '1' reason 'None'
Nov 09 03:32:14 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 09 03:32:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.mount [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Initialising _HostMountState generation 0 {{(pid=75378) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 09 03:32:22 user nova-compute[75378]: INFO nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Libvirt host capabilities <capabilities>
Nov 09 03:32:22 user nova-compute[75378]:   <host>
Nov 09 03:32:22 user nova-compute[75378]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 09 03:32:22 user nova-compute[75378]:     <cpu>
Nov 09 03:32:22 user nova-compute[75378]:       <arch>x86_64</arch>
Nov 09 03:32:22 user nova-compute[75378]:       <model>IvyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <vendor>Intel</vendor>
Nov 09 03:32:22 user nova-compute[75378]:       <microcode version='1070'/>
Nov 09 03:32:22 user nova-compute[75378]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 09 03:32:22 user nova-compute[75378]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature name='ss'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature name='vmx'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature name='pcid'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature name='osxsave'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature name='hypervisor'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature name='arat'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature name='tsc_adjust'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature name='md-clear'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature name='stibp'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature name='arch-capabilities'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature name='ssbd'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature name='invtsc'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature name='rsba'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature name='skip-l1dfl-vmentry'/>
Nov 09 03:32:22 user nova-compute[75378]:       <pages unit='KiB' size='4'/>
Nov 09 03:32:22 user nova-compute[75378]:       <pages unit='KiB' size='2048'/>
Nov 09 03:32:22 user nova-compute[75378]:     </cpu>
Nov 09 03:32:22 user nova-compute[75378]:     <power_management>
Nov 09 03:32:22 user nova-compute[75378]:       <suspend_mem/>
Nov 09 03:32:22 user nova-compute[75378]:       <suspend_disk/>
Nov 09 03:32:22 user nova-compute[75378]:       <suspend_hybrid/>
Nov 09 03:32:22 user nova-compute[75378]:     </power_management>
Nov 09 03:32:22 user nova-compute[75378]:     <iommu support='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     <migration_features>
Nov 09 03:32:22 user nova-compute[75378]:       <live/>
Nov 09 03:32:22 user nova-compute[75378]:       <uri_transports>
Nov 09 03:32:22 user nova-compute[75378]:         <uri_transport>tcp</uri_transport>
Nov 09 03:32:22 user nova-compute[75378]:         <uri_transport>rdma</uri_transport>
Nov 09 03:32:22 user nova-compute[75378]:       </uri_transports>
Nov 09 03:32:22 user nova-compute[75378]:     </migration_features>
Nov 09 03:32:22 user nova-compute[75378]:     <topology>
Nov 09 03:32:22 user nova-compute[75378]:       <cells num='2'>
Nov 09 03:32:22 user nova-compute[75378]:         <cell id='0'>
Nov 09 03:32:22 user nova-compute[75378]:           <memory unit='KiB'>8140616</memory>
Nov 09 03:32:22 user nova-compute[75378]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 09 03:32:22 user nova-compute[75378]:           <pages unit='KiB' size='2048'>0</pages>
Nov 09 03:32:22 user nova-compute[75378]:           <distances>
Nov 09 03:32:22 user nova-compute[75378]:             <sibling id='0' value='10'/>
Nov 09 03:32:22 user nova-compute[75378]:             <sibling id='1' value='20'/>
Nov 09 03:32:22 user nova-compute[75378]:           </distances>
Nov 09 03:32:22 user nova-compute[75378]:           <cpus num='6'>
Nov 09 03:32:22 user nova-compute[75378]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 09 03:32:22 user nova-compute[75378]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 09 03:32:22 user nova-compute[75378]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 09 03:32:22 user nova-compute[75378]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 09 03:32:22 user nova-compute[75378]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 09 03:32:22 user nova-compute[75378]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 09 03:32:22 user nova-compute[75378]:           </cpus>
Nov 09 03:32:22 user nova-compute[75378]:         </cell>
Nov 09 03:32:22 user nova-compute[75378]:         <cell id='1'>
Nov 09 03:32:22 user nova-compute[75378]:           <memory unit='KiB'>8255068</memory>
Nov 09 03:32:22 user nova-compute[75378]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 09 03:32:22 user nova-compute[75378]:           <pages unit='KiB' size='2048'>0</pages>
Nov 09 03:32:22 user nova-compute[75378]:           <distances>
Nov 09 03:32:22 user nova-compute[75378]:             <sibling id='0' value='20'/>
Nov 09 03:32:22 user nova-compute[75378]:             <sibling id='1' value='10'/>
Nov 09 03:32:22 user nova-compute[75378]:           </distances>
Nov 09 03:32:22 user nova-compute[75378]:           <cpus num='6'>
Nov 09 03:32:22 user nova-compute[75378]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 09 03:32:22 user nova-compute[75378]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 09 03:32:22 user nova-compute[75378]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 09 03:32:22 user nova-compute[75378]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 09 03:32:22 user nova-compute[75378]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 09 03:32:22 user nova-compute[75378]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 09 03:32:22 user nova-compute[75378]:           </cpus>
Nov 09 03:32:22 user nova-compute[75378]:         </cell>
Nov 09 03:32:22 user nova-compute[75378]:       </cells>
Nov 09 03:32:22 user nova-compute[75378]:     </topology>
Nov 09 03:32:22 user nova-compute[75378]:     <cache>
Nov 09 03:32:22 user nova-compute[75378]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 09 03:32:22 user nova-compute[75378]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 09 03:32:22 user nova-compute[75378]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 09 03:32:22 user nova-compute[75378]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 09 03:32:22 user nova-compute[75378]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 09 03:32:22 user nova-compute[75378]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 09 03:32:22 user nova-compute[75378]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 09 03:32:22 user nova-compute[75378]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 09 03:32:22 user nova-compute[75378]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 09 03:32:22 user nova-compute[75378]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 09 03:32:22 user nova-compute[75378]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 09 03:32:22 user nova-compute[75378]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 09 03:32:22 user nova-compute[75378]:     </cache>
Nov 09 03:32:22 user nova-compute[75378]:     <secmodel>
Nov 09 03:32:22 user nova-compute[75378]:       <model>apparmor</model>
Nov 09 03:32:22 user nova-compute[75378]:       <doi>0</doi>
Nov 09 03:32:22 user nova-compute[75378]:     </secmodel>
Nov 09 03:32:22 user nova-compute[75378]:     <secmodel>
Nov 09 03:32:22 user nova-compute[75378]:       <model>dac</model>
Nov 09 03:32:22 user nova-compute[75378]:       <doi>0</doi>
Nov 09 03:32:22 user nova-compute[75378]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 09 03:32:22 user nova-compute[75378]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 09 03:32:22 user nova-compute[75378]:     </secmodel>
Nov 09 03:32:22 user nova-compute[75378]:   </host>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='alpha'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>64</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>clipper</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='armv6l'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>32</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>integratorcp</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>borzoi</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>spitz</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>nuri</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>musca-b1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>versatileab</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>kzm</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>musca-a</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>smdkc210</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>sx1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>z2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>tosa</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>sabrelite</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>realview-eb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>n810</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>n800</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>versatilepb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>terrier</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mainstone</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>midway</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>musicpal</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>microbit</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>cubieboard</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>verdex</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>netduino2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>raspi2b</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>cheetah</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>highbank</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>akita</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>connex</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>collie</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>raspi0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='armv7l'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>32</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>integratorcp</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>borzoi</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>spitz</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>nuri</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>musca-b1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>versatileab</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>kzm</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>musca-a</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>smdkc210</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>sx1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>z2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>tosa</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>sabrelite</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>realview-eb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>n810</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>n800</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>versatilepb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>terrier</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mainstone</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>midway</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>musicpal</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>microbit</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>cubieboard</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>verdex</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>netduino2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>raspi2b</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>cheetah</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>highbank</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>akita</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>connex</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>collie</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>raspi0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='aarch64'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>64</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>integratorcp</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>borzoi</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>spitz</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>nuri</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>musca-b1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>versatileab</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>kzm</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>musca-a</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>smdkc210</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>sx1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>z2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>tosa</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>sabrelite</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>realview-eb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>n810</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>n800</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>versatilepb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>terrier</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mainstone</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>midway</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>musicpal</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>microbit</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>cubieboard</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>verdex</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>netduino2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>raspi3b</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>raspi2b</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>cheetah</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>highbank</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>akita</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>connex</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>collie</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>raspi0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <acpi default='on' toggle='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='cris'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>32</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='i686'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>32</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>x-remote</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>isapc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>microvm</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='kvm'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <pae/>
Nov 09 03:32:22 user nova-compute[75378]:       <nonpae/>
Nov 09 03:32:22 user nova-compute[75378]:       <acpi default='on' toggle='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:       <apic default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='m68k'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>32</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>an5206</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>q800</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>next-cube</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='microblaze'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>32</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='microblazeel'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>32</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='mips'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>32</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='16'>malta</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mipssim</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='mipsel'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>32</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='16'>malta</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mipssim</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='mips64'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>64</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='16'>malta</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mipssim</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>pica61</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>magnum</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='mips64el'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>64</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='16'>malta</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mipssim</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>pica61</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>magnum</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='16'>boston</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='ppc'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>32</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>g3beige</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mac99</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='32'>ppce500</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>pegasos2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>sam460ex</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>bamboo</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>40p</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>ref405ep</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>taihu</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='ppc64'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>64</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2048'>powernv9</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>taihu</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2048'>powernv10</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='32'>ppce500</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>40p</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>pegasos2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>bamboo</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>g3beige</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mac99</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>sam460ex</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>ref405ep</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2048'>powernv8</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='ppc64le'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>64</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2048'>powernv9</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>taihu</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2048'>powernv10</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='32'>ppce500</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>40p</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>pegasos2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>bamboo</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>g3beige</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>mac99</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>sam460ex</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>ref405ep</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2048'>powernv8</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='riscv32'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>32</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='8'>spike</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>opentitan</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='5'>sifive_u</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>sifive_e</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='8'>virt</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='riscv64'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>64</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='8'>spike</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='5'>sifive_u</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>shakti_c</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>sifive_e</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='8'>virt</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='s390x'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>64</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='sh4'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>32</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>shix</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>r2d</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='sh4eb'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>64</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>shix</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>r2d</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='sparc'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>32</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>SS-5</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>SS-20</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>LX</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>SS-4</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>SS-10</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>Voyager</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='sparc64'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>64</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>sun4u</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>niagara</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>sun4v</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='x86_64'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>64</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>x-remote</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='1'>isapc</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>microvm</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='kvm'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <acpi default='on' toggle='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:       <apic default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='xtensa'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>32</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>sim</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='32'>kc705</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='32'>ml605</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='32'>virt</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='32'>lx200</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='32'>lx60</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]:   <guest>
Nov 09 03:32:22 user nova-compute[75378]:     <os_type>hvm</os_type>
Nov 09 03:32:22 user nova-compute[75378]:     <arch name='xtensaeb'>
Nov 09 03:32:22 user nova-compute[75378]:       <wordsize>32</wordsize>
Nov 09 03:32:22 user nova-compute[75378]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='4'>sim</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='32'>kc705</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='32'>ml605</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='32'>virt</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='32'>lx200</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='32'>lx60</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 09 03:32:22 user nova-compute[75378]:       <domain type='qemu'/>
Nov 09 03:32:22 user nova-compute[75378]:     </arch>
Nov 09 03:32:22 user nova-compute[75378]:     <features>
Nov 09 03:32:22 user nova-compute[75378]:       <cpuselection/>
Nov 09 03:32:22 user nova-compute[75378]:       <deviceboot/>
Nov 09 03:32:22 user nova-compute[75378]:       <disksnapshot default='on' toggle='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     </features>
Nov 09 03:32:22 user nova-compute[75378]:   </guest>
Nov 09 03:32:22 user nova-compute[75378]: </capabilities>
Nov 09 03:32:22 user nova-compute[75378]: 
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'q35', 'ubuntu', 'pc'} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 09 03:32:22 user nova-compute[75378]: <domainCapabilities>
Nov 09 03:32:22 user nova-compute[75378]:   <path>/usr/bin/qemu-system-i386</path>
Nov 09 03:32:22 user nova-compute[75378]:   <domain>kvm</domain>
Nov 09 03:32:22 user nova-compute[75378]:   <machine>pc-q35-jammy</machine>
Nov 09 03:32:22 user nova-compute[75378]:   <arch>i686</arch>
Nov 09 03:32:22 user nova-compute[75378]:   <vcpu max='288'/>
Nov 09 03:32:22 user nova-compute[75378]:   <iothreads supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:   <os supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:     <enum name='firmware'/>
Nov 09 03:32:22 user nova-compute[75378]:     <loader supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='type'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>rom</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>pflash</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='readonly'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>yes</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>no</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='secure'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>no</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </loader>
Nov 09 03:32:22 user nova-compute[75378]:   </os>
Nov 09 03:32:22 user nova-compute[75378]:   <cpu>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='host-passthrough' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='hostPassthroughMigratable'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>off</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='maximum' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='maximumMigratable'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>on</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>off</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='host-model' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <vendor>Intel</vendor>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ss'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='vmx'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='pcid'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='hypervisor'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='arat'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='umip'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='md-clear'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='stibp'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ssbd'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ibpb'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ibrs'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='amd-stibp'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='disable' name='erms'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='disable' name='lm'/>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='custom' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>qemu64</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>qemu32</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>phenom</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium3</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium2</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>n270</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>kvm64</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>kvm32</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>coreduo</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>core2duo</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>athlon</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Westmere-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Westmere</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Snowridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>SandyBridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Penryn</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G5</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G4</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G3</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G2</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G1</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Nehalem-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Nehalem</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>IvyBridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Icelake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-Rome</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-Milan</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Dhyana</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cooperlake</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Conroe</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>486</model>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:   </cpu>
Nov 09 03:32:22 user nova-compute[75378]:   <memoryBacking supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:     <enum name='sourceType'>
Nov 09 03:32:22 user nova-compute[75378]:       <value>file</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>anonymous</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>memfd</value>
Nov 09 03:32:22 user nova-compute[75378]:     </enum>
Nov 09 03:32:22 user nova-compute[75378]:   </memoryBacking>
Nov 09 03:32:22 user nova-compute[75378]:   <devices>
Nov 09 03:32:22 user nova-compute[75378]:     <disk supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='diskDevice'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>disk</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>cdrom</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>floppy</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>lun</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='bus'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>fdc</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>scsi</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>usb</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>sata</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-non-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </disk>
Nov 09 03:32:22 user nova-compute[75378]:     <graphics supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='type'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>sdl</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vnc</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>spice</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>egl-headless</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </graphics>
Nov 09 03:32:22 user nova-compute[75378]:     <video supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='modelType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vga</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>cirrus</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vmvga</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>qxl</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>none</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>bochs</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>ramfb</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </video>
Nov 09 03:32:22 user nova-compute[75378]:     <hostdev supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='mode'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>subsystem</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='startupPolicy'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>default</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>mandatory</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>requisite</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>optional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='subsysType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>usb</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>pci</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>scsi</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='capsType'/>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='pciBackend'/>
Nov 09 03:32:22 user nova-compute[75378]:     </hostdev>
Nov 09 03:32:22 user nova-compute[75378]:     <rng supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-non-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='backendModel'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>random</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>egd</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>builtin</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </rng>
Nov 09 03:32:22 user nova-compute[75378]:     <filesystem supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='driverType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>path</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>handle</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtiofs</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </filesystem>
Nov 09 03:32:22 user nova-compute[75378]:     <tpm supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>tpm-tis</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>tpm-crb</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='backendModel'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>passthrough</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>emulator</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </tpm>
Nov 09 03:32:22 user nova-compute[75378]:   </devices>
Nov 09 03:32:22 user nova-compute[75378]:   <features>
Nov 09 03:32:22 user nova-compute[75378]:     <gic supported='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     <vmcoreinfo supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <genid supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <backingStoreInput supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <backup supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <sev supported='no'/>
Nov 09 03:32:22 user nova-compute[75378]:   </features>
Nov 09 03:32:22 user nova-compute[75378]: </domainCapabilities>
Nov 09 03:32:22 user nova-compute[75378]:  {{(pid=75378) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 09 03:32:22 user nova-compute[75378]: <domainCapabilities>
Nov 09 03:32:22 user nova-compute[75378]:   <path>/usr/bin/qemu-system-i386</path>
Nov 09 03:32:22 user nova-compute[75378]:   <domain>kvm</domain>
Nov 09 03:32:22 user nova-compute[75378]:   <machine>pc-q35-6.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:   <arch>i686</arch>
Nov 09 03:32:22 user nova-compute[75378]:   <vcpu max='288'/>
Nov 09 03:32:22 user nova-compute[75378]:   <iothreads supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:   <os supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:     <enum name='firmware'/>
Nov 09 03:32:22 user nova-compute[75378]:     <loader supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='type'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>rom</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>pflash</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='readonly'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>yes</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>no</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='secure'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>no</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </loader>
Nov 09 03:32:22 user nova-compute[75378]:   </os>
Nov 09 03:32:22 user nova-compute[75378]:   <cpu>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='host-passthrough' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='hostPassthroughMigratable'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>off</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='maximum' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='maximumMigratable'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>on</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>off</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='host-model' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <vendor>Intel</vendor>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ss'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='vmx'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='pcid'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='hypervisor'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='arat'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='umip'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='md-clear'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='stibp'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ssbd'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ibpb'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ibrs'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='amd-stibp'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='disable' name='erms'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='disable' name='lm'/>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='custom' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>qemu64</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>qemu32</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>phenom</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium3</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium2</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>n270</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>kvm64</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>kvm32</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>coreduo</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>core2duo</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>athlon</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Westmere-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Westmere</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Snowridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>SandyBridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Penryn</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G5</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G4</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G3</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G2</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G1</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Nehalem-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Nehalem</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>IvyBridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Icelake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-Rome</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-Milan</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Dhyana</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cooperlake</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Conroe</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>486</model>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:   </cpu>
Nov 09 03:32:22 user nova-compute[75378]:   <memoryBacking supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:     <enum name='sourceType'>
Nov 09 03:32:22 user nova-compute[75378]:       <value>file</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>anonymous</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>memfd</value>
Nov 09 03:32:22 user nova-compute[75378]:     </enum>
Nov 09 03:32:22 user nova-compute[75378]:   </memoryBacking>
Nov 09 03:32:22 user nova-compute[75378]:   <devices>
Nov 09 03:32:22 user nova-compute[75378]:     <disk supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='diskDevice'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>disk</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>cdrom</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>floppy</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>lun</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='bus'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>fdc</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>scsi</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>usb</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>sata</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-non-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </disk>
Nov 09 03:32:22 user nova-compute[75378]:     <graphics supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='type'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>sdl</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vnc</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>spice</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>egl-headless</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </graphics>
Nov 09 03:32:22 user nova-compute[75378]:     <video supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='modelType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vga</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>cirrus</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vmvga</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>qxl</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>none</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>bochs</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>ramfb</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </video>
Nov 09 03:32:22 user nova-compute[75378]:     <hostdev supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='mode'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>subsystem</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='startupPolicy'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>default</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>mandatory</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>requisite</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>optional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='subsysType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>usb</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>pci</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>scsi</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='capsType'/>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='pciBackend'/>
Nov 09 03:32:22 user nova-compute[75378]:     </hostdev>
Nov 09 03:32:22 user nova-compute[75378]:     <rng supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-non-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='backendModel'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>random</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>egd</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>builtin</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </rng>
Nov 09 03:32:22 user nova-compute[75378]:     <filesystem supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='driverType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>path</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>handle</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtiofs</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </filesystem>
Nov 09 03:32:22 user nova-compute[75378]:     <tpm supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>tpm-tis</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>tpm-crb</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='backendModel'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>passthrough</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>emulator</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </tpm>
Nov 09 03:32:22 user nova-compute[75378]:   </devices>
Nov 09 03:32:22 user nova-compute[75378]:   <features>
Nov 09 03:32:22 user nova-compute[75378]:     <gic supported='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     <vmcoreinfo supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <genid supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <backingStoreInput supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <backup supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <sev supported='no'/>
Nov 09 03:32:22 user nova-compute[75378]:   </features>
Nov 09 03:32:22 user nova-compute[75378]: </domainCapabilities>
Nov 09 03:32:22 user nova-compute[75378]:  {{(pid=75378) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 09 03:32:22 user nova-compute[75378]: <domainCapabilities>
Nov 09 03:32:22 user nova-compute[75378]:   <path>/usr/bin/qemu-system-i386</path>
Nov 09 03:32:22 user nova-compute[75378]:   <domain>kvm</domain>
Nov 09 03:32:22 user nova-compute[75378]:   <machine>pc-i440fx-jammy</machine>
Nov 09 03:32:22 user nova-compute[75378]:   <arch>i686</arch>
Nov 09 03:32:22 user nova-compute[75378]:   <vcpu max='255'/>
Nov 09 03:32:22 user nova-compute[75378]:   <iothreads supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:   <os supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:     <enum name='firmware'/>
Nov 09 03:32:22 user nova-compute[75378]:     <loader supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='type'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>rom</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>pflash</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='readonly'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>yes</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>no</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='secure'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>no</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </loader>
Nov 09 03:32:22 user nova-compute[75378]:   </os>
Nov 09 03:32:22 user nova-compute[75378]:   <cpu>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='host-passthrough' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='hostPassthroughMigratable'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>off</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='maximum' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='maximumMigratable'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>on</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>off</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='host-model' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <vendor>Intel</vendor>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ss'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='vmx'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='pcid'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='hypervisor'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='arat'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='umip'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='md-clear'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='stibp'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ssbd'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ibpb'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ibrs'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='amd-stibp'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='disable' name='erms'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='disable' name='lm'/>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='custom' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>qemu64</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>qemu32</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>phenom</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium3</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium2</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>n270</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>kvm64</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>kvm32</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>coreduo</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>core2duo</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>athlon</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Westmere-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Westmere</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Snowridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>SandyBridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Penryn</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G5</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G4</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G3</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G2</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G1</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Nehalem-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Nehalem</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>IvyBridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Icelake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-Rome</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-Milan</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Dhyana</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cooperlake</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Conroe</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>486</model>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:   </cpu>
Nov 09 03:32:22 user nova-compute[75378]:   <memoryBacking supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:     <enum name='sourceType'>
Nov 09 03:32:22 user nova-compute[75378]:       <value>file</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>anonymous</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>memfd</value>
Nov 09 03:32:22 user nova-compute[75378]:     </enum>
Nov 09 03:32:22 user nova-compute[75378]:   </memoryBacking>
Nov 09 03:32:22 user nova-compute[75378]:   <devices>
Nov 09 03:32:22 user nova-compute[75378]:     <disk supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='diskDevice'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>disk</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>cdrom</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>floppy</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>lun</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='bus'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>ide</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>fdc</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>scsi</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>usb</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>sata</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-non-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </disk>
Nov 09 03:32:22 user nova-compute[75378]:     <graphics supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='type'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>sdl</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vnc</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>spice</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>egl-headless</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </graphics>
Nov 09 03:32:22 user nova-compute[75378]:     <video supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='modelType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vga</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>cirrus</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vmvga</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>qxl</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>none</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>bochs</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>ramfb</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </video>
Nov 09 03:32:22 user nova-compute[75378]:     <hostdev supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='mode'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>subsystem</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='startupPolicy'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>default</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>mandatory</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>requisite</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>optional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='subsysType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>usb</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>pci</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>scsi</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='capsType'/>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='pciBackend'/>
Nov 09 03:32:22 user nova-compute[75378]:     </hostdev>
Nov 09 03:32:22 user nova-compute[75378]:     <rng supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-non-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='backendModel'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>random</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>egd</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>builtin</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </rng>
Nov 09 03:32:22 user nova-compute[75378]:     <filesystem supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='driverType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>path</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>handle</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtiofs</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </filesystem>
Nov 09 03:32:22 user nova-compute[75378]:     <tpm supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>tpm-tis</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>tpm-crb</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='backendModel'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>passthrough</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>emulator</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </tpm>
Nov 09 03:32:22 user nova-compute[75378]:   </devices>
Nov 09 03:32:22 user nova-compute[75378]:   <features>
Nov 09 03:32:22 user nova-compute[75378]:     <gic supported='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     <vmcoreinfo supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <genid supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <backingStoreInput supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <backup supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <sev supported='no'/>
Nov 09 03:32:22 user nova-compute[75378]:   </features>
Nov 09 03:32:22 user nova-compute[75378]: </domainCapabilities>
Nov 09 03:32:22 user nova-compute[75378]:  {{(pid=75378) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 09 03:32:22 user nova-compute[75378]: <domainCapabilities>
Nov 09 03:32:22 user nova-compute[75378]:   <path>/usr/bin/qemu-system-i386</path>
Nov 09 03:32:22 user nova-compute[75378]:   <domain>kvm</domain>
Nov 09 03:32:22 user nova-compute[75378]:   <machine>pc-i440fx-6.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:   <arch>i686</arch>
Nov 09 03:32:22 user nova-compute[75378]:   <vcpu max='255'/>
Nov 09 03:32:22 user nova-compute[75378]:   <iothreads supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:   <os supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:     <enum name='firmware'/>
Nov 09 03:32:22 user nova-compute[75378]:     <loader supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='type'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>rom</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>pflash</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='readonly'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>yes</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>no</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='secure'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>no</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </loader>
Nov 09 03:32:22 user nova-compute[75378]:   </os>
Nov 09 03:32:22 user nova-compute[75378]:   <cpu>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='host-passthrough' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='hostPassthroughMigratable'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>off</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='maximum' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='maximumMigratable'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>on</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>off</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='host-model' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <vendor>Intel</vendor>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ss'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='vmx'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='pcid'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='hypervisor'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='arat'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='umip'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='md-clear'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='stibp'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ssbd'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ibpb'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ibrs'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='amd-stibp'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='disable' name='erms'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='disable' name='lm'/>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='custom' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>qemu64</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>qemu32</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>phenom</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium3</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium2</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>n270</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>kvm64</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>kvm32</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>coreduo</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>core2duo</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>athlon</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Westmere-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Westmere</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Snowridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>SandyBridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Penryn</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G5</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G4</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G3</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G2</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G1</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Nehalem-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Nehalem</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>IvyBridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Icelake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-Rome</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-Milan</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Dhyana</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cooperlake</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Conroe</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>486</model>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:   </cpu>
Nov 09 03:32:22 user nova-compute[75378]:   <memoryBacking supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:     <enum name='sourceType'>
Nov 09 03:32:22 user nova-compute[75378]:       <value>file</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>anonymous</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>memfd</value>
Nov 09 03:32:22 user nova-compute[75378]:     </enum>
Nov 09 03:32:22 user nova-compute[75378]:   </memoryBacking>
Nov 09 03:32:22 user nova-compute[75378]:   <devices>
Nov 09 03:32:22 user nova-compute[75378]:     <disk supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='diskDevice'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>disk</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>cdrom</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>floppy</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>lun</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='bus'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>ide</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>fdc</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>scsi</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>usb</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>sata</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-non-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </disk>
Nov 09 03:32:22 user nova-compute[75378]:     <graphics supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='type'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>sdl</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vnc</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>spice</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>egl-headless</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </graphics>
Nov 09 03:32:22 user nova-compute[75378]:     <video supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='modelType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vga</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>cirrus</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vmvga</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>qxl</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>none</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>bochs</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>ramfb</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </video>
Nov 09 03:32:22 user nova-compute[75378]:     <hostdev supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='mode'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>subsystem</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='startupPolicy'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>default</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>mandatory</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>requisite</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>optional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='subsysType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>usb</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>pci</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>scsi</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='capsType'/>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='pciBackend'/>
Nov 09 03:32:22 user nova-compute[75378]:     </hostdev>
Nov 09 03:32:22 user nova-compute[75378]:     <rng supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-non-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='backendModel'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>random</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>egd</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>builtin</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </rng>
Nov 09 03:32:22 user nova-compute[75378]:     <filesystem supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='driverType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>path</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>handle</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtiofs</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </filesystem>
Nov 09 03:32:22 user nova-compute[75378]:     <tpm supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>tpm-tis</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>tpm-crb</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='backendModel'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>passthrough</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>emulator</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </tpm>
Nov 09 03:32:22 user nova-compute[75378]:   </devices>
Nov 09 03:32:22 user nova-compute[75378]:   <features>
Nov 09 03:32:22 user nova-compute[75378]:     <gic supported='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     <vmcoreinfo supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <genid supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <backingStoreInput supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <backup supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <sev supported='no'/>
Nov 09 03:32:22 user nova-compute[75378]:   </features>
Nov 09 03:32:22 user nova-compute[75378]: </domainCapabilities>
Nov 09 03:32:22 user nova-compute[75378]:  {{(pid=75378) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'q35', 'ubuntu', 'pc'} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 09 03:32:22 user nova-compute[75378]: <domainCapabilities>
Nov 09 03:32:22 user nova-compute[75378]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 09 03:32:22 user nova-compute[75378]:   <domain>kvm</domain>
Nov 09 03:32:22 user nova-compute[75378]:   <machine>pc-q35-jammy</machine>
Nov 09 03:32:22 user nova-compute[75378]:   <arch>x86_64</arch>
Nov 09 03:32:22 user nova-compute[75378]:   <vcpu max='288'/>
Nov 09 03:32:22 user nova-compute[75378]:   <iothreads supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:   <os supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:     <enum name='firmware'>
Nov 09 03:32:22 user nova-compute[75378]:       <value>efi</value>
Nov 09 03:32:22 user nova-compute[75378]:     </enum>
Nov 09 03:32:22 user nova-compute[75378]:     <loader supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='type'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>rom</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>pflash</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='readonly'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>yes</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>no</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='secure'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>yes</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>no</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </loader>
Nov 09 03:32:22 user nova-compute[75378]:   </os>
Nov 09 03:32:22 user nova-compute[75378]:   <cpu>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='host-passthrough' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='hostPassthroughMigratable'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>on</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>off</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='maximum' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='maximumMigratable'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>on</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>off</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='host-model' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <vendor>Intel</vendor>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ss'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='vmx'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='pcid'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='hypervisor'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='arat'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='umip'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='md-clear'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='stibp'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ssbd'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='invtsc'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ibpb'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ibrs'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='amd-stibp'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='rsba'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='pschange-mc-no'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='disable' name='erms'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='custom' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>qemu64</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>qemu32</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>phenom</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium3</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium2</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>n270</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>kvm64</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>kvm32</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>coreduo</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>core2duo</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>athlon</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Westmere-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Westmere</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Snowridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>SandyBridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Penryn</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G5</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G4</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G3</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G2</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Opteron_G1</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Nehalem</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>IvyBridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Icelake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-Rome</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-Milan</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Dhyana</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cooperlake</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Conroe</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>486</model>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:   </cpu>
Nov 09 03:32:22 user nova-compute[75378]:   <memoryBacking supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:     <enum name='sourceType'>
Nov 09 03:32:22 user nova-compute[75378]:       <value>file</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>anonymous</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>memfd</value>
Nov 09 03:32:22 user nova-compute[75378]:     </enum>
Nov 09 03:32:22 user nova-compute[75378]:   </memoryBacking>
Nov 09 03:32:22 user nova-compute[75378]:   <devices>
Nov 09 03:32:22 user nova-compute[75378]:     <disk supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='diskDevice'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>disk</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>cdrom</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>floppy</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>lun</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='bus'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>fdc</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>scsi</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>usb</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>sata</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-non-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </disk>
Nov 09 03:32:22 user nova-compute[75378]:     <graphics supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='type'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>sdl</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vnc</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>spice</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>egl-headless</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </graphics>
Nov 09 03:32:22 user nova-compute[75378]:     <video supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='modelType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vga</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>cirrus</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vmvga</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>qxl</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>none</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>bochs</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>ramfb</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </video>
Nov 09 03:32:22 user nova-compute[75378]:     <hostdev supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='mode'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>subsystem</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='startupPolicy'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>default</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>mandatory</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>requisite</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>optional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='subsysType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>usb</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>pci</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>scsi</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='capsType'/>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='pciBackend'/>
Nov 09 03:32:22 user nova-compute[75378]:     </hostdev>
Nov 09 03:32:22 user nova-compute[75378]:     <rng supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-non-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='backendModel'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>random</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>egd</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>builtin</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </rng>
Nov 09 03:32:22 user nova-compute[75378]:     <filesystem supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='driverType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>path</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>handle</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtiofs</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </filesystem>
Nov 09 03:32:22 user nova-compute[75378]:     <tpm supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>tpm-tis</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>tpm-crb</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='backendModel'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>passthrough</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>emulator</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </tpm>
Nov 09 03:32:22 user nova-compute[75378]:   </devices>
Nov 09 03:32:22 user nova-compute[75378]:   <features>
Nov 09 03:32:22 user nova-compute[75378]:     <gic supported='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     <vmcoreinfo supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <genid supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <backingStoreInput supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <backup supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <sev supported='no'/>
Nov 09 03:32:22 user nova-compute[75378]:   </features>
Nov 09 03:32:22 user nova-compute[75378]: </domainCapabilities>
Nov 09 03:32:22 user nova-compute[75378]:  {{(pid=75378) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 09 03:32:22 user nova-compute[75378]: <domainCapabilities>
Nov 09 03:32:22 user nova-compute[75378]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 09 03:32:22 user nova-compute[75378]:   <domain>kvm</domain>
Nov 09 03:32:22 user nova-compute[75378]:   <machine>pc-q35-6.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:   <arch>x86_64</arch>
Nov 09 03:32:22 user nova-compute[75378]:   <vcpu max='288'/>
Nov 09 03:32:22 user nova-compute[75378]:   <iothreads supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:   <os supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:     <enum name='firmware'>
Nov 09 03:32:22 user nova-compute[75378]:       <value>efi</value>
Nov 09 03:32:22 user nova-compute[75378]:     </enum>
Nov 09 03:32:22 user nova-compute[75378]:     <loader supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='type'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>rom</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>pflash</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='readonly'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>yes</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>no</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='secure'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>yes</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>no</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </loader>
Nov 09 03:32:22 user nova-compute[75378]:   </os>
Nov 09 03:32:22 user nova-compute[75378]:   <cpu>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='host-passthrough' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='hostPassthroughMigratable'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>on</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>off</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='maximum' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='maximumMigratable'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>on</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>off</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='host-model' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <vendor>Intel</vendor>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ss'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='vmx'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='pcid'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='hypervisor'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='arat'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='umip'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='md-clear'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='stibp'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ssbd'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='invtsc'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ibpb'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ibrs'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='amd-stibp'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='rsba'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='pschange-mc-no'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='disable' name='erms'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='custom' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>qemu64</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>qemu32</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>phenom</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium3</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium2</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>n270</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>kvm64</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>kvm32</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>coreduo</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>core2duo</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>athlon</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Westmere-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Westmere</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Snowridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>SandyBridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Penryn</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G5</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G4</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G3</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G2</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Opteron_G1</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Nehalem</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>IvyBridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Icelake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-Rome</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-Milan</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Dhyana</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cooperlake</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Conroe</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>486</model>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:   </cpu>
Nov 09 03:32:22 user nova-compute[75378]:   <memoryBacking supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:     <enum name='sourceType'>
Nov 09 03:32:22 user nova-compute[75378]:       <value>file</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>anonymous</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>memfd</value>
Nov 09 03:32:22 user nova-compute[75378]:     </enum>
Nov 09 03:32:22 user nova-compute[75378]:   </memoryBacking>
Nov 09 03:32:22 user nova-compute[75378]:   <devices>
Nov 09 03:32:22 user nova-compute[75378]:     <disk supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='diskDevice'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>disk</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>cdrom</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>floppy</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>lun</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='bus'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>fdc</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>scsi</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>usb</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>sata</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-non-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </disk>
Nov 09 03:32:22 user nova-compute[75378]:     <graphics supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='type'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>sdl</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vnc</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>spice</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>egl-headless</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </graphics>
Nov 09 03:32:22 user nova-compute[75378]:     <video supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='modelType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vga</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>cirrus</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vmvga</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>qxl</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>none</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>bochs</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>ramfb</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </video>
Nov 09 03:32:22 user nova-compute[75378]:     <hostdev supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='mode'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>subsystem</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='startupPolicy'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>default</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>mandatory</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>requisite</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>optional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='subsysType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>usb</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>pci</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>scsi</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='capsType'/>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='pciBackend'/>
Nov 09 03:32:22 user nova-compute[75378]:     </hostdev>
Nov 09 03:32:22 user nova-compute[75378]:     <rng supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-non-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='backendModel'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>random</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>egd</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>builtin</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </rng>
Nov 09 03:32:22 user nova-compute[75378]:     <filesystem supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='driverType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>path</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>handle</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtiofs</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </filesystem>
Nov 09 03:32:22 user nova-compute[75378]:     <tpm supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>tpm-tis</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>tpm-crb</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='backendModel'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>passthrough</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>emulator</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </tpm>
Nov 09 03:32:22 user nova-compute[75378]:   </devices>
Nov 09 03:32:22 user nova-compute[75378]:   <features>
Nov 09 03:32:22 user nova-compute[75378]:     <gic supported='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     <vmcoreinfo supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <genid supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <backingStoreInput supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <backup supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <sev supported='no'/>
Nov 09 03:32:22 user nova-compute[75378]:   </features>
Nov 09 03:32:22 user nova-compute[75378]: </domainCapabilities>
Nov 09 03:32:22 user nova-compute[75378]:  {{(pid=75378) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 09 03:32:22 user nova-compute[75378]: <domainCapabilities>
Nov 09 03:32:22 user nova-compute[75378]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 09 03:32:22 user nova-compute[75378]:   <domain>kvm</domain>
Nov 09 03:32:22 user nova-compute[75378]:   <machine>pc-i440fx-jammy</machine>
Nov 09 03:32:22 user nova-compute[75378]:   <arch>x86_64</arch>
Nov 09 03:32:22 user nova-compute[75378]:   <vcpu max='255'/>
Nov 09 03:32:22 user nova-compute[75378]:   <iothreads supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:   <os supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:     <enum name='firmware'>
Nov 09 03:32:22 user nova-compute[75378]:       <value>efi</value>
Nov 09 03:32:22 user nova-compute[75378]:     </enum>
Nov 09 03:32:22 user nova-compute[75378]:     <loader supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='type'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>rom</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>pflash</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='readonly'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>yes</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>no</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='secure'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>no</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </loader>
Nov 09 03:32:22 user nova-compute[75378]:   </os>
Nov 09 03:32:22 user nova-compute[75378]:   <cpu>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='host-passthrough' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='hostPassthroughMigratable'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>on</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>off</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='maximum' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='maximumMigratable'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>on</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>off</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='host-model' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <vendor>Intel</vendor>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ss'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='vmx'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='pcid'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='hypervisor'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='arat'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='umip'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='md-clear'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='stibp'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ssbd'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='invtsc'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ibpb'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ibrs'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='amd-stibp'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='rsba'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='pschange-mc-no'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='disable' name='erms'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='custom' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>qemu64</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>qemu32</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>phenom</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium3</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium2</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>n270</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>kvm64</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>kvm32</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>coreduo</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>core2duo</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>athlon</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Westmere-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Westmere</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Snowridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>SandyBridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Penryn</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G5</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G4</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G3</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G2</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Opteron_G1</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Nehalem</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>IvyBridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Icelake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-Rome</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-Milan</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Dhyana</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cooperlake</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Conroe</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>486</model>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:   </cpu>
Nov 09 03:32:22 user nova-compute[75378]:   <memoryBacking supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:     <enum name='sourceType'>
Nov 09 03:32:22 user nova-compute[75378]:       <value>file</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>anonymous</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>memfd</value>
Nov 09 03:32:22 user nova-compute[75378]:     </enum>
Nov 09 03:32:22 user nova-compute[75378]:   </memoryBacking>
Nov 09 03:32:22 user nova-compute[75378]:   <devices>
Nov 09 03:32:22 user nova-compute[75378]:     <disk supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='diskDevice'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>disk</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>cdrom</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>floppy</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>lun</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='bus'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>ide</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>fdc</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>scsi</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>usb</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>sata</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-non-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </disk>
Nov 09 03:32:22 user nova-compute[75378]:     <graphics supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='type'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>sdl</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vnc</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>spice</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>egl-headless</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </graphics>
Nov 09 03:32:22 user nova-compute[75378]:     <video supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='modelType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vga</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>cirrus</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vmvga</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>qxl</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>none</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>bochs</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>ramfb</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </video>
Nov 09 03:32:22 user nova-compute[75378]:     <hostdev supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='mode'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>subsystem</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='startupPolicy'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>default</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>mandatory</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>requisite</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>optional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='subsysType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>usb</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>pci</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>scsi</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='capsType'/>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='pciBackend'/>
Nov 09 03:32:22 user nova-compute[75378]:     </hostdev>
Nov 09 03:32:22 user nova-compute[75378]:     <rng supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-non-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='backendModel'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>random</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>egd</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>builtin</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </rng>
Nov 09 03:32:22 user nova-compute[75378]:     <filesystem supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='driverType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>path</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>handle</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtiofs</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </filesystem>
Nov 09 03:32:22 user nova-compute[75378]:     <tpm supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>tpm-tis</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>tpm-crb</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='backendModel'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>passthrough</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>emulator</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </tpm>
Nov 09 03:32:22 user nova-compute[75378]:   </devices>
Nov 09 03:32:22 user nova-compute[75378]:   <features>
Nov 09 03:32:22 user nova-compute[75378]:     <gic supported='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     <vmcoreinfo supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <genid supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <backingStoreInput supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <backup supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <sev supported='no'/>
Nov 09 03:32:22 user nova-compute[75378]:   </features>
Nov 09 03:32:22 user nova-compute[75378]: </domainCapabilities>
Nov 09 03:32:22 user nova-compute[75378]:  {{(pid=75378) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 09 03:32:22 user nova-compute[75378]: <domainCapabilities>
Nov 09 03:32:22 user nova-compute[75378]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 09 03:32:22 user nova-compute[75378]:   <domain>kvm</domain>
Nov 09 03:32:22 user nova-compute[75378]:   <machine>pc-i440fx-6.2</machine>
Nov 09 03:32:22 user nova-compute[75378]:   <arch>x86_64</arch>
Nov 09 03:32:22 user nova-compute[75378]:   <vcpu max='255'/>
Nov 09 03:32:22 user nova-compute[75378]:   <iothreads supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:   <os supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:     <enum name='firmware'>
Nov 09 03:32:22 user nova-compute[75378]:       <value>efi</value>
Nov 09 03:32:22 user nova-compute[75378]:     </enum>
Nov 09 03:32:22 user nova-compute[75378]:     <loader supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='type'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>rom</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>pflash</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='readonly'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>yes</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>no</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='secure'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>no</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </loader>
Nov 09 03:32:22 user nova-compute[75378]:   </os>
Nov 09 03:32:22 user nova-compute[75378]:   <cpu>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='host-passthrough' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='hostPassthroughMigratable'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>on</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>off</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='maximum' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='maximumMigratable'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>on</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>off</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='host-model' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <vendor>Intel</vendor>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ss'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='vmx'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='pcid'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='hypervisor'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='arat'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='umip'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='md-clear'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='stibp'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ssbd'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='invtsc'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ibpb'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='ibrs'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='amd-stibp'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='rsba'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='require' name='pschange-mc-no'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='disable' name='erms'/>
Nov 09 03:32:22 user nova-compute[75378]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:     <mode name='custom' supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>qemu64</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>qemu32</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>phenom</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium3</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium2</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>pentium</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>n270</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>kvm64</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>kvm32</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>coreduo</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>core2duo</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>athlon</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Westmere-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Westmere</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Snowridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Skylake-Client</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>SandyBridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Penryn</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G5</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G4</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G3</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Opteron_G2</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Opteron_G1</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Nehalem</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>IvyBridge</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Icelake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Haswell</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-Rome</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-Milan</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>EPYC</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Dhyana</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cooperlake</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>Conroe</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='no'>Broadwell</model>
Nov 09 03:32:22 user nova-compute[75378]:       <model usable='yes'>486</model>
Nov 09 03:32:22 user nova-compute[75378]:     </mode>
Nov 09 03:32:22 user nova-compute[75378]:   </cpu>
Nov 09 03:32:22 user nova-compute[75378]:   <memoryBacking supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:     <enum name='sourceType'>
Nov 09 03:32:22 user nova-compute[75378]:       <value>file</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>anonymous</value>
Nov 09 03:32:22 user nova-compute[75378]:       <value>memfd</value>
Nov 09 03:32:22 user nova-compute[75378]:     </enum>
Nov 09 03:32:22 user nova-compute[75378]:   </memoryBacking>
Nov 09 03:32:22 user nova-compute[75378]:   <devices>
Nov 09 03:32:22 user nova-compute[75378]:     <disk supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='diskDevice'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>disk</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>cdrom</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>floppy</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>lun</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='bus'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>ide</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>fdc</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>scsi</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>usb</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>sata</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-non-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </disk>
Nov 09 03:32:22 user nova-compute[75378]:     <graphics supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='type'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>sdl</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vnc</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>spice</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>egl-headless</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </graphics>
Nov 09 03:32:22 user nova-compute[75378]:     <video supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='modelType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vga</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>cirrus</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>vmvga</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>qxl</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>none</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>bochs</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>ramfb</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </video>
Nov 09 03:32:22 user nova-compute[75378]:     <hostdev supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='mode'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>subsystem</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='startupPolicy'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>default</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>mandatory</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>requisite</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>optional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='subsysType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>usb</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>pci</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>scsi</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='capsType'/>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='pciBackend'/>
Nov 09 03:32:22 user nova-compute[75378]:     </hostdev>
Nov 09 03:32:22 user nova-compute[75378]:     <rng supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtio-non-transitional</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='backendModel'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>random</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>egd</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>builtin</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </rng>
Nov 09 03:32:22 user nova-compute[75378]:     <filesystem supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='driverType'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>path</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>handle</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>virtiofs</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </filesystem>
Nov 09 03:32:22 user nova-compute[75378]:     <tpm supported='yes'>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='model'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>tpm-tis</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>tpm-crb</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:       <enum name='backendModel'>
Nov 09 03:32:22 user nova-compute[75378]:         <value>passthrough</value>
Nov 09 03:32:22 user nova-compute[75378]:         <value>emulator</value>
Nov 09 03:32:22 user nova-compute[75378]:       </enum>
Nov 09 03:32:22 user nova-compute[75378]:     </tpm>
Nov 09 03:32:22 user nova-compute[75378]:   </devices>
Nov 09 03:32:22 user nova-compute[75378]:   <features>
Nov 09 03:32:22 user nova-compute[75378]:     <gic supported='no'/>
Nov 09 03:32:22 user nova-compute[75378]:     <vmcoreinfo supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <genid supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <backingStoreInput supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <backup supported='yes'/>
Nov 09 03:32:22 user nova-compute[75378]:     <sev supported='no'/>
Nov 09 03:32:22 user nova-compute[75378]:   </features>
Nov 09 03:32:22 user nova-compute[75378]: </domainCapabilities>
Nov 09 03:32:22 user nova-compute[75378]:  {{(pid=75378) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75378) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75378) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Checking secure boot support for host arch (x86_64) {{(pid=75378) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 09 03:32:22 user nova-compute[75378]: INFO nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Secure Boot support detected
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] cpu compare xml: <cpu match="exact">
Nov 09 03:32:22 user nova-compute[75378]:   <model>Nehalem</model>
Nov 09 03:32:22 user nova-compute[75378]: </cpu>
Nov 09 03:32:22 user nova-compute[75378]:  {{(pid=75378) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 09 03:32:22 user nova-compute[75378]: INFO nova.virt.node [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Generated node identity 47051f37-c496-4978-8e02-d2f1a5bbf8b8
Nov 09 03:32:22 user nova-compute[75378]: INFO nova.virt.node [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Wrote node identity 47051f37-c496-4978-8e02-d2f1a5bbf8b8 to /opt/stack/data/nova/compute_id
Nov 09 03:32:22 user nova-compute[75378]: WARNING nova.compute.manager [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Compute nodes ['47051f37-c496-4978-8e02-d2f1a5bbf8b8'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 09 03:32:22 user nova-compute[75378]: INFO nova.compute.manager [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 09 03:32:22 user nova-compute[75378]: WARNING nova.compute.manager [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 09 03:32:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:32:22 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:32:22 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Hypervisor/Node resource view: name=user free_ram=10975MB free_disk=26.258930206298828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:32:22 user nova-compute[75378]: WARNING nova.compute.resource_tracker [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] No compute node record for user:47051f37-c496-4978-8e02-d2f1a5bbf8b8: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 47051f37-c496-4978-8e02-d2f1a5bbf8b8 could not be found.
Nov 09 03:32:22 user nova-compute[75378]: INFO nova.compute.resource_tracker [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Compute node record created for user:user with uuid: 47051f37-c496-4978-8e02-d2f1a5bbf8b8
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:32:22 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:32:22 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] [req-8f6d09f4-9a2a-434f-bda2-9f4a5e62f978] Created resource provider record via placement API for resource provider with UUID 47051f37-c496-4978-8e02-d2f1a5bbf8b8 and name user.
Nov 09 03:32:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75378) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 09 03:32:23 user nova-compute[75378]: INFO nova.virt.libvirt.host [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] kernel doesn't support AMD SEV
Nov 09 03:32:23 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Updating inventory in ProviderTree for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 03:32:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:32:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Libvirt baseline CPU <cpu>
Nov 09 03:32:23 user nova-compute[75378]:   <arch>x86_64</arch>
Nov 09 03:32:23 user nova-compute[75378]:   <model>Nehalem</model>
Nov 09 03:32:23 user nova-compute[75378]:   <vendor>Intel</vendor>
Nov 09 03:32:23 user nova-compute[75378]:   <topology sockets="6" cores="1" threads="1"/>
Nov 09 03:32:23 user nova-compute[75378]: </cpu>
Nov 09 03:32:23 user nova-compute[75378]:  {{(pid=75378) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 09 03:32:23 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Updated inventory for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 09 03:32:23 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Updating resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 generation from 0 to 1 during operation: update_inventory {{(pid=75378) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 09 03:32:23 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Updating inventory in ProviderTree for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 03:32:23 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Updating resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 generation from 1 to 2 during operation: update_traits {{(pid=75378) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 09 03:32:23 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:32:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.632s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:32:23 user nova-compute[75378]: DEBUG nova.service [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Creating RPC server for service compute {{(pid=75378) start /opt/stack/nova/nova/service.py:182}}
Nov 09 03:32:23 user nova-compute[75378]: DEBUG nova.service [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] Join ServiceGroup membership for this service compute {{(pid=75378) start /opt/stack/nova/nova/service.py:199}}
Nov 09 03:32:23 user nova-compute[75378]: DEBUG nova.servicegroup.drivers.db [None req-81a34476-0268-406d-8b89-bccdf756b741 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75378) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 09 03:32:23 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:32:23 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Rebuilding the list of instances to heal {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Didn't find any instances for network info cache update. {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:33:14 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:33:14 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:33:14 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=10417MB free_disk=26.162704467773438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:33:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:34:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:34:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:34:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:34:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:34:15 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:34:15 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:34:15 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:34:15 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:34:15 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:34:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:34:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:34:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:34:15 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:34:15 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:34:15 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:34:15 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=10366MB free_disk=26.227088928222656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:34:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:34:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:34:15 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:34:15 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:34:15 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:34:15 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:34:15 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:34:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:34:16 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:34:16 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:34:16 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Rebuilding the list of instances to heal {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 03:34:16 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Didn't find any instances for network info cache update. {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 03:34:16 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:35:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:35:15 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:35:15 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:35:16 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:35:17 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:35:17 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:35:17 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:35:17 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:35:17 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:35:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:35:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:35:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:35:17 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:35:17 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:35:17 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:35:17 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=10346MB free_disk=25.979522705078125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:35:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:35:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:35:17 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:35:17 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:35:17 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:35:17 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:35:17 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:35:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:35:18 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:35:18 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:35:18 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Rebuilding the list of instances to heal {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 03:35:18 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Didn't find any instances for network info cache update. {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 03:36:15 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:36:15 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:36:17 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:36:17 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:36:17 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:36:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:17 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:36:17 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:36:17 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:36:17 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=9589MB free_disk=26.00725555419922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:36:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:17 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:36:17 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:36:17 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:36:17 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:36:17 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:36:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:18 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:36:18 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:36:18 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:36:18 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Rebuilding the list of instances to heal {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 03:36:18 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Didn't find any instances for network info cache update. {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 03:36:18 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:36:18 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:36:18 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:36:18 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:36:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Acquiring lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:24 user nova-compute[75378]: DEBUG nova.compute.manager [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:36:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:24 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:36:24 user nova-compute[75378]: INFO nova.compute.claims [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Claim successful on node user
Nov 09 03:36:24 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:36:24 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:36:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:25 user nova-compute[75378]: DEBUG nova.compute.manager [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:36:25 user nova-compute[75378]: DEBUG nova.compute.manager [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:36:25 user nova-compute[75378]: DEBUG nova.network.neutron [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:36:25 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:36:25 user nova-compute[75378]: DEBUG nova.compute.manager [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:36:25 user nova-compute[75378]: DEBUG nova.compute.manager [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:36:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:36:25 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Creating image(s)
Nov 09 03:36:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Acquiring lock "/opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "/opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "/opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:25 user nova-compute[75378]: DEBUG nova.policy [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '201443e0d5e84be0b662043093120ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1024d4b86f47b480b75e55108e6c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:36:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a.part --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a.part --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:26 user nova-compute[75378]: DEBUG nova.virt.images [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] c162665b-54ae-441d-9cd1-28ea81cc5de8 was qcow2, converting to raw {{(pid=75378) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 03:36:26 user nova-compute[75378]: DEBUG nova.privsep.utils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75378) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 03:36:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a.part /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a.converted {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a.part /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a.converted" returned: 0 in 0.162s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a.converted --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.280s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:26 user nova-compute[75378]: INFO oslo.privsep.daemon [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp69fiz9dr/privsep.sock']
Nov 09 03:36:26 user sudo[84623]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp69fiz9dr/privsep.sock
Nov 09 03:36:26 user sudo[84623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 09 03:36:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:27 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:36:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:27 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:36:27 user nova-compute[75378]: INFO nova.compute.claims [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Claim successful on node user
Nov 09 03:36:27 user nova-compute[75378]: DEBUG nova.network.neutron [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Successfully created port: 49f2f1d8-31ba-44d8-bb43-d85162cbfc46 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:36:27 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:36:27 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:36:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:27 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:36:28 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:36:28 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:36:28 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:36:28 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:36:28 user sudo[84623]: pam_unix(sudo:session): session closed for user root
Nov 09 03:36:28 user nova-compute[75378]: INFO oslo.privsep.daemon [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Spawned new privsep daemon via rootwrap
Nov 09 03:36:28 user nova-compute[75378]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 09 03:36:28 user nova-compute[75378]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 09 03:36:28 user nova-compute[75378]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 09 03:36:28 user nova-compute[75378]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84632
Nov 09 03:36:28 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:36:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:36:28 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Creating image(s)
Nov 09 03:36:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "/opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "/opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "/opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:28 user nova-compute[75378]: DEBUG nova.policy [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab29d2c2dda547aeb386aa641f4acd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cddc7aab3e44cf82391eebc6a167b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:36:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.196s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.202s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.175s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk 1073741824" returned: 0 in 0.060s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.243s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.177s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.224s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk 1073741824" returned: 0 in 0.050s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Cannot resize image /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Ensure instance console log exists: /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.170s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Cannot resize image /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Ensure instance console log exists: /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:30 user nova-compute[75378]: DEBUG nova.compute.manager [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:36:30 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Successfully created port: 27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:36:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:30 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:36:30 user nova-compute[75378]: INFO nova.compute.claims [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Claim successful on node user
Nov 09 03:36:31 user nova-compute[75378]: DEBUG nova.network.neutron [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Successfully updated port: 49f2f1d8-31ba-44d8-bb43-d85162cbfc46 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Acquiring lock "refresh_cache-9691c96a-287e-40f0-a7e2-70bd56d9d2d3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Acquired lock "refresh_cache-9691c96a-287e-40f0-a7e2-70bd56d9d2d3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG nova.network.neutron [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG nova.network.neutron [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG nova.compute.manager [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG nova.compute.manager [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG nova.network.neutron [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG nova.compute.manager [req-d154f829-188c-4b0a-85d0-40547a18cd04 req-f080723b-6a13-4f3f-b8fe-48a910e29994 service nova] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Received event network-changed-49f2f1d8-31ba-44d8-bb43-d85162cbfc46 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG nova.compute.manager [req-d154f829-188c-4b0a-85d0-40547a18cd04 req-f080723b-6a13-4f3f-b8fe-48a910e29994 service nova] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Refreshing instance network info cache due to event network-changed-49f2f1d8-31ba-44d8-bb43-d85162cbfc46. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d154f829-188c-4b0a-85d0-40547a18cd04 req-f080723b-6a13-4f3f-b8fe-48a910e29994 service nova] Acquiring lock "refresh_cache-9691c96a-287e-40f0-a7e2-70bd56d9d2d3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:36:31 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:36:31 user nova-compute[75378]: DEBUG nova.compute.manager [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG nova.compute.manager [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:36:31 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Creating image(s)
Nov 09 03:36:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "/opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "/opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.175s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG nova.policy [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab29d2c2dda547aeb386aa641f4acd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cddc7aab3e44cf82391eebc6a167b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.178s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk 1073741824" returned: 0 in 0.049s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.network.neutron [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Updating instance_info_cache with network_info: [{"id": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "address": "fa:16:3e:cb:7d:a8", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f2f1d8-31", "ovs_interfaceid": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Releasing lock "refresh_cache-9691c96a-287e-40f0-a7e2-70bd56d9d2d3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.compute.manager [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Instance network_info: |[{"id": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "address": "fa:16:3e:cb:7d:a8", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f2f1d8-31", "ovs_interfaceid": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d154f829-188c-4b0a-85d0-40547a18cd04 req-f080723b-6a13-4f3f-b8fe-48a910e29994 service nova] Acquired lock "refresh_cache-9691c96a-287e-40f0-a7e2-70bd56d9d2d3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.network.neutron [req-d154f829-188c-4b0a-85d0-40547a18cd04 req-f080723b-6a13-4f3f-b8fe-48a910e29994 service nova] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Refreshing network info cache for port 49f2f1d8-31ba-44d8-bb43-d85162cbfc46 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Start _get_guest_xml network_info=[{"id": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "address": "fa:16:3e:cb:7d:a8", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f2f1d8-31", "ovs_interfaceid": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:36:32 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:36:32 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.privsep.utils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75378) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1308792204',display_name='tempest-ServersNegativeTestJSON-server-1308792204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1308792204',id=1,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed1024d4b86f47b480b75e55108e6c30',ramdisk_id='',reservation_id='r-bvdat0ij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-218592793',owner_user_name='tempest-ServersNegativeTestJSON-218592793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:36:25Z,user_data=None,user_id='201443e0d5e84be0b662043093120ae3',uuid=9691c96a-287e-40f0-a7e2-70bd56d9d2d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "address": "fa:16:3e:cb:7d:a8", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f2f1d8-31", "ovs_interfaceid": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Converting VIF {"id": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "address": "fa:16:3e:cb:7d:a8", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f2f1d8-31", "ovs_interfaceid": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=49f2f1d8-31ba-44d8-bb43-d85162cbfc46,network=Network(9b18f037-ec04-4c7f-bfc8-17e90dd10787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f2f1d8-31') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.objects.instance [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lazy-loading 'pci_devices' on Instance uuid 9691c96a-287e-40f0-a7e2-70bd56d9d2d3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:36:32 user nova-compute[75378]:   <uuid>9691c96a-287e-40f0-a7e2-70bd56d9d2d3</uuid>
Nov 09 03:36:32 user nova-compute[75378]:   <name>instance-00000001</name>
Nov 09 03:36:32 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:36:32 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:36:32 user nova-compute[75378]:   <metadata>
Nov 09 03:36:32 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:36:32 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:36:32 user nova-compute[75378]:       <nova:name>tempest-ServersNegativeTestJSON-server-1308792204</nova:name>
Nov 09 03:36:32 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:36:32</nova:creationTime>
Nov 09 03:36:32 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:36:32 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:36:32 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:36:32 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:36:32 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:36:32 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:36:32 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:36:32 user nova-compute[75378]:       <nova:owner>
Nov 09 03:36:32 user nova-compute[75378]:         <nova:user uuid="201443e0d5e84be0b662043093120ae3">tempest-ServersNegativeTestJSON-218592793-project-member</nova:user>
Nov 09 03:36:32 user nova-compute[75378]:         <nova:project uuid="ed1024d4b86f47b480b75e55108e6c30">tempest-ServersNegativeTestJSON-218592793</nova:project>
Nov 09 03:36:32 user nova-compute[75378]:       </nova:owner>
Nov 09 03:36:32 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:36:32 user nova-compute[75378]:       <nova:ports>
Nov 09 03:36:32 user nova-compute[75378]:         <nova:port uuid="49f2f1d8-31ba-44d8-bb43-d85162cbfc46">
Nov 09 03:36:32 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 09 03:36:32 user nova-compute[75378]:         </nova:port>
Nov 09 03:36:32 user nova-compute[75378]:       </nova:ports>
Nov 09 03:36:32 user nova-compute[75378]:     </nova:instance>
Nov 09 03:36:32 user nova-compute[75378]:   </metadata>
Nov 09 03:36:32 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:36:32 user nova-compute[75378]:     <system>
Nov 09 03:36:32 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:36:32 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:36:32 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:36:32 user nova-compute[75378]:       <entry name="serial">9691c96a-287e-40f0-a7e2-70bd56d9d2d3</entry>
Nov 09 03:36:32 user nova-compute[75378]:       <entry name="uuid">9691c96a-287e-40f0-a7e2-70bd56d9d2d3</entry>
Nov 09 03:36:32 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:36:32 user nova-compute[75378]:     </system>
Nov 09 03:36:32 user nova-compute[75378]:   </sysinfo>
Nov 09 03:36:32 user nova-compute[75378]:   <os>
Nov 09 03:36:32 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:36:32 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:36:32 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:36:32 user nova-compute[75378]:   </os>
Nov 09 03:36:32 user nova-compute[75378]:   <features>
Nov 09 03:36:32 user nova-compute[75378]:     <acpi/>
Nov 09 03:36:32 user nova-compute[75378]:     <apic/>
Nov 09 03:36:32 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:36:32 user nova-compute[75378]:   </features>
Nov 09 03:36:32 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:36:32 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:36:32 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:36:32 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:36:32 user nova-compute[75378]:   </clock>
Nov 09 03:36:32 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:36:32 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:36:32 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:36:32 user nova-compute[75378]:   </cpu>
Nov 09 03:36:32 user nova-compute[75378]:   <devices>
Nov 09 03:36:32 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:36:32 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:36:32 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk"/>
Nov 09 03:36:32 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:36:32 user nova-compute[75378]:     </disk>
Nov 09 03:36:32 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:36:32 user nova-compute[75378]:       <mac address="fa:16:3e:cb:7d:a8"/>
Nov 09 03:36:32 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:36:32 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:36:32 user nova-compute[75378]:       <target dev="tap49f2f1d8-31"/>
Nov 09 03:36:32 user nova-compute[75378]:     </interface>
Nov 09 03:36:32 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:36:32 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/console.log" append="off"/>
Nov 09 03:36:32 user nova-compute[75378]:     </serial>
Nov 09 03:36:32 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:36:32 user nova-compute[75378]:     <video>
Nov 09 03:36:32 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:36:32 user nova-compute[75378]:     </video>
Nov 09 03:36:32 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:36:32 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:36:32 user nova-compute[75378]:     </rng>
Nov 09 03:36:32 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:36:32 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:36:32 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:36:32 user nova-compute[75378]:     </memballoon>
Nov 09 03:36:32 user nova-compute[75378]:   </devices>
Nov 09 03:36:32 user nova-compute[75378]: </domain>
Nov 09 03:36:32 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1308792204',display_name='tempest-ServersNegativeTestJSON-server-1308792204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1308792204',id=1,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed1024d4b86f47b480b75e55108e6c30',ramdisk_id='',reservation_id='r-bvdat0ij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-218592793',owner_user_name='tempest-ServersNegativeTestJSON-218592793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:36:25Z,user_data=None,user_id='201443e0d5e84be0b662043093120ae3',uuid=9691c96a-287e-40f0-a7e2-70bd56d9d2d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "address": "fa:16:3e:cb:7d:a8", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f2f1d8-31", "ovs_interfaceid": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Converting VIF {"id": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "address": "fa:16:3e:cb:7d:a8", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f2f1d8-31", "ovs_interfaceid": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=49f2f1d8-31ba-44d8-bb43-d85162cbfc46,network=Network(9b18f037-ec04-4c7f-bfc8-17e90dd10787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f2f1d8-31') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG os_vif [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=49f2f1d8-31ba-44d8-bb43-d85162cbfc46,network=Network(9b18f037-ec04-4c7f-bfc8-17e90dd10787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f2f1d8-31') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Created schema index Interface.name {{(pid=75378) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Created schema index Port.name {{(pid=75378) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Created schema index Bridge.name {{(pid=75378) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Cannot resize image /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Ensure instance console log exists: /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [POLLOUT] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '503c92ff-1468-551f-8562-b222ab12bb4c', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:32 user nova-compute[75378]: INFO oslo.privsep.daemon [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpxpbdqety/privsep.sock']
Nov 09 03:36:32 user sudo[84691]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpxpbdqety/privsep.sock
Nov 09 03:36:32 user sudo[84691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 09 03:36:33 user nova-compute[75378]: DEBUG nova.network.neutron [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Successfully created port: 4c53e537-1637-4f65-b393-a10e68383acb {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:36:33 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Successfully updated port: 27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:36:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "refresh_cache-c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:36:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquired lock "refresh_cache-c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:36:33 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:36:33 user nova-compute[75378]: DEBUG nova.network.neutron [req-d154f829-188c-4b0a-85d0-40547a18cd04 req-f080723b-6a13-4f3f-b8fe-48a910e29994 service nova] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Updated VIF entry in instance network info cache for port 49f2f1d8-31ba-44d8-bb43-d85162cbfc46. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:36:33 user nova-compute[75378]: DEBUG nova.network.neutron [req-d154f829-188c-4b0a-85d0-40547a18cd04 req-f080723b-6a13-4f3f-b8fe-48a910e29994 service nova] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Updating instance_info_cache with network_info: [{"id": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "address": "fa:16:3e:cb:7d:a8", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f2f1d8-31", "ovs_interfaceid": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:36:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d154f829-188c-4b0a-85d0-40547a18cd04 req-f080723b-6a13-4f3f-b8fe-48a910e29994 service nova] Releasing lock "refresh_cache-9691c96a-287e-40f0-a7e2-70bd56d9d2d3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:36:33 user nova-compute[75378]: DEBUG nova.compute.manager [req-d588e280-1273-47ee-bba5-03af314af264 req-7a27e4e2-3f92-42fa-8533-4d70a050479a service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received event network-changed-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:36:33 user nova-compute[75378]: DEBUG nova.compute.manager [req-d588e280-1273-47ee-bba5-03af314af264 req-7a27e4e2-3f92-42fa-8533-4d70a050479a service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Refreshing instance network info cache due to event network-changed-27d42515-fd6b-4627-bfb1-06ee1c1dc36a. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:36:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d588e280-1273-47ee-bba5-03af314af264 req-7a27e4e2-3f92-42fa-8533-4d70a050479a service nova] Acquiring lock "refresh_cache-c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:36:33 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:36:34 user sudo[84691]: pam_unix(sudo:session): session closed for user root
Nov 09 03:36:34 user nova-compute[75378]: INFO oslo.privsep.daemon [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Spawned new privsep daemon via rootwrap
Nov 09 03:36:34 user nova-compute[75378]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 09 03:36:34 user nova-compute[75378]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 09 03:36:34 user nova-compute[75378]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 09 03:36:34 user nova-compute[75378]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84695
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49f2f1d8-31, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49f2f1d8-31, col_values=(('qos', UUID('d1357c0b-3d05-4024-a217-d0f60d3a7e40')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49f2f1d8-31, col_values=(('external_ids', {'iface-id': '49f2f1d8-31ba-44d8-bb43-d85162cbfc46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:7d:a8', 'vm-uuid': '9691c96a-287e-40f0-a7e2-70bd56d9d2d3'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:34 user nova-compute[75378]: INFO os_vif [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=49f2f1d8-31ba-44d8-bb43-d85162cbfc46,network=Network(9b18f037-ec04-4c7f-bfc8-17e90dd10787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f2f1d8-31')
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Updating instance_info_cache with network_info: [{"id": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "address": "fa:16:3e:a6:f3:49", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d42515-fd", "ovs_interfaceid": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Releasing lock "refresh_cache-c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Instance network_info: |[{"id": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "address": "fa:16:3e:a6:f3:49", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d42515-fd", "ovs_interfaceid": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d588e280-1273-47ee-bba5-03af314af264 req-7a27e4e2-3f92-42fa-8533-4d70a050479a service nova] Acquired lock "refresh_cache-c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.network.neutron [req-d588e280-1273-47ee-bba5-03af314af264 req-7a27e4e2-3f92-42fa-8533-4d70a050479a service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Refreshing network info cache for port 27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Start _get_guest_xml network_info=[{"id": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "address": "fa:16:3e:a6:f3:49", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d42515-fd", "ovs_interfaceid": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] No VIF found with MAC fa:16:3e:cb:7d:a8, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:36:34 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:36:34 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1026804955',display_name='tempest-ServerRescueNegativeTestJSON-server-1026804955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1026804955',id=2,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87cddc7aab3e44cf82391eebc6a167b1',ramdisk_id='',reservation_id='r-lxupg3g9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1449314788',owner_user_name='tempest-ServerRescueNegativeTestJSON-1449314788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:36:28Z,user_data=None,user_id='ab29d2c2dda547aeb386aa641f4acd24',uuid=c647ac61-b8d0-4b30-b1cc-86ddc896eaa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "address": "fa:16:3e:a6:f3:49", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d42515-fd", "ovs_interfaceid": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converting VIF {"id": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "address": "fa:16:3e:a6:f3:49", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d42515-fd", "ovs_interfaceid": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f3:49,bridge_name='br-int',has_traffic_filtering=True,id=27d42515-fd6b-4627-bfb1-06ee1c1dc36a,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d42515-fd') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.objects.instance [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'pci_devices' on Instance uuid c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:36:34 user nova-compute[75378]:   <uuid>c647ac61-b8d0-4b30-b1cc-86ddc896eaa3</uuid>
Nov 09 03:36:34 user nova-compute[75378]:   <name>instance-00000002</name>
Nov 09 03:36:34 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:36:34 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:36:34 user nova-compute[75378]:   <metadata>
Nov 09 03:36:34 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:36:34 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:36:34 user nova-compute[75378]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1026804955</nova:name>
Nov 09 03:36:34 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:36:34</nova:creationTime>
Nov 09 03:36:34 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:36:34 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:36:34 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:36:34 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:36:34 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:36:34 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:36:34 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:36:34 user nova-compute[75378]:       <nova:owner>
Nov 09 03:36:34 user nova-compute[75378]:         <nova:user uuid="ab29d2c2dda547aeb386aa641f4acd24">tempest-ServerRescueNegativeTestJSON-1449314788-project-member</nova:user>
Nov 09 03:36:34 user nova-compute[75378]:         <nova:project uuid="87cddc7aab3e44cf82391eebc6a167b1">tempest-ServerRescueNegativeTestJSON-1449314788</nova:project>
Nov 09 03:36:34 user nova-compute[75378]:       </nova:owner>
Nov 09 03:36:34 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:36:34 user nova-compute[75378]:       <nova:ports>
Nov 09 03:36:34 user nova-compute[75378]:         <nova:port uuid="27d42515-fd6b-4627-bfb1-06ee1c1dc36a">
Nov 09 03:36:34 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 03:36:34 user nova-compute[75378]:         </nova:port>
Nov 09 03:36:34 user nova-compute[75378]:       </nova:ports>
Nov 09 03:36:34 user nova-compute[75378]:     </nova:instance>
Nov 09 03:36:34 user nova-compute[75378]:   </metadata>
Nov 09 03:36:34 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:36:34 user nova-compute[75378]:     <system>
Nov 09 03:36:34 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:36:34 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:36:34 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:36:34 user nova-compute[75378]:       <entry name="serial">c647ac61-b8d0-4b30-b1cc-86ddc896eaa3</entry>
Nov 09 03:36:34 user nova-compute[75378]:       <entry name="uuid">c647ac61-b8d0-4b30-b1cc-86ddc896eaa3</entry>
Nov 09 03:36:34 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:36:34 user nova-compute[75378]:     </system>
Nov 09 03:36:34 user nova-compute[75378]:   </sysinfo>
Nov 09 03:36:34 user nova-compute[75378]:   <os>
Nov 09 03:36:34 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:36:34 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:36:34 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:36:34 user nova-compute[75378]:   </os>
Nov 09 03:36:34 user nova-compute[75378]:   <features>
Nov 09 03:36:34 user nova-compute[75378]:     <acpi/>
Nov 09 03:36:34 user nova-compute[75378]:     <apic/>
Nov 09 03:36:34 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:36:34 user nova-compute[75378]:   </features>
Nov 09 03:36:34 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:36:34 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:36:34 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:36:34 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:36:34 user nova-compute[75378]:   </clock>
Nov 09 03:36:34 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:36:34 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:36:34 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:36:34 user nova-compute[75378]:   </cpu>
Nov 09 03:36:34 user nova-compute[75378]:   <devices>
Nov 09 03:36:34 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:36:34 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:36:34 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk"/>
Nov 09 03:36:34 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:36:34 user nova-compute[75378]:     </disk>
Nov 09 03:36:34 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:36:34 user nova-compute[75378]:       <mac address="fa:16:3e:a6:f3:49"/>
Nov 09 03:36:34 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:36:34 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:36:34 user nova-compute[75378]:       <target dev="tap27d42515-fd"/>
Nov 09 03:36:34 user nova-compute[75378]:     </interface>
Nov 09 03:36:34 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:36:34 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/console.log" append="off"/>
Nov 09 03:36:34 user nova-compute[75378]:     </serial>
Nov 09 03:36:34 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:36:34 user nova-compute[75378]:     <video>
Nov 09 03:36:34 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:36:34 user nova-compute[75378]:     </video>
Nov 09 03:36:34 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:36:34 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:36:34 user nova-compute[75378]:     </rng>
Nov 09 03:36:34 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:36:34 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:36:34 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:36:34 user nova-compute[75378]:     </memballoon>
Nov 09 03:36:34 user nova-compute[75378]:   </devices>
Nov 09 03:36:34 user nova-compute[75378]: </domain>
Nov 09 03:36:34 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1026804955',display_name='tempest-ServerRescueNegativeTestJSON-server-1026804955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1026804955',id=2,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87cddc7aab3e44cf82391eebc6a167b1',ramdisk_id='',reservation_id='r-lxupg3g9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1449314788',owner_user_name='tempest-ServerRescueNegativeTestJSON-1449314788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:36:28Z,user_data=None,user_id='ab29d2c2dda547aeb386aa641f4acd24',uuid=c647ac61-b8d0-4b30-b1cc-86ddc896eaa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "address": "fa:16:3e:a6:f3:49", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d42515-fd", "ovs_interfaceid": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converting VIF {"id": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "address": "fa:16:3e:a6:f3:49", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d42515-fd", "ovs_interfaceid": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f3:49,bridge_name='br-int',has_traffic_filtering=True,id=27d42515-fd6b-4627-bfb1-06ee1c1dc36a,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d42515-fd') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG os_vif [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f3:49,bridge_name='br-int',has_traffic_filtering=True,id=27d42515-fd6b-4627-bfb1-06ee1c1dc36a,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d42515-fd') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e19443b-c8cc-531c-bf7a-b5856a8c5178', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27d42515-fd, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27d42515-fd, col_values=(('qos', UUID('656e5e42-d69d-4e59-8cd6-8f0f3db20420')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27d42515-fd, col_values=(('external_ids', {'iface-id': '27d42515-fd6b-4627-bfb1-06ee1c1dc36a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:f3:49', 'vm-uuid': 'c647ac61-b8d0-4b30-b1cc-86ddc896eaa3'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:34 user nova-compute[75378]: INFO os_vif [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f3:49,bridge_name='br-int',has_traffic_filtering=True,id=27d42515-fd6b-4627-bfb1-06ee1c1dc36a,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d42515-fd')
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:36:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] No VIF found with MAC fa:16:3e:a6:f3:49, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:36:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "2f475dba-59f5-414a-8156-8b438601ecfd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:35 user nova-compute[75378]: DEBUG nova.compute.manager [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:36:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:35 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:36:35 user nova-compute[75378]: INFO nova.compute.claims [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Claim successful on node user
Nov 09 03:36:35 user nova-compute[75378]: DEBUG nova.network.neutron [req-d588e280-1273-47ee-bba5-03af314af264 req-7a27e4e2-3f92-42fa-8533-4d70a050479a service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Updated VIF entry in instance network info cache for port 27d42515-fd6b-4627-bfb1-06ee1c1dc36a. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:36:35 user nova-compute[75378]: DEBUG nova.network.neutron [req-d588e280-1273-47ee-bba5-03af314af264 req-7a27e4e2-3f92-42fa-8533-4d70a050479a service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Updating instance_info_cache with network_info: [{"id": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "address": "fa:16:3e:a6:f3:49", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d42515-fd", "ovs_interfaceid": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:36:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d588e280-1273-47ee-bba5-03af314af264 req-7a27e4e2-3f92-42fa-8533-4d70a050479a service nova] Releasing lock "refresh_cache-c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG nova.compute.manager [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG nova.network.neutron [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Successfully updated port: 4c53e537-1637-4f65-b393-a10e68383acb {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG nova.compute.manager [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG nova.network.neutron [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "refresh_cache-6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquired lock "refresh_cache-6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG nova.network.neutron [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:36:36 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:36:36 user nova-compute[75378]: DEBUG nova.compute.manager [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG nova.network.neutron [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG nova.compute.manager [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:36:36 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Creating image(s)
Nov 09 03:36:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "/opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "/opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG nova.compute.manager [req-7e6074fc-f8f4-4de1-8f2d-3811c2d9331b req-1bd3089f-9b9f-43df-8926-69d248788523 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Received event network-changed-4c53e537-1637-4f65-b393-a10e68383acb {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG nova.compute.manager [req-7e6074fc-f8f4-4de1-8f2d-3811c2d9331b req-1bd3089f-9b9f-43df-8926-69d248788523 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Refreshing instance network info cache due to event network-changed-4c53e537-1637-4f65-b393-a10e68383acb. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7e6074fc-f8f4-4de1-8f2d-3811c2d9331b req-1bd3089f-9b9f-43df-8926-69d248788523 service nova] Acquiring lock "refresh_cache-6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.200s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:36 user nova-compute[75378]: DEBUG nova.policy [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7bb5d4c95c341beaa22c1bbeacaf4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0bda222cd54a44bd26b140d08d8274', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.network.neutron [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Updating instance_info_cache with network_info: [{"id": "4c53e537-1637-4f65-b393-a10e68383acb", "address": "fa:16:3e:d8:76:bf", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c53e537-16", "ovs_interfaceid": "4c53e537-1637-4f65-b393-a10e68383acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Releasing lock "refresh_cache-6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.compute.manager [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Instance network_info: |[{"id": "4c53e537-1637-4f65-b393-a10e68383acb", "address": "fa:16:3e:d8:76:bf", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c53e537-16", "ovs_interfaceid": "4c53e537-1637-4f65-b393-a10e68383acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7e6074fc-f8f4-4de1-8f2d-3811c2d9331b req-1bd3089f-9b9f-43df-8926-69d248788523 service nova] Acquired lock "refresh_cache-6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.network.neutron [req-7e6074fc-f8f4-4de1-8f2d-3811c2d9331b req-1bd3089f-9b9f-43df-8926-69d248788523 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Refreshing network info cache for port 4c53e537-1637-4f65-b393-a10e68383acb {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Start _get_guest_xml network_info=[{"id": "4c53e537-1637-4f65-b393-a10e68383acb", "address": "fa:16:3e:d8:76:bf", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c53e537-16", "ovs_interfaceid": "4c53e537-1637-4f65-b393-a10e68383acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:36:37 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:36:37 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:36:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.257s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-126426902',display_name='tempest-ServerRescueNegativeTestJSON-server-126426902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-126426902',id=3,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87cddc7aab3e44cf82391eebc6a167b1',ramdisk_id='',reservation_id='r-2farfnrw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1449314788',owner_user_name='tempest-ServerRescueNegativeTestJSON-1449314788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:36:31Z,user_data=None,user_id='ab29d2c2dda547aeb386aa641f4acd24',uuid=6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c53e537-1637-4f65-b393-a10e68383acb", "address": "fa:16:3e:d8:76:bf", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c53e537-16", "ovs_interfaceid": "4c53e537-1637-4f65-b393-a10e68383acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converting VIF {"id": "4c53e537-1637-4f65-b393-a10e68383acb", "address": "fa:16:3e:d8:76:bf", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c53e537-16", "ovs_interfaceid": "4c53e537-1637-4f65-b393-a10e68383acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:76:bf,bridge_name='br-int',has_traffic_filtering=True,id=4c53e537-1637-4f65-b393-a10e68383acb,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c53e537-16') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.objects.instance [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk 1073741824" returned: 0 in 0.158s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.421s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:36:37 user nova-compute[75378]:   <uuid>6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76</uuid>
Nov 09 03:36:37 user nova-compute[75378]:   <name>instance-00000003</name>
Nov 09 03:36:37 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:36:37 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:36:37 user nova-compute[75378]:   <metadata>
Nov 09 03:36:37 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:36:37 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:36:37 user nova-compute[75378]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-126426902</nova:name>
Nov 09 03:36:37 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:36:37</nova:creationTime>
Nov 09 03:36:37 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:36:37 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:36:37 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:36:37 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:36:37 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:36:37 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:36:37 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:36:37 user nova-compute[75378]:       <nova:owner>
Nov 09 03:36:37 user nova-compute[75378]:         <nova:user uuid="ab29d2c2dda547aeb386aa641f4acd24">tempest-ServerRescueNegativeTestJSON-1449314788-project-member</nova:user>
Nov 09 03:36:37 user nova-compute[75378]:         <nova:project uuid="87cddc7aab3e44cf82391eebc6a167b1">tempest-ServerRescueNegativeTestJSON-1449314788</nova:project>
Nov 09 03:36:37 user nova-compute[75378]:       </nova:owner>
Nov 09 03:36:37 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:36:37 user nova-compute[75378]:       <nova:ports>
Nov 09 03:36:37 user nova-compute[75378]:         <nova:port uuid="4c53e537-1637-4f65-b393-a10e68383acb">
Nov 09 03:36:37 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 03:36:37 user nova-compute[75378]:         </nova:port>
Nov 09 03:36:37 user nova-compute[75378]:       </nova:ports>
Nov 09 03:36:37 user nova-compute[75378]:     </nova:instance>
Nov 09 03:36:37 user nova-compute[75378]:   </metadata>
Nov 09 03:36:37 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:36:37 user nova-compute[75378]:     <system>
Nov 09 03:36:37 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:36:37 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:36:37 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:36:37 user nova-compute[75378]:       <entry name="serial">6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76</entry>
Nov 09 03:36:37 user nova-compute[75378]:       <entry name="uuid">6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76</entry>
Nov 09 03:36:37 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:36:37 user nova-compute[75378]:     </system>
Nov 09 03:36:37 user nova-compute[75378]:   </sysinfo>
Nov 09 03:36:37 user nova-compute[75378]:   <os>
Nov 09 03:36:37 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:36:37 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:36:37 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:36:37 user nova-compute[75378]:   </os>
Nov 09 03:36:37 user nova-compute[75378]:   <features>
Nov 09 03:36:37 user nova-compute[75378]:     <acpi/>
Nov 09 03:36:37 user nova-compute[75378]:     <apic/>
Nov 09 03:36:37 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:36:37 user nova-compute[75378]:   </features>
Nov 09 03:36:37 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:36:37 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:36:37 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:36:37 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:36:37 user nova-compute[75378]:   </clock>
Nov 09 03:36:37 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:36:37 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:36:37 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:36:37 user nova-compute[75378]:   </cpu>
Nov 09 03:36:37 user nova-compute[75378]:   <devices>
Nov 09 03:36:37 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:36:37 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:36:37 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk"/>
Nov 09 03:36:37 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:36:37 user nova-compute[75378]:     </disk>
Nov 09 03:36:37 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:36:37 user nova-compute[75378]:       <mac address="fa:16:3e:d8:76:bf"/>
Nov 09 03:36:37 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:36:37 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:36:37 user nova-compute[75378]:       <target dev="tap4c53e537-16"/>
Nov 09 03:36:37 user nova-compute[75378]:     </interface>
Nov 09 03:36:37 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:36:37 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/console.log" append="off"/>
Nov 09 03:36:37 user nova-compute[75378]:     </serial>
Nov 09 03:36:37 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:36:37 user nova-compute[75378]:     <video>
Nov 09 03:36:37 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:36:37 user nova-compute[75378]:     </video>
Nov 09 03:36:37 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:36:37 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:36:37 user nova-compute[75378]:     </rng>
Nov 09 03:36:37 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:36:37 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:36:37 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:36:37 user nova-compute[75378]:     </memballoon>
Nov 09 03:36:37 user nova-compute[75378]:   </devices>
Nov 09 03:36:37 user nova-compute[75378]: </domain>
Nov 09 03:36:37 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-126426902',display_name='tempest-ServerRescueNegativeTestJSON-server-126426902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-126426902',id=3,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87cddc7aab3e44cf82391eebc6a167b1',ramdisk_id='',reservation_id='r-2farfnrw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1449314788',owner_user_name='tempest-ServerRescueNegativeTestJSON-1449314788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:36:31Z,user_data=None,user_id='ab29d2c2dda547aeb386aa641f4acd24',uuid=6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c53e537-1637-4f65-b393-a10e68383acb", "address": "fa:16:3e:d8:76:bf", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c53e537-16", "ovs_interfaceid": "4c53e537-1637-4f65-b393-a10e68383acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converting VIF {"id": "4c53e537-1637-4f65-b393-a10e68383acb", "address": "fa:16:3e:d8:76:bf", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c53e537-16", "ovs_interfaceid": "4c53e537-1637-4f65-b393-a10e68383acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:76:bf,bridge_name='br-int',has_traffic_filtering=True,id=4c53e537-1637-4f65-b393-a10e68383acb,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c53e537-16') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG os_vif [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:76:bf,bridge_name='br-int',has_traffic_filtering=True,id=4c53e537-1637-4f65-b393-a10e68383acb,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c53e537-16') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b8b554dd-8a4b-50de-ad6d-b2143b29965b', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c53e537-16, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c53e537-16, col_values=(('qos', UUID('faff080d-44a7-4ddb-97e6-18b74a6e8157')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c53e537-16, col_values=(('external_ids', {'iface-id': '4c53e537-1637-4f65-b393-a10e68383acb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:76:bf', 'vm-uuid': '6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:37 user nova-compute[75378]: INFO os_vif [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:76:bf,bridge_name='br-int',has_traffic_filtering=True,id=4c53e537-1637-4f65-b393-a10e68383acb,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c53e537-16')
Nov 09 03:36:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.196s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] No VIF found with MAC fa:16:3e:d8:76:bf, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Cannot resize image /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Ensure instance console log exists: /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.network.neutron [req-7e6074fc-f8f4-4de1-8f2d-3811c2d9331b req-1bd3089f-9b9f-43df-8926-69d248788523 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Updated VIF entry in instance network info cache for port 4c53e537-1637-4f65-b393-a10e68383acb. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG nova.network.neutron [req-7e6074fc-f8f4-4de1-8f2d-3811c2d9331b req-1bd3089f-9b9f-43df-8926-69d248788523 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Updating instance_info_cache with network_info: [{"id": "4c53e537-1637-4f65-b393-a10e68383acb", "address": "fa:16:3e:d8:76:bf", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c53e537-16", "ovs_interfaceid": "4c53e537-1637-4f65-b393-a10e68383acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:36:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7e6074fc-f8f4-4de1-8f2d-3811c2d9331b req-1bd3089f-9b9f-43df-8926-69d248788523 service nova] Releasing lock "refresh_cache-6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:36:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:39 user nova-compute[75378]: DEBUG nova.network.neutron [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Successfully created port: d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:36:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:40 user nova-compute[75378]: DEBUG nova.network.neutron [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Successfully updated port: d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:36:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:36:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquired lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:36:40 user nova-compute[75378]: DEBUG nova.network.neutron [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:36:41 user nova-compute[75378]: DEBUG nova.compute.manager [req-89588b61-ee16-463d-abc2-69183996f0a4 req-437fc2ef-92a3-4af2-8a65-0457e9d5e2f6 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received event network-changed-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:36:41 user nova-compute[75378]: DEBUG nova.compute.manager [req-89588b61-ee16-463d-abc2-69183996f0a4 req-437fc2ef-92a3-4af2-8a65-0457e9d5e2f6 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Refreshing instance network info cache due to event network-changed-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:36:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-89588b61-ee16-463d-abc2-69183996f0a4 req-437fc2ef-92a3-4af2-8a65-0457e9d5e2f6 service nova] Acquiring lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:36:41 user nova-compute[75378]: DEBUG nova.network.neutron [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:36:41 user nova-compute[75378]: DEBUG nova.compute.manager [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:36:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:36:41 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Instance spawned successfully.
Nov 09 03:36:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:36:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:41 user nova-compute[75378]: INFO nova.compute.manager [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Took 16.08 seconds to spawn the instance on the hypervisor.
Nov 09 03:36:41 user nova-compute[75378]: DEBUG nova.compute.manager [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:36:41 user nova-compute[75378]: INFO nova.compute.manager [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Took 17.21 seconds to build instance.
Nov 09 03:36:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e144b417-8b40-4818-874a-d6ed26457032 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.466s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:41 user nova-compute[75378]: DEBUG nova.network.neutron [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Updating instance_info_cache with network_info: [{"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:36:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Releasing lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:36:41 user nova-compute[75378]: DEBUG nova.compute.manager [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Instance network_info: |[{"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:36:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-89588b61-ee16-463d-abc2-69183996f0a4 req-437fc2ef-92a3-4af2-8a65-0457e9d5e2f6 service nova] Acquired lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:36:41 user nova-compute[75378]: DEBUG nova.network.neutron [req-89588b61-ee16-463d-abc2-69183996f0a4 req-437fc2ef-92a3-4af2-8a65-0457e9d5e2f6 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Refreshing network info cache for port d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:36:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Start _get_guest_xml network_info=[{"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:36:41 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:36:41 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1138780210',display_name='tempest-ServerActionsTestOtherB-server-1138780210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1138780210',id=4,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+s7M8RwDJb3loYxaUJGVxjbTQ9aVX7ngKf1RZUNQALVC7bsteyYsWXKwZsj2SvyMQBcJEfxsQ8l4Bn0IQtqoWxZ715fiA5I3KyJRgBFHf7jRe97Ql+ZXV7Ej5ZLqWSCg==',key_name='tempest-keypair-904427918',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb0bda222cd54a44bd26b140d08d8274',ramdisk_id='',reservation_id='r-u0jhm5ex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1007633314',owner_user_name='tempest-ServerActionsTestOtherB-1007633314-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:36:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7bb5d4c95c341beaa22c1bbeacaf4f7',uuid=2f475dba-59f5-414a-8156-8b438601ecfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Converting VIF {"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:9f:69,bridge_name='br-int',has_traffic_filtering=True,id=d0fa9225-bc1d-4d57-b259-5a6d1e3638f8,network=Network(2e704dce-6cba-4cf1-bd3e-d05da48d7839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fa9225-bc') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.objects.instance [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f475dba-59f5-414a-8156-8b438601ecfd {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:36:42 user nova-compute[75378]:   <uuid>2f475dba-59f5-414a-8156-8b438601ecfd</uuid>
Nov 09 03:36:42 user nova-compute[75378]:   <name>instance-00000004</name>
Nov 09 03:36:42 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:36:42 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:36:42 user nova-compute[75378]:   <metadata>
Nov 09 03:36:42 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:36:42 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:36:42 user nova-compute[75378]:       <nova:name>tempest-ServerActionsTestOtherB-server-1138780210</nova:name>
Nov 09 03:36:42 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:36:41</nova:creationTime>
Nov 09 03:36:42 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:36:42 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:36:42 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:36:42 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:36:42 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:36:42 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:36:42 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:36:42 user nova-compute[75378]:       <nova:owner>
Nov 09 03:36:42 user nova-compute[75378]:         <nova:user uuid="e7bb5d4c95c341beaa22c1bbeacaf4f7">tempest-ServerActionsTestOtherB-1007633314-project-member</nova:user>
Nov 09 03:36:42 user nova-compute[75378]:         <nova:project uuid="cb0bda222cd54a44bd26b140d08d8274">tempest-ServerActionsTestOtherB-1007633314</nova:project>
Nov 09 03:36:42 user nova-compute[75378]:       </nova:owner>
Nov 09 03:36:42 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:36:42 user nova-compute[75378]:       <nova:ports>
Nov 09 03:36:42 user nova-compute[75378]:         <nova:port uuid="d0fa9225-bc1d-4d57-b259-5a6d1e3638f8">
Nov 09 03:36:42 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 03:36:42 user nova-compute[75378]:         </nova:port>
Nov 09 03:36:42 user nova-compute[75378]:       </nova:ports>
Nov 09 03:36:42 user nova-compute[75378]:     </nova:instance>
Nov 09 03:36:42 user nova-compute[75378]:   </metadata>
Nov 09 03:36:42 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:36:42 user nova-compute[75378]:     <system>
Nov 09 03:36:42 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:36:42 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:36:42 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:36:42 user nova-compute[75378]:       <entry name="serial">2f475dba-59f5-414a-8156-8b438601ecfd</entry>
Nov 09 03:36:42 user nova-compute[75378]:       <entry name="uuid">2f475dba-59f5-414a-8156-8b438601ecfd</entry>
Nov 09 03:36:42 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:36:42 user nova-compute[75378]:     </system>
Nov 09 03:36:42 user nova-compute[75378]:   </sysinfo>
Nov 09 03:36:42 user nova-compute[75378]:   <os>
Nov 09 03:36:42 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:36:42 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:36:42 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:36:42 user nova-compute[75378]:   </os>
Nov 09 03:36:42 user nova-compute[75378]:   <features>
Nov 09 03:36:42 user nova-compute[75378]:     <acpi/>
Nov 09 03:36:42 user nova-compute[75378]:     <apic/>
Nov 09 03:36:42 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:36:42 user nova-compute[75378]:   </features>
Nov 09 03:36:42 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:36:42 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:36:42 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:36:42 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:36:42 user nova-compute[75378]:   </clock>
Nov 09 03:36:42 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:36:42 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:36:42 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:36:42 user nova-compute[75378]:   </cpu>
Nov 09 03:36:42 user nova-compute[75378]:   <devices>
Nov 09 03:36:42 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:36:42 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:36:42 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk"/>
Nov 09 03:36:42 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:36:42 user nova-compute[75378]:     </disk>
Nov 09 03:36:42 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:36:42 user nova-compute[75378]:       <mac address="fa:16:3e:07:9f:69"/>
Nov 09 03:36:42 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:36:42 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:36:42 user nova-compute[75378]:       <target dev="tapd0fa9225-bc"/>
Nov 09 03:36:42 user nova-compute[75378]:     </interface>
Nov 09 03:36:42 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:36:42 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/console.log" append="off"/>
Nov 09 03:36:42 user nova-compute[75378]:     </serial>
Nov 09 03:36:42 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:36:42 user nova-compute[75378]:     <video>
Nov 09 03:36:42 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:36:42 user nova-compute[75378]:     </video>
Nov 09 03:36:42 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:36:42 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:36:42 user nova-compute[75378]:     </rng>
Nov 09 03:36:42 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:36:42 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:36:42 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:36:42 user nova-compute[75378]:     </memballoon>
Nov 09 03:36:42 user nova-compute[75378]:   </devices>
Nov 09 03:36:42 user nova-compute[75378]: </domain>
Nov 09 03:36:42 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1138780210',display_name='tempest-ServerActionsTestOtherB-server-1138780210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1138780210',id=4,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+s7M8RwDJb3loYxaUJGVxjbTQ9aVX7ngKf1RZUNQALVC7bsteyYsWXKwZsj2SvyMQBcJEfxsQ8l4Bn0IQtqoWxZ715fiA5I3KyJRgBFHf7jRe97Ql+ZXV7Ej5ZLqWSCg==',key_name='tempest-keypair-904427918',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb0bda222cd54a44bd26b140d08d8274',ramdisk_id='',reservation_id='r-u0jhm5ex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1007633314',owner_user_name='tempest-ServerActionsTestOtherB-1007633314-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:36:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7bb5d4c95c341beaa22c1bbeacaf4f7',uuid=2f475dba-59f5-414a-8156-8b438601ecfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Converting VIF {"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:9f:69,bridge_name='br-int',has_traffic_filtering=True,id=d0fa9225-bc1d-4d57-b259-5a6d1e3638f8,network=Network(2e704dce-6cba-4cf1-bd3e-d05da48d7839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fa9225-bc') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG os_vif [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:9f:69,bridge_name='br-int',has_traffic_filtering=True,id=d0fa9225-bc1d-4d57-b259-5a6d1e3638f8,network=Network(2e704dce-6cba-4cf1-bd3e-d05da48d7839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fa9225-bc') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8cc8b611-6ed6-5dff-86ef-69553918d72c', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:36:42 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Instance spawned successfully.
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0fa9225-bc, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0fa9225-bc, col_values=(('qos', UUID('2bff65c1-8c05-4dd7-b0c3-54031054506c')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0fa9225-bc, col_values=(('external_ids', {'iface-id': 'd0fa9225-bc1d-4d57-b259-5a6d1e3638f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:9f:69', 'vm-uuid': '2f475dba-59f5-414a-8156-8b438601ecfd'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:42 user nova-compute[75378]: INFO os_vif [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:9f:69,bridge_name='br-int',has_traffic_filtering=True,id=d0fa9225-bc1d-4d57-b259-5a6d1e3638f8,network=Network(2e704dce-6cba-4cf1-bd3e-d05da48d7839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fa9225-bc')
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] No VIF found with MAC fa:16:3e:07:9f:69, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.compute.manager [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:36:42 user nova-compute[75378]: INFO nova.compute.manager [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Took 13.96 seconds to spawn the instance on the hypervisor.
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:36:42 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Instance spawned successfully.
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:42 user nova-compute[75378]: INFO nova.compute.manager [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Took 15.00 seconds to build instance.
Nov 09 03:36:42 user nova-compute[75378]: INFO nova.compute.manager [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Took 10.94 seconds to spawn the instance on the hypervisor.
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.compute.manager [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a00f0f1-aea7-4b0e-aacb-adc3ea6c9256 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.174s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.compute.manager [req-ca33e332-6f62-4f0d-9372-1a3ea7bb2cfe req-3e64ee03-7110-4139-91f1-73c5202e0f64 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received event network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ca33e332-6f62-4f0d-9372-1a3ea7bb2cfe req-3e64ee03-7110-4139-91f1-73c5202e0f64 service nova] Acquiring lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ca33e332-6f62-4f0d-9372-1a3ea7bb2cfe req-3e64ee03-7110-4139-91f1-73c5202e0f64 service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ca33e332-6f62-4f0d-9372-1a3ea7bb2cfe req-3e64ee03-7110-4139-91f1-73c5202e0f64 service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:42 user nova-compute[75378]: DEBUG nova.compute.manager [req-ca33e332-6f62-4f0d-9372-1a3ea7bb2cfe req-3e64ee03-7110-4139-91f1-73c5202e0f64 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] No waiting events found dispatching network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:36:42 user nova-compute[75378]: WARNING nova.compute.manager [req-ca33e332-6f62-4f0d-9372-1a3ea7bb2cfe req-3e64ee03-7110-4139-91f1-73c5202e0f64 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received unexpected event network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a for instance with vm_state active and task_state None.
Nov 09 03:36:42 user nova-compute[75378]: INFO nova.compute.manager [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Took 11.91 seconds to build instance.
Nov 09 03:36:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-593353b1-4f38-4747-b2c3-7c388f391c1b tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.097s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:43 user nova-compute[75378]: DEBUG nova.network.neutron [req-89588b61-ee16-463d-abc2-69183996f0a4 req-437fc2ef-92a3-4af2-8a65-0457e9d5e2f6 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Updated VIF entry in instance network info cache for port d0fa9225-bc1d-4d57-b259-5a6d1e3638f8. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:36:43 user nova-compute[75378]: DEBUG nova.network.neutron [req-89588b61-ee16-463d-abc2-69183996f0a4 req-437fc2ef-92a3-4af2-8a65-0457e9d5e2f6 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Updating instance_info_cache with network_info: [{"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:36:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-89588b61-ee16-463d-abc2-69183996f0a4 req-437fc2ef-92a3-4af2-8a65-0457e9d5e2f6 service nova] Releasing lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:36:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:44 user nova-compute[75378]: DEBUG nova.compute.manager [req-1a35793b-1ede-4a5f-8ac2-d1b92f7a999f req-8a619f8d-4141-42c9-9158-99ead7fe89b5 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received event network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:36:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1a35793b-1ede-4a5f-8ac2-d1b92f7a999f req-8a619f8d-4141-42c9-9158-99ead7fe89b5 service nova] Acquiring lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1a35793b-1ede-4a5f-8ac2-d1b92f7a999f req-8a619f8d-4141-42c9-9158-99ead7fe89b5 service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1a35793b-1ede-4a5f-8ac2-d1b92f7a999f req-8a619f8d-4141-42c9-9158-99ead7fe89b5 service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:44 user nova-compute[75378]: DEBUG nova.compute.manager [req-1a35793b-1ede-4a5f-8ac2-d1b92f7a999f req-8a619f8d-4141-42c9-9158-99ead7fe89b5 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] No waiting events found dispatching network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:36:44 user nova-compute[75378]: WARNING nova.compute.manager [req-1a35793b-1ede-4a5f-8ac2-d1b92f7a999f req-8a619f8d-4141-42c9-9158-99ead7fe89b5 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received unexpected event network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a for instance with vm_state active and task_state None.
Nov 09 03:36:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:36:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:36:47 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Instance spawned successfully.
Nov 09 03:36:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:36:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:36:47 user nova-compute[75378]: INFO nova.compute.manager [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Took 10.73 seconds to spawn the instance on the hypervisor.
Nov 09 03:36:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:36:47 user nova-compute[75378]: INFO nova.compute.manager [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Took 11.66 seconds to build instance.
Nov 09 03:36:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-deb1d044-11d1-432f-9b12-cfd18421cfd7 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "2f475dba-59f5-414a-8156-8b438601ecfd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.853s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "70a7686e-042c-4be8-8182-69c62027c744" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "70a7686e-042c-4be8-8182-69c62027c744" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:49 user nova-compute[75378]: DEBUG nova.compute.manager [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:36:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:49 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:36:49 user nova-compute[75378]: INFO nova.compute.claims [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Claim successful on node user
Nov 09 03:36:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:49 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:36:49 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:36:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.842s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:50 user nova-compute[75378]: DEBUG nova.compute.manager [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:36:50 user nova-compute[75378]: DEBUG nova.compute.manager [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:36:50 user nova-compute[75378]: DEBUG nova.network.neutron [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:36:50 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:36:50 user nova-compute[75378]: DEBUG nova.compute.manager [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:36:50 user nova-compute[75378]: DEBUG nova.policy [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6811290b00b044f1b1a0430f775d512a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e8a43607594d039f7514185feb8e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:36:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:50 user nova-compute[75378]: DEBUG nova.compute.manager [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:36:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:36:50 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Creating image(s)
Nov 09 03:36:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "/opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "/opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "/opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.314s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.227s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk 1073741824" returned: 0 in 0.079s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.280s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:51 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:36:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:51 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Cannot resize image /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:36:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:36:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Ensure instance console log exists: /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:36:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.010s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquiring lock "0aa21edc-dc12-46ad-925d-47bc5b576172" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:51 user nova-compute[75378]: DEBUG nova.compute.manager [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:36:51 user nova-compute[75378]: DEBUG nova.network.neutron [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Successfully created port: cf0655e0-c321-449f-840d-89a729a9b6ad {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:36:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:52 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:36:52 user nova-compute[75378]: INFO nova.compute.claims [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Claim successful on node user
Nov 09 03:36:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:52 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:36:52 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:36:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:36:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:36:52 user nova-compute[75378]: DEBUG nova.network.neutron [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:36:52 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:36:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG nova.compute.manager [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:36:53 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Creating image(s)
Nov 09 03:36:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquiring lock "/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG nova.policy [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b1261613bc54e7f96c70ed27d8a829e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e0442fe540cda81d2a5467664870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.317s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG nova.network.neutron [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Successfully updated port: cf0655e0-c321-449f-840d-89a729a9b6ad {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "refresh_cache-70a7686e-042c-4be8-8182-69c62027c744" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquired lock "refresh_cache-70a7686e-042c-4be8-8182-69c62027c744" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG nova.network.neutron [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.337s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-92e95e45-a72f-4543-aae8-604ab04a3dfa req-c858f450-e041-4655-80d7-5c3b3f4b1c1e service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Received event network-changed-cf0655e0-c321-449f-840d-89a729a9b6ad {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-92e95e45-a72f-4543-aae8-604ab04a3dfa req-c858f450-e041-4655-80d7-5c3b3f4b1c1e service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Refreshing instance network info cache due to event network-changed-cf0655e0-c321-449f-840d-89a729a9b6ad. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-92e95e45-a72f-4543-aae8-604ab04a3dfa req-c858f450-e041-4655-80d7-5c3b3f4b1c1e service nova] Acquiring lock "refresh_cache-70a7686e-042c-4be8-8182-69c62027c744" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk 1073741824" returned: 0 in 0.096s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.439s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.network.neutron [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.281s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Cannot resize image /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Ensure instance console log exists: /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.network.neutron [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Updating instance_info_cache with network_info: [{"id": "cf0655e0-c321-449f-840d-89a729a9b6ad", "address": "fa:16:3e:83:d7:60", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0655e0-c3", "ovs_interfaceid": "cf0655e0-c321-449f-840d-89a729a9b6ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Releasing lock "refresh_cache-70a7686e-042c-4be8-8182-69c62027c744" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.compute.manager [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Instance network_info: |[{"id": "cf0655e0-c321-449f-840d-89a729a9b6ad", "address": "fa:16:3e:83:d7:60", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0655e0-c3", "ovs_interfaceid": "cf0655e0-c321-449f-840d-89a729a9b6ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-92e95e45-a72f-4543-aae8-604ab04a3dfa req-c858f450-e041-4655-80d7-5c3b3f4b1c1e service nova] Acquired lock "refresh_cache-70a7686e-042c-4be8-8182-69c62027c744" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.network.neutron [req-92e95e45-a72f-4543-aae8-604ab04a3dfa req-c858f450-e041-4655-80d7-5c3b3f4b1c1e service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Refreshing network info cache for port cf0655e0-c321-449f-840d-89a729a9b6ad {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Start _get_guest_xml network_info=[{"id": "cf0655e0-c321-449f-840d-89a729a9b6ad", "address": "fa:16:3e:83:d7:60", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0655e0-c3", "ovs_interfaceid": "cf0655e0-c321-449f-840d-89a729a9b6ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:36:54 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:36:54 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-963914825',display_name='tempest-VolumesAdminNegativeTest-server-963914825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-963914825',id=5,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFVKMfES28A1ktyCRMO/alXBA9IHBbiyikWP72jDo2vFeGgQ5s59bvsdgB9vblPSmeQ1SFmCP/V0ank19sERARincGjeHiKIeClQ1JKZdAPb/mQMufvyIemDuOcBpOxzA==',key_name='tempest-keypair-1634317855',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13e8a43607594d039f7514185feb8e78',ramdisk_id='',reservation_id='r-4u231271',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-980015254',owner_user_name='tempest-VolumesAdminNegativeTest-980015254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:36:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6811290b00b044f1b1a0430f775d512a',uuid=70a7686e-042c-4be8-8182-69c62027c744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf0655e0-c321-449f-840d-89a729a9b6ad", "address": "fa:16:3e:83:d7:60", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0655e0-c3", "ovs_interfaceid": "cf0655e0-c321-449f-840d-89a729a9b6ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Converting VIF {"id": "cf0655e0-c321-449f-840d-89a729a9b6ad", "address": "fa:16:3e:83:d7:60", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0655e0-c3", "ovs_interfaceid": "cf0655e0-c321-449f-840d-89a729a9b6ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=cf0655e0-c321-449f-840d-89a729a9b6ad,network=Network(bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0655e0-c3') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.objects.instance [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lazy-loading 'pci_devices' on Instance uuid 70a7686e-042c-4be8-8182-69c62027c744 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:36:54 user nova-compute[75378]:   <uuid>70a7686e-042c-4be8-8182-69c62027c744</uuid>
Nov 09 03:36:54 user nova-compute[75378]:   <name>instance-00000005</name>
Nov 09 03:36:54 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:36:54 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:36:54 user nova-compute[75378]:   <metadata>
Nov 09 03:36:54 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:36:54 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:36:54 user nova-compute[75378]:       <nova:name>tempest-VolumesAdminNegativeTest-server-963914825</nova:name>
Nov 09 03:36:54 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:36:54</nova:creationTime>
Nov 09 03:36:54 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:36:54 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:36:54 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:36:54 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:36:54 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:36:54 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:36:54 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:36:54 user nova-compute[75378]:       <nova:owner>
Nov 09 03:36:54 user nova-compute[75378]:         <nova:user uuid="6811290b00b044f1b1a0430f775d512a">tempest-VolumesAdminNegativeTest-980015254-project-member</nova:user>
Nov 09 03:36:54 user nova-compute[75378]:         <nova:project uuid="13e8a43607594d039f7514185feb8e78">tempest-VolumesAdminNegativeTest-980015254</nova:project>
Nov 09 03:36:54 user nova-compute[75378]:       </nova:owner>
Nov 09 03:36:54 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:36:54 user nova-compute[75378]:       <nova:ports>
Nov 09 03:36:54 user nova-compute[75378]:         <nova:port uuid="cf0655e0-c321-449f-840d-89a729a9b6ad">
Nov 09 03:36:54 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 03:36:54 user nova-compute[75378]:         </nova:port>
Nov 09 03:36:54 user nova-compute[75378]:       </nova:ports>
Nov 09 03:36:54 user nova-compute[75378]:     </nova:instance>
Nov 09 03:36:54 user nova-compute[75378]:   </metadata>
Nov 09 03:36:54 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:36:54 user nova-compute[75378]:     <system>
Nov 09 03:36:54 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:36:54 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:36:54 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:36:54 user nova-compute[75378]:       <entry name="serial">70a7686e-042c-4be8-8182-69c62027c744</entry>
Nov 09 03:36:54 user nova-compute[75378]:       <entry name="uuid">70a7686e-042c-4be8-8182-69c62027c744</entry>
Nov 09 03:36:54 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:36:54 user nova-compute[75378]:     </system>
Nov 09 03:36:54 user nova-compute[75378]:   </sysinfo>
Nov 09 03:36:54 user nova-compute[75378]:   <os>
Nov 09 03:36:54 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:36:54 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:36:54 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:36:54 user nova-compute[75378]:   </os>
Nov 09 03:36:54 user nova-compute[75378]:   <features>
Nov 09 03:36:54 user nova-compute[75378]:     <acpi/>
Nov 09 03:36:54 user nova-compute[75378]:     <apic/>
Nov 09 03:36:54 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:36:54 user nova-compute[75378]:   </features>
Nov 09 03:36:54 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:36:54 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:36:54 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:36:54 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:36:54 user nova-compute[75378]:   </clock>
Nov 09 03:36:54 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:36:54 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:36:54 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:36:54 user nova-compute[75378]:   </cpu>
Nov 09 03:36:54 user nova-compute[75378]:   <devices>
Nov 09 03:36:54 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:36:54 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:36:54 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk"/>
Nov 09 03:36:54 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:36:54 user nova-compute[75378]:     </disk>
Nov 09 03:36:54 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:36:54 user nova-compute[75378]:       <mac address="fa:16:3e:83:d7:60"/>
Nov 09 03:36:54 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:36:54 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:36:54 user nova-compute[75378]:       <target dev="tapcf0655e0-c3"/>
Nov 09 03:36:54 user nova-compute[75378]:     </interface>
Nov 09 03:36:54 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:36:54 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/console.log" append="off"/>
Nov 09 03:36:54 user nova-compute[75378]:     </serial>
Nov 09 03:36:54 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:36:54 user nova-compute[75378]:     <video>
Nov 09 03:36:54 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:36:54 user nova-compute[75378]:     </video>
Nov 09 03:36:54 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:36:54 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:36:54 user nova-compute[75378]:     </rng>
Nov 09 03:36:54 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:36:54 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:36:54 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:36:54 user nova-compute[75378]:     </memballoon>
Nov 09 03:36:54 user nova-compute[75378]:   </devices>
Nov 09 03:36:54 user nova-compute[75378]: </domain>
Nov 09 03:36:54 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-963914825',display_name='tempest-VolumesAdminNegativeTest-server-963914825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-963914825',id=5,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFVKMfES28A1ktyCRMO/alXBA9IHBbiyikWP72jDo2vFeGgQ5s59bvsdgB9vblPSmeQ1SFmCP/V0ank19sERARincGjeHiKIeClQ1JKZdAPb/mQMufvyIemDuOcBpOxzA==',key_name='tempest-keypair-1634317855',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13e8a43607594d039f7514185feb8e78',ramdisk_id='',reservation_id='r-4u231271',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-980015254',owner_user_name='tempest-VolumesAdminNegativeTest-980015254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:36:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6811290b00b044f1b1a0430f775d512a',uuid=70a7686e-042c-4be8-8182-69c62027c744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf0655e0-c321-449f-840d-89a729a9b6ad", "address": "fa:16:3e:83:d7:60", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0655e0-c3", "ovs_interfaceid": "cf0655e0-c321-449f-840d-89a729a9b6ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Converting VIF {"id": "cf0655e0-c321-449f-840d-89a729a9b6ad", "address": "fa:16:3e:83:d7:60", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0655e0-c3", "ovs_interfaceid": "cf0655e0-c321-449f-840d-89a729a9b6ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=cf0655e0-c321-449f-840d-89a729a9b6ad,network=Network(bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0655e0-c3') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG os_vif [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=cf0655e0-c321-449f-840d-89a729a9b6ad,network=Network(bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0655e0-c3') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '53e8a7d7-881b-5950-ae9d-3dc54a5526dc', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf0655e0-c3, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf0655e0-c3, col_values=(('qos', UUID('39f79309-3fc7-4bfb-b398-51766c9f66db')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf0655e0-c3, col_values=(('external_ids', {'iface-id': 'cf0655e0-c321-449f-840d-89a729a9b6ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:d7:60', 'vm-uuid': '70a7686e-042c-4be8-8182-69c62027c744'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:36:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:54 user nova-compute[75378]: INFO os_vif [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=cf0655e0-c321-449f-840d-89a729a9b6ad,network=Network(bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0655e0-c3')
Nov 09 03:36:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:36:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] No VIF found with MAC fa:16:3e:83:d7:60, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:36:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-2575ff2a-388c-4df5-abc9-55422ac05741 req-784830bf-3742-4e5a-8792-b50b39437daf service nova] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Received event network-vif-plugged-49f2f1d8-31ba-44d8-bb43-d85162cbfc46 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:36:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2575ff2a-388c-4df5-abc9-55422ac05741 req-784830bf-3742-4e5a-8792-b50b39437daf service nova] Acquiring lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2575ff2a-388c-4df5-abc9-55422ac05741 req-784830bf-3742-4e5a-8792-b50b39437daf service nova] Lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2575ff2a-388c-4df5-abc9-55422ac05741 req-784830bf-3742-4e5a-8792-b50b39437daf service nova] Lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-2575ff2a-388c-4df5-abc9-55422ac05741 req-784830bf-3742-4e5a-8792-b50b39437daf service nova] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] No waiting events found dispatching network-vif-plugged-49f2f1d8-31ba-44d8-bb43-d85162cbfc46 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:36:55 user nova-compute[75378]: WARNING nova.compute.manager [req-2575ff2a-388c-4df5-abc9-55422ac05741 req-784830bf-3742-4e5a-8792-b50b39437daf service nova] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Received unexpected event network-vif-plugged-49f2f1d8-31ba-44d8-bb43-d85162cbfc46 for instance with vm_state active and task_state None.
Nov 09 03:36:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:55 user nova-compute[75378]: DEBUG nova.network.neutron [req-92e95e45-a72f-4543-aae8-604ab04a3dfa req-c858f450-e041-4655-80d7-5c3b3f4b1c1e service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Updated VIF entry in instance network info cache for port cf0655e0-c321-449f-840d-89a729a9b6ad. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:36:55 user nova-compute[75378]: DEBUG nova.network.neutron [req-92e95e45-a72f-4543-aae8-604ab04a3dfa req-c858f450-e041-4655-80d7-5c3b3f4b1c1e service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Updating instance_info_cache with network_info: [{"id": "cf0655e0-c321-449f-840d-89a729a9b6ad", "address": "fa:16:3e:83:d7:60", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0655e0-c3", "ovs_interfaceid": "cf0655e0-c321-449f-840d-89a729a9b6ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:36:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-92e95e45-a72f-4543-aae8-604ab04a3dfa req-c858f450-e041-4655-80d7-5c3b3f4b1c1e service nova] Releasing lock "refresh_cache-70a7686e-042c-4be8-8182-69c62027c744" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:36:55 user nova-compute[75378]: DEBUG nova.network.neutron [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Successfully created port: 23694ef3-48c1-4a9b-9b38-3062aed570e5 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:36:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:57 user nova-compute[75378]: DEBUG nova.compute.manager [req-5bd00023-03cb-4828-aa48-84e842cacf05 req-3397dd3a-af46-465e-b548-cfd25491e936 service nova] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Received event network-vif-plugged-49f2f1d8-31ba-44d8-bb43-d85162cbfc46 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:36:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5bd00023-03cb-4828-aa48-84e842cacf05 req-3397dd3a-af46-465e-b548-cfd25491e936 service nova] Acquiring lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5bd00023-03cb-4828-aa48-84e842cacf05 req-3397dd3a-af46-465e-b548-cfd25491e936 service nova] Lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5bd00023-03cb-4828-aa48-84e842cacf05 req-3397dd3a-af46-465e-b548-cfd25491e936 service nova] Lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:57 user nova-compute[75378]: DEBUG nova.compute.manager [req-5bd00023-03cb-4828-aa48-84e842cacf05 req-3397dd3a-af46-465e-b548-cfd25491e936 service nova] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] No waiting events found dispatching network-vif-plugged-49f2f1d8-31ba-44d8-bb43-d85162cbfc46 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:36:57 user nova-compute[75378]: WARNING nova.compute.manager [req-5bd00023-03cb-4828-aa48-84e842cacf05 req-3397dd3a-af46-465e-b548-cfd25491e936 service nova] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Received unexpected event network-vif-plugged-49f2f1d8-31ba-44d8-bb43-d85162cbfc46 for instance with vm_state active and task_state None.
Nov 09 03:36:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:36:58 user nova-compute[75378]: DEBUG nova.compute.manager [req-a2d28e78-9cde-461b-b3fc-42b7951e974a req-1415c3a3-72bb-4659-9e2d-7701c030b63c service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Received event network-vif-plugged-4c53e537-1637-4f65-b393-a10e68383acb {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:36:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a2d28e78-9cde-461b-b3fc-42b7951e974a req-1415c3a3-72bb-4659-9e2d-7701c030b63c service nova] Acquiring lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:36:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a2d28e78-9cde-461b-b3fc-42b7951e974a req-1415c3a3-72bb-4659-9e2d-7701c030b63c service nova] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:36:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a2d28e78-9cde-461b-b3fc-42b7951e974a req-1415c3a3-72bb-4659-9e2d-7701c030b63c service nova] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:36:58 user nova-compute[75378]: DEBUG nova.compute.manager [req-a2d28e78-9cde-461b-b3fc-42b7951e974a req-1415c3a3-72bb-4659-9e2d-7701c030b63c service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] No waiting events found dispatching network-vif-plugged-4c53e537-1637-4f65-b393-a10e68383acb {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:36:58 user nova-compute[75378]: WARNING nova.compute.manager [req-a2d28e78-9cde-461b-b3fc-42b7951e974a req-1415c3a3-72bb-4659-9e2d-7701c030b63c service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Received unexpected event network-vif-plugged-4c53e537-1637-4f65-b393-a10e68383acb for instance with vm_state active and task_state None.
Nov 09 03:36:59 user nova-compute[75378]: DEBUG nova.network.neutron [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Successfully updated port: 23694ef3-48c1-4a9b-9b38-3062aed570e5 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:36:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquiring lock "refresh_cache-0aa21edc-dc12-46ad-925d-47bc5b576172" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:36:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquired lock "refresh_cache-0aa21edc-dc12-46ad-925d-47bc5b576172" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:36:59 user nova-compute[75378]: DEBUG nova.network.neutron [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:36:59 user nova-compute[75378]: DEBUG nova.network.neutron [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:36:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-bc3c3a71-d9b6-4908-ae6f-a6c55a1242bd req-da690313-03d2-4054-8b47-02e7f468fdf4 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Received event network-changed-23694ef3-48c1-4a9b-9b38-3062aed570e5 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:36:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-bc3c3a71-d9b6-4908-ae6f-a6c55a1242bd req-da690313-03d2-4054-8b47-02e7f468fdf4 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Refreshing instance network info cache due to event network-changed-23694ef3-48c1-4a9b-9b38-3062aed570e5. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:36:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bc3c3a71-d9b6-4908-ae6f-a6c55a1242bd req-da690313-03d2-4054-8b47-02e7f468fdf4 service nova] Acquiring lock "refresh_cache-0aa21edc-dc12-46ad-925d-47bc5b576172" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:36:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.network.neutron [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Updating instance_info_cache with network_info: [{"id": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "address": "fa:16:3e:2e:7c:ad", "network": {"id": "dbae8930-1593-4089-9f9e-4d0ee5306608", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-203847065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23694ef3-48", "ovs_interfaceid": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Releasing lock "refresh_cache-0aa21edc-dc12-46ad-925d-47bc5b576172" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.compute.manager [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Instance network_info: |[{"id": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "address": "fa:16:3e:2e:7c:ad", "network": {"id": "dbae8930-1593-4089-9f9e-4d0ee5306608", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-203847065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23694ef3-48", "ovs_interfaceid": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bc3c3a71-d9b6-4908-ae6f-a6c55a1242bd req-da690313-03d2-4054-8b47-02e7f468fdf4 service nova] Acquired lock "refresh_cache-0aa21edc-dc12-46ad-925d-47bc5b576172" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.network.neutron [req-bc3c3a71-d9b6-4908-ae6f-a6c55a1242bd req-da690313-03d2-4054-8b47-02e7f468fdf4 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Refreshing network info cache for port 23694ef3-48c1-4a9b-9b38-3062aed570e5 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Start _get_guest_xml network_info=[{"id": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "address": "fa:16:3e:2e:7c:ad", "network": {"id": "dbae8930-1593-4089-9f9e-4d0ee5306608", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-203847065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23694ef3-48", "ovs_interfaceid": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:37:00 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:37:00 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-600308768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-600308768',id=6,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7Zi3/OBwBWFZyzirh8mZQ4BgVFx7fj6XXgOw9/PxXUG8dZzej6jh1WqLhuSvXrU5svCvjW/PsldUVgziNo99MiMWj1iBWLdTs8DNBiQq2fEkWCg0hw0gQlP+3PQUsmdg==',key_name='tempest-keypair-1523638191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d1e0442fe540cda81d2a5467664870',ramdisk_id='',reservation_id='r-776ypqd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1282324561',owner_user_name='tempest-TaggedAttachmentsTest-1282324561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:36:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1261613bc54e7f96c70ed27d8a829e',uuid=0aa21edc-dc12-46ad-925d-47bc5b576172,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "address": "fa:16:3e:2e:7c:ad", "network": {"id": "dbae8930-1593-4089-9f9e-4d0ee5306608", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-203847065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23694ef3-48", "ovs_interfaceid": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Converting VIF {"id": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "address": "fa:16:3e:2e:7c:ad", "network": {"id": "dbae8930-1593-4089-9f9e-4d0ee5306608", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-203847065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23694ef3-48", "ovs_interfaceid": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:7c:ad,bridge_name='br-int',has_traffic_filtering=True,id=23694ef3-48c1-4a9b-9b38-3062aed570e5,network=Network(dbae8930-1593-4089-9f9e-4d0ee5306608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23694ef3-48') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.objects.instance [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lazy-loading 'pci_devices' on Instance uuid 0aa21edc-dc12-46ad-925d-47bc5b576172 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:37:00 user nova-compute[75378]:   <uuid>0aa21edc-dc12-46ad-925d-47bc5b576172</uuid>
Nov 09 03:37:00 user nova-compute[75378]:   <name>instance-00000006</name>
Nov 09 03:37:00 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:37:00 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:37:00 user nova-compute[75378]:   <metadata>
Nov 09 03:37:00 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:37:00 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:37:00 user nova-compute[75378]:       <nova:name>tempest-device-tagging-server-600308768</nova:name>
Nov 09 03:37:00 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:37:00</nova:creationTime>
Nov 09 03:37:00 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:37:00 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:37:00 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:37:00 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:37:00 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:37:00 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:37:00 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:37:00 user nova-compute[75378]:       <nova:owner>
Nov 09 03:37:00 user nova-compute[75378]:         <nova:user uuid="1b1261613bc54e7f96c70ed27d8a829e">tempest-TaggedAttachmentsTest-1282324561-project-member</nova:user>
Nov 09 03:37:00 user nova-compute[75378]:         <nova:project uuid="64d1e0442fe540cda81d2a5467664870">tempest-TaggedAttachmentsTest-1282324561</nova:project>
Nov 09 03:37:00 user nova-compute[75378]:       </nova:owner>
Nov 09 03:37:00 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:37:00 user nova-compute[75378]:       <nova:ports>
Nov 09 03:37:00 user nova-compute[75378]:         <nova:port uuid="23694ef3-48c1-4a9b-9b38-3062aed570e5">
Nov 09 03:37:00 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 03:37:00 user nova-compute[75378]:         </nova:port>
Nov 09 03:37:00 user nova-compute[75378]:       </nova:ports>
Nov 09 03:37:00 user nova-compute[75378]:     </nova:instance>
Nov 09 03:37:00 user nova-compute[75378]:   </metadata>
Nov 09 03:37:00 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:37:00 user nova-compute[75378]:     <system>
Nov 09 03:37:00 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:37:00 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:37:00 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:37:00 user nova-compute[75378]:       <entry name="serial">0aa21edc-dc12-46ad-925d-47bc5b576172</entry>
Nov 09 03:37:00 user nova-compute[75378]:       <entry name="uuid">0aa21edc-dc12-46ad-925d-47bc5b576172</entry>
Nov 09 03:37:00 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:37:00 user nova-compute[75378]:     </system>
Nov 09 03:37:00 user nova-compute[75378]:   </sysinfo>
Nov 09 03:37:00 user nova-compute[75378]:   <os>
Nov 09 03:37:00 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:37:00 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:37:00 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:37:00 user nova-compute[75378]:   </os>
Nov 09 03:37:00 user nova-compute[75378]:   <features>
Nov 09 03:37:00 user nova-compute[75378]:     <acpi/>
Nov 09 03:37:00 user nova-compute[75378]:     <apic/>
Nov 09 03:37:00 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:37:00 user nova-compute[75378]:   </features>
Nov 09 03:37:00 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:37:00 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:37:00 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:37:00 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:37:00 user nova-compute[75378]:   </clock>
Nov 09 03:37:00 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:37:00 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:37:00 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:37:00 user nova-compute[75378]:   </cpu>
Nov 09 03:37:00 user nova-compute[75378]:   <devices>
Nov 09 03:37:00 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:37:00 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:37:00 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk"/>
Nov 09 03:37:00 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:37:00 user nova-compute[75378]:     </disk>
Nov 09 03:37:00 user nova-compute[75378]:     <disk type="file" device="cdrom">
Nov 09 03:37:00 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none"/>
Nov 09 03:37:00 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk.config"/>
Nov 09 03:37:00 user nova-compute[75378]:       <target dev="hda" bus="ide"/>
Nov 09 03:37:00 user nova-compute[75378]:     </disk>
Nov 09 03:37:00 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:37:00 user nova-compute[75378]:       <mac address="fa:16:3e:2e:7c:ad"/>
Nov 09 03:37:00 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:37:00 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:37:00 user nova-compute[75378]:       <target dev="tap23694ef3-48"/>
Nov 09 03:37:00 user nova-compute[75378]:     </interface>
Nov 09 03:37:00 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:37:00 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/console.log" append="off"/>
Nov 09 03:37:00 user nova-compute[75378]:     </serial>
Nov 09 03:37:00 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:37:00 user nova-compute[75378]:     <video>
Nov 09 03:37:00 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:37:00 user nova-compute[75378]:     </video>
Nov 09 03:37:00 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:37:00 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:37:00 user nova-compute[75378]:     </rng>
Nov 09 03:37:00 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:37:00 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:37:00 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:37:00 user nova-compute[75378]:     </memballoon>
Nov 09 03:37:00 user nova-compute[75378]:   </devices>
Nov 09 03:37:00 user nova-compute[75378]: </domain>
Nov 09 03:37:00 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-600308768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-600308768',id=6,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7Zi3/OBwBWFZyzirh8mZQ4BgVFx7fj6XXgOw9/PxXUG8dZzej6jh1WqLhuSvXrU5svCvjW/PsldUVgziNo99MiMWj1iBWLdTs8DNBiQq2fEkWCg0hw0gQlP+3PQUsmdg==',key_name='tempest-keypair-1523638191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d1e0442fe540cda81d2a5467664870',ramdisk_id='',reservation_id='r-776ypqd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1282324561',owner_user_name='tempest-TaggedAttachmentsTest-1282324561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:36:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1261613bc54e7f96c70ed27d8a829e',uuid=0aa21edc-dc12-46ad-925d-47bc5b576172,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "address": "fa:16:3e:2e:7c:ad", "network": {"id": "dbae8930-1593-4089-9f9e-4d0ee5306608", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-203847065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23694ef3-48", "ovs_interfaceid": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Converting VIF {"id": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "address": "fa:16:3e:2e:7c:ad", "network": {"id": "dbae8930-1593-4089-9f9e-4d0ee5306608", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-203847065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23694ef3-48", "ovs_interfaceid": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:7c:ad,bridge_name='br-int',has_traffic_filtering=True,id=23694ef3-48c1-4a9b-9b38-3062aed570e5,network=Network(dbae8930-1593-4089-9f9e-4d0ee5306608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23694ef3-48') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG os_vif [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:7c:ad,bridge_name='br-int',has_traffic_filtering=True,id=23694ef3-48c1-4a9b-9b38-3062aed570e5,network=Network(dbae8930-1593-4089-9f9e-4d0ee5306608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23694ef3-48') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8124faf5-a48d-5c0b-98a8-d6c2a646deb9', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.compute.manager [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Acquiring lock "1fb5f90d-3d22-474d-947d-f939fa150f3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "1fb5f90d-3d22-474d-947d-f939fa150f3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23694ef3-48, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23694ef3-48, col_values=(('qos', UUID('bac11648-689f-4484-b367-b2e91fedbdbb')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23694ef3-48, col_values=(('external_ids', {'iface-id': '23694ef3-48c1-4a9b-9b38-3062aed570e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:7c:ad', 'vm-uuid': '0aa21edc-dc12-46ad-925d-47bc5b576172'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:37:00 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Instance spawned successfully.
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:00 user nova-compute[75378]: INFO os_vif [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:7c:ad,bridge_name='br-int',has_traffic_filtering=True,id=23694ef3-48c1-4a9b-9b38-3062aed570e5,network=Network(dbae8930-1593-4089-9f9e-4d0ee5306608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23694ef3-48')
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.compute.manager [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-0e76c207-393a-4ceb-b240-8f761e559ed9 req-8ac3a45d-a901-4205-bf53-84baeba7c796 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Received event network-vif-plugged-4c53e537-1637-4f65-b393-a10e68383acb {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0e76c207-393a-4ceb-b240-8f761e559ed9 req-8ac3a45d-a901-4205-bf53-84baeba7c796 service nova] Acquiring lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0e76c207-393a-4ceb-b240-8f761e559ed9 req-8ac3a45d-a901-4205-bf53-84baeba7c796 service nova] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0e76c207-393a-4ceb-b240-8f761e559ed9 req-8ac3a45d-a901-4205-bf53-84baeba7c796 service nova] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-0e76c207-393a-4ceb-b240-8f761e559ed9 req-8ac3a45d-a901-4205-bf53-84baeba7c796 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] No waiting events found dispatching network-vif-plugged-4c53e537-1637-4f65-b393-a10e68383acb {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:37:00 user nova-compute[75378]: WARNING nova.compute.manager [req-0e76c207-393a-4ceb-b240-8f761e559ed9 req-8ac3a45d-a901-4205-bf53-84baeba7c796 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Received unexpected event network-vif-plugged-4c53e537-1637-4f65-b393-a10e68383acb for instance with vm_state active and task_state None.
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-0e76c207-393a-4ceb-b240-8f761e559ed9 req-8ac3a45d-a901-4205-bf53-84baeba7c796 service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Received event network-vif-plugged-cf0655e0-c321-449f-840d-89a729a9b6ad {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0e76c207-393a-4ceb-b240-8f761e559ed9 req-8ac3a45d-a901-4205-bf53-84baeba7c796 service nova] Acquiring lock "70a7686e-042c-4be8-8182-69c62027c744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0e76c207-393a-4ceb-b240-8f761e559ed9 req-8ac3a45d-a901-4205-bf53-84baeba7c796 service nova] Lock "70a7686e-042c-4be8-8182-69c62027c744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0e76c207-393a-4ceb-b240-8f761e559ed9 req-8ac3a45d-a901-4205-bf53-84baeba7c796 service nova] Lock "70a7686e-042c-4be8-8182-69c62027c744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-0e76c207-393a-4ceb-b240-8f761e559ed9 req-8ac3a45d-a901-4205-bf53-84baeba7c796 service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] No waiting events found dispatching network-vif-plugged-cf0655e0-c321-449f-840d-89a729a9b6ad {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:37:00 user nova-compute[75378]: WARNING nova.compute.manager [req-0e76c207-393a-4ceb-b240-8f761e559ed9 req-8ac3a45d-a901-4205-bf53-84baeba7c796 service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Received unexpected event network-vif-plugged-cf0655e0-c321-449f-840d-89a729a9b6ad for instance with vm_state building and task_state spawning.
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] No BDM found with device name hda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] No VIF found with MAC fa:16:3e:2e:7c:ad, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:37:00 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Using config drive
Nov 09 03:37:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:37:00 user nova-compute[75378]: INFO nova.compute.claims [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Claim successful on node user
Nov 09 03:37:01 user nova-compute[75378]: INFO nova.compute.manager [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Took 10.55 seconds to spawn the instance on the hypervisor.
Nov 09 03:37:01 user nova-compute[75378]: DEBUG nova.compute.manager [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:37:01 user nova-compute[75378]: INFO nova.compute.manager [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Took 12.05 seconds to build instance.
Nov 09 03:37:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-31ba7ea8-815d-4c7b-beab-fcb4258dfcd8 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "70a7686e-042c-4be8-8182-69c62027c744" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.287s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:01 user nova-compute[75378]: DEBUG nova.network.neutron [req-bc3c3a71-d9b6-4908-ae6f-a6c55a1242bd req-da690313-03d2-4054-8b47-02e7f468fdf4 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Updated VIF entry in instance network info cache for port 23694ef3-48c1-4a9b-9b38-3062aed570e5. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:37:01 user nova-compute[75378]: DEBUG nova.network.neutron [req-bc3c3a71-d9b6-4908-ae6f-a6c55a1242bd req-da690313-03d2-4054-8b47-02e7f468fdf4 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Updating instance_info_cache with network_info: [{"id": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "address": "fa:16:3e:2e:7c:ad", "network": {"id": "dbae8930-1593-4089-9f9e-4d0ee5306608", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-203847065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23694ef3-48", "ovs_interfaceid": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:37:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bc3c3a71-d9b6-4908-ae6f-a6c55a1242bd req-da690313-03d2-4054-8b47-02e7f468fdf4 service nova] Releasing lock "refresh_cache-0aa21edc-dc12-46ad-925d-47bc5b576172" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:37:01 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Creating config drive at /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk.config
Nov 09 03:37:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpj6dnty4p {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpj6dnty4p" returned: 0 in 0.065s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:01 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:37:01 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:37:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.932s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:01 user nova-compute[75378]: DEBUG nova.compute.manager [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:37:02 user nova-compute[75378]: DEBUG nova.compute.manager [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:37:02 user nova-compute[75378]: DEBUG nova.network.neutron [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:37:02 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 09 03:37:02 user nova-compute[75378]: DEBUG nova.compute.manager [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:37:02 user nova-compute[75378]: DEBUG nova.policy [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8ed2cec9cb74b03bff46c13a22ed9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8db95eb923b64757988e524ce4e89dc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:37:02 user nova-compute[75378]: DEBUG nova.compute.manager [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:37:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:37:02 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Creating image(s)
Nov 09 03:37:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "/opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "/opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Acquiring lock "d4b423fcc307a74fcfc2182462d01c379a5095c1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "d4b423fcc307a74fcfc2182462d01c379a5095c1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4b423fcc307a74fcfc2182462d01c379a5095c1.part --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:02 user nova-compute[75378]: DEBUG nova.compute.manager [req-193e6587-94dc-4485-b6c1-93ebee4c0b62 req-8b573a87-62c9-46c4-b368-add90890d952 service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Received event network-vif-plugged-cf0655e0-c321-449f-840d-89a729a9b6ad {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:37:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-193e6587-94dc-4485-b6c1-93ebee4c0b62 req-8b573a87-62c9-46c4-b368-add90890d952 service nova] Acquiring lock "70a7686e-042c-4be8-8182-69c62027c744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-193e6587-94dc-4485-b6c1-93ebee4c0b62 req-8b573a87-62c9-46c4-b368-add90890d952 service nova] Lock "70a7686e-042c-4be8-8182-69c62027c744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-193e6587-94dc-4485-b6c1-93ebee4c0b62 req-8b573a87-62c9-46c4-b368-add90890d952 service nova] Lock "70a7686e-042c-4be8-8182-69c62027c744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-193e6587-94dc-4485-b6c1-93ebee4c0b62 req-8b573a87-62c9-46c4-b368-add90890d952 service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] No waiting events found dispatching network-vif-plugged-cf0655e0-c321-449f-840d-89a729a9b6ad {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:37:03 user nova-compute[75378]: WARNING nova.compute.manager [req-193e6587-94dc-4485-b6c1-93ebee4c0b62 req-8b573a87-62c9-46c4-b368-add90890d952 service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Received unexpected event network-vif-plugged-cf0655e0-c321-449f-840d-89a729a9b6ad for instance with vm_state active and task_state None.
Nov 09 03:37:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4b423fcc307a74fcfc2182462d01c379a5095c1.part --force-share --output=json" returned: 0 in 0.264s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:03 user nova-compute[75378]: DEBUG nova.virt.images [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] 360e2ba6-50f3-41c0-9228-6c814915c8d6 was qcow2, converting to raw {{(pid=75378) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 03:37:03 user nova-compute[75378]: DEBUG nova.privsep.utils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75378) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 03:37:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d4b423fcc307a74fcfc2182462d01c379a5095c1.part /opt/stack/data/nova/instances/_base/d4b423fcc307a74fcfc2182462d01c379a5095c1.converted {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:03 user nova-compute[75378]: DEBUG nova.network.neutron [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Successfully created port: db537bed-b0bc-4295-af53-4fc336c45675 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:37:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d4b423fcc307a74fcfc2182462d01c379a5095c1.part /opt/stack/data/nova/instances/_base/d4b423fcc307a74fcfc2182462d01c379a5095c1.converted" returned: 0 in 0.194s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4b423fcc307a74fcfc2182462d01c379a5095c1.converted --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4b423fcc307a74fcfc2182462d01c379a5095c1.converted --force-share --output=json" returned: 0 in 0.294s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "d4b423fcc307a74fcfc2182462d01c379a5095c1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.289s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4b423fcc307a74fcfc2182462d01c379a5095c1 --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4b423fcc307a74fcfc2182462d01c379a5095c1 --force-share --output=json" returned: 0 in 0.260s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Acquiring lock "d4b423fcc307a74fcfc2182462d01c379a5095c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "d4b423fcc307a74fcfc2182462d01c379a5095c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4b423fcc307a74fcfc2182462d01c379a5095c1 --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4b423fcc307a74fcfc2182462d01c379a5095c1 --force-share --output=json" returned: 0 in 0.281s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4b423fcc307a74fcfc2182462d01c379a5095c1,backing_fmt=raw /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4b423fcc307a74fcfc2182462d01c379a5095c1,backing_fmt=raw /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk 1073741824" returned: 0 in 0.062s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "d4b423fcc307a74fcfc2182462d01c379a5095c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.355s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4b423fcc307a74fcfc2182462d01c379a5095c1 --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG nova.network.neutron [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Successfully updated port: db537bed-b0bc-4295-af53-4fc336c45675 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Acquiring lock "refresh_cache-1fb5f90d-3d22-474d-947d-f939fa150f3f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Acquired lock "refresh_cache-1fb5f90d-3d22-474d-947d-f939fa150f3f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG nova.network.neutron [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4b423fcc307a74fcfc2182462d01c379a5095c1 --force-share --output=json" returned: 0 in 0.256s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG nova.network.neutron [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Cannot resize image /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Ensure instance console log exists: /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-f61d1d56-ed4c-4b30-8df6-95c5d5a381c0 req-16baa622-6ea8-4e4d-9a4f-a43adf3bd55a service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Received event network-vif-plugged-23694ef3-48c1-4a9b-9b38-3062aed570e5 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f61d1d56-ed4c-4b30-8df6-95c5d5a381c0 req-16baa622-6ea8-4e4d-9a4f-a43adf3bd55a service nova] Acquiring lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f61d1d56-ed4c-4b30-8df6-95c5d5a381c0 req-16baa622-6ea8-4e4d-9a4f-a43adf3bd55a service nova] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f61d1d56-ed4c-4b30-8df6-95c5d5a381c0 req-16baa622-6ea8-4e4d-9a4f-a43adf3bd55a service nova] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-f61d1d56-ed4c-4b30-8df6-95c5d5a381c0 req-16baa622-6ea8-4e4d-9a4f-a43adf3bd55a service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] No waiting events found dispatching network-vif-plugged-23694ef3-48c1-4a9b-9b38-3062aed570e5 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:37:04 user nova-compute[75378]: WARNING nova.compute.manager [req-f61d1d56-ed4c-4b30-8df6-95c5d5a381c0 req-16baa622-6ea8-4e4d-9a4f-a43adf3bd55a service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Received unexpected event network-vif-plugged-23694ef3-48c1-4a9b-9b38-3062aed570e5 for instance with vm_state building and task_state spawning.
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.network.neutron [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Updating instance_info_cache with network_info: [{"id": "db537bed-b0bc-4295-af53-4fc336c45675", "address": "fa:16:3e:ef:6c:72", "network": {"id": "14e65d53-261f-4171-bb08-63e3da53c090", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1182321126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db95eb923b64757988e524ce4e89dc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb537bed-b0", "ovs_interfaceid": "db537bed-b0bc-4295-af53-4fc336c45675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Releasing lock "refresh_cache-1fb5f90d-3d22-474d-947d-f939fa150f3f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.compute.manager [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Instance network_info: |[{"id": "db537bed-b0bc-4295-af53-4fc336c45675", "address": "fa:16:3e:ef:6c:72", "network": {"id": "14e65d53-261f-4171-bb08-63e3da53c090", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1182321126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db95eb923b64757988e524ce4e89dc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb537bed-b0", "ovs_interfaceid": "db537bed-b0bc-4295-af53-4fc336c45675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Start _get_guest_xml network_info=[{"id": "db537bed-b0bc-4295-af53-4fc336c45675", "address": "fa:16:3e:ef:6c:72", "network": {"id": "14e65d53-261f-4171-bb08-63e3da53c090", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1182321126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db95eb923b64757988e524ce4e89dc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb537bed-b0", "ovs_interfaceid": "db537bed-b0bc-4295-af53-4fc336c45675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:36:49Z,direct_url=<?>,disk_format='qcow2',id=360e2ba6-50f3-41c0-9228-6c814915c8d6,min_disk=0,min_ram=0,name='',owner='9bf6fad6835f4c03b83a6edb217cfe44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:36:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'device_name': '/dev/sda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'scsi', 'image_id': '360e2ba6-50f3-41c0-9228-6c814915c8d6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.compute.manager [req-01a0a531-9437-460d-bfb3-0b66ef1b2b06 req-f8fbb108-55ea-4fdb-ab3b-92d6c5f748be service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Received event network-changed-db537bed-b0bc-4295-af53-4fc336c45675 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.compute.manager [req-01a0a531-9437-460d-bfb3-0b66ef1b2b06 req-f8fbb108-55ea-4fdb-ab3b-92d6c5f748be service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Refreshing instance network info cache due to event network-changed-db537bed-b0bc-4295-af53-4fc336c45675. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-01a0a531-9437-460d-bfb3-0b66ef1b2b06 req-f8fbb108-55ea-4fdb-ab3b-92d6c5f748be service nova] Acquiring lock "refresh_cache-1fb5f90d-3d22-474d-947d-f939fa150f3f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-01a0a531-9437-460d-bfb3-0b66ef1b2b06 req-f8fbb108-55ea-4fdb-ab3b-92d6c5f748be service nova] Acquired lock "refresh_cache-1fb5f90d-3d22-474d-947d-f939fa150f3f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.network.neutron [req-01a0a531-9437-460d-bfb3-0b66ef1b2b06 req-f8fbb108-55ea-4fdb-ab3b-92d6c5f748be service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Refreshing network info cache for port db537bed-b0bc-4295-af53-4fc336c45675 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:37:05 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:37:05 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:36:49Z,direct_url=<?>,disk_format='qcow2',id=360e2ba6-50f3-41c0-9228-6c814915c8d6,min_disk=0,min_ram=0,name='',owner='9bf6fad6835f4c03b83a6edb217cfe44',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:36:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:36:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1488682605',display_name='tempest-AttachSCSIVolumeTestJSON-server-1488682605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1488682605',id=7,image_ref='360e2ba6-50f3-41c0-9228-6c814915c8d6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjKqxvnzbpvtEoLi4XzsXY7P5jPG9kSkT2NxZCP3vVk8E5pCIeaFhjuY7OpRVb0cM0aQpUndYBoVPASBAe7SsXXvWR7AaNYI3uOQ0JU7LmSmr3r8aSmgeJOq27B9wS2Cw==',key_name='tempest-keypair-550667506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8db95eb923b64757988e524ce4e89dc0',ramdisk_id='',reservation_id='r-72jum4bj',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='360e2ba6-50f3-41c0-9228-6c814915c8d6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1066171224',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1066171224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:37:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8ed2cec9cb74b03bff46c13a22ed9ff',uuid=1fb5f90d-3d22-474d-947d-f939fa150f3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db537bed-b0bc-4295-af53-4fc336c45675", "address": "fa:16:3e:ef:6c:72", "network": {"id": "14e65d53-261f-4171-bb08-63e3da53c090", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1182321126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db95eb923b64757988e524ce4e89dc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb537bed-b0", "ovs_interfaceid": "db537bed-b0bc-4295-af53-4fc336c45675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Converting VIF {"id": "db537bed-b0bc-4295-af53-4fc336c45675", "address": "fa:16:3e:ef:6c:72", "network": {"id": "14e65d53-261f-4171-bb08-63e3da53c090", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1182321126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db95eb923b64757988e524ce4e89dc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb537bed-b0", "ovs_interfaceid": "db537bed-b0bc-4295-af53-4fc336c45675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:6c:72,bridge_name='br-int',has_traffic_filtering=True,id=db537bed-b0bc-4295-af53-4fc336c45675,network=Network(14e65d53-261f-4171-bb08-63e3da53c090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb537bed-b0') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.objects.instance [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fb5f90d-3d22-474d-947d-f939fa150f3f {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:37:05 user nova-compute[75378]:   <uuid>1fb5f90d-3d22-474d-947d-f939fa150f3f</uuid>
Nov 09 03:37:05 user nova-compute[75378]:   <name>instance-00000007</name>
Nov 09 03:37:05 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:37:05 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:37:05 user nova-compute[75378]:   <metadata>
Nov 09 03:37:05 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:37:05 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:37:05 user nova-compute[75378]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1488682605</nova:name>
Nov 09 03:37:05 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:37:05</nova:creationTime>
Nov 09 03:37:05 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:37:05 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:37:05 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:37:05 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:37:05 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:37:05 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:37:05 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:37:05 user nova-compute[75378]:       <nova:owner>
Nov 09 03:37:05 user nova-compute[75378]:         <nova:user uuid="f8ed2cec9cb74b03bff46c13a22ed9ff">tempest-AttachSCSIVolumeTestJSON-1066171224-project-member</nova:user>
Nov 09 03:37:05 user nova-compute[75378]:         <nova:project uuid="8db95eb923b64757988e524ce4e89dc0">tempest-AttachSCSIVolumeTestJSON-1066171224</nova:project>
Nov 09 03:37:05 user nova-compute[75378]:       </nova:owner>
Nov 09 03:37:05 user nova-compute[75378]:       <nova:root type="image" uuid="360e2ba6-50f3-41c0-9228-6c814915c8d6"/>
Nov 09 03:37:05 user nova-compute[75378]:       <nova:ports>
Nov 09 03:37:05 user nova-compute[75378]:         <nova:port uuid="db537bed-b0bc-4295-af53-4fc336c45675">
Nov 09 03:37:05 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 03:37:05 user nova-compute[75378]:         </nova:port>
Nov 09 03:37:05 user nova-compute[75378]:       </nova:ports>
Nov 09 03:37:05 user nova-compute[75378]:     </nova:instance>
Nov 09 03:37:05 user nova-compute[75378]:   </metadata>
Nov 09 03:37:05 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:37:05 user nova-compute[75378]:     <system>
Nov 09 03:37:05 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:37:05 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:37:05 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:37:05 user nova-compute[75378]:       <entry name="serial">1fb5f90d-3d22-474d-947d-f939fa150f3f</entry>
Nov 09 03:37:05 user nova-compute[75378]:       <entry name="uuid">1fb5f90d-3d22-474d-947d-f939fa150f3f</entry>
Nov 09 03:37:05 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:37:05 user nova-compute[75378]:     </system>
Nov 09 03:37:05 user nova-compute[75378]:   </sysinfo>
Nov 09 03:37:05 user nova-compute[75378]:   <os>
Nov 09 03:37:05 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:37:05 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:37:05 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:37:05 user nova-compute[75378]:   </os>
Nov 09 03:37:05 user nova-compute[75378]:   <features>
Nov 09 03:37:05 user nova-compute[75378]:     <acpi/>
Nov 09 03:37:05 user nova-compute[75378]:     <apic/>
Nov 09 03:37:05 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:37:05 user nova-compute[75378]:   </features>
Nov 09 03:37:05 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:37:05 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:37:05 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:37:05 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:37:05 user nova-compute[75378]:   </clock>
Nov 09 03:37:05 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:37:05 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:37:05 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:37:05 user nova-compute[75378]:   </cpu>
Nov 09 03:37:05 user nova-compute[75378]:   <devices>
Nov 09 03:37:05 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:37:05 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:37:05 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk"/>
Nov 09 03:37:05 user nova-compute[75378]:       <target dev="sda" bus="scsi"/>
Nov 09 03:37:05 user nova-compute[75378]:       <address type="drive" controller="0" unit="0"/>
Nov 09 03:37:05 user nova-compute[75378]:     </disk>
Nov 09 03:37:05 user nova-compute[75378]:     <disk type="file" device="cdrom">
Nov 09 03:37:05 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none"/>
Nov 09 03:37:05 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk.config"/>
Nov 09 03:37:05 user nova-compute[75378]:       <target dev="sdb" bus="scsi"/>
Nov 09 03:37:05 user nova-compute[75378]:       <address type="drive" controller="0" unit="1"/>
Nov 09 03:37:05 user nova-compute[75378]:     </disk>
Nov 09 03:37:05 user nova-compute[75378]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 09 03:37:05 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:37:05 user nova-compute[75378]:       <mac address="fa:16:3e:ef:6c:72"/>
Nov 09 03:37:05 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:37:05 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:37:05 user nova-compute[75378]:       <target dev="tapdb537bed-b0"/>
Nov 09 03:37:05 user nova-compute[75378]:     </interface>
Nov 09 03:37:05 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:37:05 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/console.log" append="off"/>
Nov 09 03:37:05 user nova-compute[75378]:     </serial>
Nov 09 03:37:05 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:37:05 user nova-compute[75378]:     <video>
Nov 09 03:37:05 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:37:05 user nova-compute[75378]:     </video>
Nov 09 03:37:05 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:37:05 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:37:05 user nova-compute[75378]:     </rng>
Nov 09 03:37:05 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:37:05 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:37:05 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:37:05 user nova-compute[75378]:     </memballoon>
Nov 09 03:37:05 user nova-compute[75378]:   </devices>
Nov 09 03:37:05 user nova-compute[75378]: </domain>
Nov 09 03:37:05 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:36:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1488682605',display_name='tempest-AttachSCSIVolumeTestJSON-server-1488682605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1488682605',id=7,image_ref='360e2ba6-50f3-41c0-9228-6c814915c8d6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjKqxvnzbpvtEoLi4XzsXY7P5jPG9kSkT2NxZCP3vVk8E5pCIeaFhjuY7OpRVb0cM0aQpUndYBoVPASBAe7SsXXvWR7AaNYI3uOQ0JU7LmSmr3r8aSmgeJOq27B9wS2Cw==',key_name='tempest-keypair-550667506',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8db95eb923b64757988e524ce4e89dc0',ramdisk_id='',reservation_id='r-72jum4bj',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='360e2ba6-50f3-41c0-9228-6c814915c8d6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1066171224',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1066171224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:37:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8ed2cec9cb74b03bff46c13a22ed9ff',uuid=1fb5f90d-3d22-474d-947d-f939fa150f3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db537bed-b0bc-4295-af53-4fc336c45675", "address": "fa:16:3e:ef:6c:72", "network": {"id": "14e65d53-261f-4171-bb08-63e3da53c090", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1182321126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db95eb923b64757988e524ce4e89dc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb537bed-b0", "ovs_interfaceid": "db537bed-b0bc-4295-af53-4fc336c45675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Converting VIF {"id": "db537bed-b0bc-4295-af53-4fc336c45675", "address": "fa:16:3e:ef:6c:72", "network": {"id": "14e65d53-261f-4171-bb08-63e3da53c090", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1182321126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db95eb923b64757988e524ce4e89dc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb537bed-b0", "ovs_interfaceid": "db537bed-b0bc-4295-af53-4fc336c45675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:6c:72,bridge_name='br-int',has_traffic_filtering=True,id=db537bed-b0bc-4295-af53-4fc336c45675,network=Network(14e65d53-261f-4171-bb08-63e3da53c090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb537bed-b0') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG os_vif [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:6c:72,bridge_name='br-int',has_traffic_filtering=True,id=db537bed-b0bc-4295-af53-4fc336c45675,network=Network(14e65d53-261f-4171-bb08-63e3da53c090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb537bed-b0') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f694dfb8-0e8e-5a68-ae66-231798c34091', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb537bed-b0, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb537bed-b0, col_values=(('qos', UUID('5a50f960-5ca8-41b9-937a-1d4234fc601c')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb537bed-b0, col_values=(('external_ids', {'iface-id': 'db537bed-b0bc-4295-af53-4fc336c45675', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:6c:72', 'vm-uuid': '1fb5f90d-3d22-474d-947d-f939fa150f3f'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:05 user nova-compute[75378]: INFO os_vif [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:6c:72,bridge_name='br-int',has_traffic_filtering=True,id=db537bed-b0bc-4295-af53-4fc336c45675,network=Network(14e65d53-261f-4171-bb08-63e3da53c090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb537bed-b0')
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] No BDM found with device name sda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] No VIF found with MAC fa:16:3e:ef:6c:72, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:37:05 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Using config drive
Nov 09 03:37:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.network.neutron [req-01a0a531-9437-460d-bfb3-0b66ef1b2b06 req-f8fbb108-55ea-4fdb-ab3b-92d6c5f748be service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Updated VIF entry in instance network info cache for port db537bed-b0bc-4295-af53-4fc336c45675. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG nova.network.neutron [req-01a0a531-9437-460d-bfb3-0b66ef1b2b06 req-f8fbb108-55ea-4fdb-ab3b-92d6c5f748be service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Updating instance_info_cache with network_info: [{"id": "db537bed-b0bc-4295-af53-4fc336c45675", "address": "fa:16:3e:ef:6c:72", "network": {"id": "14e65d53-261f-4171-bb08-63e3da53c090", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1182321126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db95eb923b64757988e524ce4e89dc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb537bed-b0", "ovs_interfaceid": "db537bed-b0bc-4295-af53-4fc336c45675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-01a0a531-9437-460d-bfb3-0b66ef1b2b06 req-f8fbb108-55ea-4fdb-ab3b-92d6c5f748be service nova] Releasing lock "refresh_cache-1fb5f90d-3d22-474d-947d-f939fa150f3f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:37:05 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Creating config drive at /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk.config
Nov 09 03:37:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpk1on4lcw {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpk1on4lcw" returned: 0 in 0.096s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:06 user nova-compute[75378]: DEBUG nova.compute.manager [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:37:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:37:06 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Instance spawned successfully.
Nov 09 03:37:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:37:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:06 user nova-compute[75378]: INFO nova.compute.manager [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Took 13.48 seconds to spawn the instance on the hypervisor.
Nov 09 03:37:06 user nova-compute[75378]: DEBUG nova.compute.manager [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:37:06 user nova-compute[75378]: INFO nova.compute.manager [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Took 14.74 seconds to build instance.
Nov 09 03:37:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f22cf198-76c0-4cf3-bdb3-aedfd3babc20 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.963s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-6772025e-7096-4bac-b61b-0f53886e238f req-f6c2493a-68e5-4e01-b8c1-7b674331479f service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Received event network-vif-plugged-23694ef3-48c1-4a9b-9b38-3062aed570e5 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:37:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6772025e-7096-4bac-b61b-0f53886e238f req-f6c2493a-68e5-4e01-b8c1-7b674331479f service nova] Acquiring lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6772025e-7096-4bac-b61b-0f53886e238f req-f6c2493a-68e5-4e01-b8c1-7b674331479f service nova] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6772025e-7096-4bac-b61b-0f53886e238f req-f6c2493a-68e5-4e01-b8c1-7b674331479f service nova] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-6772025e-7096-4bac-b61b-0f53886e238f req-f6c2493a-68e5-4e01-b8c1-7b674331479f service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] No waiting events found dispatching network-vif-plugged-23694ef3-48c1-4a9b-9b38-3062aed570e5 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:37:06 user nova-compute[75378]: WARNING nova.compute.manager [req-6772025e-7096-4bac-b61b-0f53886e238f req-f6c2493a-68e5-4e01-b8c1-7b674331479f service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Received unexpected event network-vif-plugged-23694ef3-48c1-4a9b-9b38-3062aed570e5 for instance with vm_state active and task_state None.
Nov 09 03:37:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Acquiring lock "fadeb1f5-4118-4a08-986a-ff08778b229d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:07 user nova-compute[75378]: DEBUG nova.compute.manager [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:37:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:37:07 user nova-compute[75378]: INFO nova.compute.claims [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Claim successful on node user
Nov 09 03:37:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-51d25313-52cd-49ad-9d0b-7621bf6851f8 req-02c65d36-7b51-4cb1-b611-6bb6e9408da9 service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Received event network-vif-plugged-db537bed-b0bc-4295-af53-4fc336c45675 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:37:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-51d25313-52cd-49ad-9d0b-7621bf6851f8 req-02c65d36-7b51-4cb1-b611-6bb6e9408da9 service nova] Acquiring lock "1fb5f90d-3d22-474d-947d-f939fa150f3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-51d25313-52cd-49ad-9d0b-7621bf6851f8 req-02c65d36-7b51-4cb1-b611-6bb6e9408da9 service nova] Lock "1fb5f90d-3d22-474d-947d-f939fa150f3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-51d25313-52cd-49ad-9d0b-7621bf6851f8 req-02c65d36-7b51-4cb1-b611-6bb6e9408da9 service nova] Lock "1fb5f90d-3d22-474d-947d-f939fa150f3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-51d25313-52cd-49ad-9d0b-7621bf6851f8 req-02c65d36-7b51-4cb1-b611-6bb6e9408da9 service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] No waiting events found dispatching network-vif-plugged-db537bed-b0bc-4295-af53-4fc336c45675 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:37:07 user nova-compute[75378]: WARNING nova.compute.manager [req-51d25313-52cd-49ad-9d0b-7621bf6851f8 req-02c65d36-7b51-4cb1-b611-6bb6e9408da9 service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Received unexpected event network-vif-plugged-db537bed-b0bc-4295-af53-4fc336c45675 for instance with vm_state building and task_state spawning.
Nov 09 03:37:08 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:37:08 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:37:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.869s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:08 user nova-compute[75378]: DEBUG nova.compute.manager [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:37:08 user nova-compute[75378]: DEBUG nova.compute.manager [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:37:08 user nova-compute[75378]: DEBUG nova.network.neutron [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:37:08 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:37:08 user nova-compute[75378]: DEBUG nova.compute.manager [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:37:08 user nova-compute[75378]: DEBUG nova.policy [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ddb493bc62a46ab9d2fe559eb2587f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d1f59e34b145bab300bb75cc1b7e2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:37:08 user nova-compute[75378]: DEBUG nova.compute.manager [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:37:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:37:08 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Creating image(s)
Nov 09 03:37:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Acquiring lock "/opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "/opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "/opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.209s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:09 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.213s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:09 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:09 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk 1073741824" returned: 0 in 0.066s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:09 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:09 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.257s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:09 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:37:09 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:09 user nova-compute[75378]: DEBUG nova.network.neutron [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Successfully created port: c831c172-1cc7-428a-b240-f6ced441ef2a {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:37:09 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:09 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Cannot resize image /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:37:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:37:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Ensure instance console log exists: /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:37:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-e5d4f018-5115-4ecc-bb76-031d82e04697 req-d1911604-0989-4ea7-8ed9-ee0d81ac30e4 service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Received event network-vif-plugged-db537bed-b0bc-4295-af53-4fc336c45675 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:37:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e5d4f018-5115-4ecc-bb76-031d82e04697 req-d1911604-0989-4ea7-8ed9-ee0d81ac30e4 service nova] Acquiring lock "1fb5f90d-3d22-474d-947d-f939fa150f3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e5d4f018-5115-4ecc-bb76-031d82e04697 req-d1911604-0989-4ea7-8ed9-ee0d81ac30e4 service nova] Lock "1fb5f90d-3d22-474d-947d-f939fa150f3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e5d4f018-5115-4ecc-bb76-031d82e04697 req-d1911604-0989-4ea7-8ed9-ee0d81ac30e4 service nova] Lock "1fb5f90d-3d22-474d-947d-f939fa150f3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-e5d4f018-5115-4ecc-bb76-031d82e04697 req-d1911604-0989-4ea7-8ed9-ee0d81ac30e4 service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] No waiting events found dispatching network-vif-plugged-db537bed-b0bc-4295-af53-4fc336c45675 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:37:09 user nova-compute[75378]: WARNING nova.compute.manager [req-e5d4f018-5115-4ecc-bb76-031d82e04697 req-d1911604-0989-4ea7-8ed9-ee0d81ac30e4 service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Received unexpected event network-vif-plugged-db537bed-b0bc-4295-af53-4fc336c45675 for instance with vm_state building and task_state spawning.
Nov 09 03:37:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:10 user nova-compute[75378]: DEBUG nova.compute.manager [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:37:10 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:37:10 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Instance spawned successfully.
Nov 09 03:37:10 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:37:10 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:10 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:10 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:10 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:10 user nova-compute[75378]: INFO nova.compute.manager [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Took 8.16 seconds to spawn the instance on the hypervisor.
Nov 09 03:37:10 user nova-compute[75378]: DEBUG nova.compute.manager [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:37:10 user nova-compute[75378]: DEBUG nova.network.neutron [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Successfully updated port: c831c172-1cc7-428a-b240-f6ced441ef2a {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:37:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Acquiring lock "refresh_cache-fadeb1f5-4118-4a08-986a-ff08778b229d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:37:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Acquired lock "refresh_cache-fadeb1f5-4118-4a08-986a-ff08778b229d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:37:10 user nova-compute[75378]: DEBUG nova.network.neutron [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:37:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-6ae67eb8-3231-4a8a-b1aa-53f6feb9adbe req-314b4704-1d18-47f6-9ee8-b9345842f0cb service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Received event network-changed-c831c172-1cc7-428a-b240-f6ced441ef2a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:37:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-6ae67eb8-3231-4a8a-b1aa-53f6feb9adbe req-314b4704-1d18-47f6-9ee8-b9345842f0cb service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Refreshing instance network info cache due to event network-changed-c831c172-1cc7-428a-b240-f6ced441ef2a. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:37:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6ae67eb8-3231-4a8a-b1aa-53f6feb9adbe req-314b4704-1d18-47f6-9ee8-b9345842f0cb service nova] Acquiring lock "refresh_cache-fadeb1f5-4118-4a08-986a-ff08778b229d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:37:10 user nova-compute[75378]: INFO nova.compute.manager [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Took 9.69 seconds to build instance.
Nov 09 03:37:10 user nova-compute[75378]: DEBUG nova.network.neutron [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:37:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-65f20722-d11d-4d0d-9b50-89278d5a94f3 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "1fb5f90d-3d22-474d-947d-f939fa150f3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.028s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.network.neutron [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Updating instance_info_cache with network_info: [{"id": "c831c172-1cc7-428a-b240-f6ced441ef2a", "address": "fa:16:3e:3a:19:8c", "network": {"id": "7cae065f-736a-43fe-a505-62054a7c5af3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-265578846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5d1f59e34b145bab300bb75cc1b7e2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831c172-1c", "ovs_interfaceid": "c831c172-1cc7-428a-b240-f6ced441ef2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Releasing lock "refresh_cache-fadeb1f5-4118-4a08-986a-ff08778b229d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.compute.manager [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Instance network_info: |[{"id": "c831c172-1cc7-428a-b240-f6ced441ef2a", "address": "fa:16:3e:3a:19:8c", "network": {"id": "7cae065f-736a-43fe-a505-62054a7c5af3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-265578846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5d1f59e34b145bab300bb75cc1b7e2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831c172-1c", "ovs_interfaceid": "c831c172-1cc7-428a-b240-f6ced441ef2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6ae67eb8-3231-4a8a-b1aa-53f6feb9adbe req-314b4704-1d18-47f6-9ee8-b9345842f0cb service nova] Acquired lock "refresh_cache-fadeb1f5-4118-4a08-986a-ff08778b229d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.network.neutron [req-6ae67eb8-3231-4a8a-b1aa-53f6feb9adbe req-314b4704-1d18-47f6-9ee8-b9345842f0cb service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Refreshing network info cache for port c831c172-1cc7-428a-b240-f6ced441ef2a {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Start _get_guest_xml network_info=[{"id": "c831c172-1cc7-428a-b240-f6ced441ef2a", "address": "fa:16:3e:3a:19:8c", "network": {"id": "7cae065f-736a-43fe-a505-62054a7c5af3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-265578846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5d1f59e34b145bab300bb75cc1b7e2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831c172-1c", "ovs_interfaceid": "c831c172-1cc7-428a-b240-f6ced441ef2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:37:11 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:37:11 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:37:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1582652175',display_name='tempest-TestVolumeSwap-server-1582652175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1582652175',id=8,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyk9T16GFQ+y1h0pOF5Hrm3d7RD92EOy4TdU1mHmhgFKtaR27JmR/D69MWt8+fDMBahxH+u3ZN9qNjPU5RYIoSG14WkbOQ4znhP3S/IGfvqhP5i3qDYDpXEkvPXxUlcRQ==',key_name='tempest-keypair-1553599307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5d1f59e34b145bab300bb75cc1b7e2a',ramdisk_id='',reservation_id='r-5md8dbes',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-50463933',owner_user_name='tempest-TestVolumeSwap-50463933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:37:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ddb493bc62a46ab9d2fe559eb2587f2',uuid=fadeb1f5-4118-4a08-986a-ff08778b229d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c831c172-1cc7-428a-b240-f6ced441ef2a", "address": "fa:16:3e:3a:19:8c", "network": {"id": "7cae065f-736a-43fe-a505-62054a7c5af3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-265578846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5d1f59e34b145bab300bb75cc1b7e2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831c172-1c", "ovs_interfaceid": "c831c172-1cc7-428a-b240-f6ced441ef2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Converting VIF {"id": "c831c172-1cc7-428a-b240-f6ced441ef2a", "address": "fa:16:3e:3a:19:8c", "network": {"id": "7cae065f-736a-43fe-a505-62054a7c5af3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-265578846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5d1f59e34b145bab300bb75cc1b7e2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831c172-1c", "ovs_interfaceid": "c831c172-1cc7-428a-b240-f6ced441ef2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=c831c172-1cc7-428a-b240-f6ced441ef2a,network=Network(7cae065f-736a-43fe-a505-62054a7c5af3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc831c172-1c') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.objects.instance [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lazy-loading 'pci_devices' on Instance uuid fadeb1f5-4118-4a08-986a-ff08778b229d {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:37:11 user nova-compute[75378]:   <uuid>fadeb1f5-4118-4a08-986a-ff08778b229d</uuid>
Nov 09 03:37:11 user nova-compute[75378]:   <name>instance-00000008</name>
Nov 09 03:37:11 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:37:11 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:37:11 user nova-compute[75378]:   <metadata>
Nov 09 03:37:11 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:37:11 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:37:11 user nova-compute[75378]:       <nova:name>tempest-TestVolumeSwap-server-1582652175</nova:name>
Nov 09 03:37:11 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:37:11</nova:creationTime>
Nov 09 03:37:11 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:37:11 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:37:11 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:37:11 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:37:11 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:37:11 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:37:11 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:37:11 user nova-compute[75378]:       <nova:owner>
Nov 09 03:37:11 user nova-compute[75378]:         <nova:user uuid="5ddb493bc62a46ab9d2fe559eb2587f2">tempest-TestVolumeSwap-50463933-project-member</nova:user>
Nov 09 03:37:11 user nova-compute[75378]:         <nova:project uuid="c5d1f59e34b145bab300bb75cc1b7e2a">tempest-TestVolumeSwap-50463933</nova:project>
Nov 09 03:37:11 user nova-compute[75378]:       </nova:owner>
Nov 09 03:37:11 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:37:11 user nova-compute[75378]:       <nova:ports>
Nov 09 03:37:11 user nova-compute[75378]:         <nova:port uuid="c831c172-1cc7-428a-b240-f6ced441ef2a">
Nov 09 03:37:11 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 03:37:11 user nova-compute[75378]:         </nova:port>
Nov 09 03:37:11 user nova-compute[75378]:       </nova:ports>
Nov 09 03:37:11 user nova-compute[75378]:     </nova:instance>
Nov 09 03:37:11 user nova-compute[75378]:   </metadata>
Nov 09 03:37:11 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:37:11 user nova-compute[75378]:     <system>
Nov 09 03:37:11 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:37:11 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:37:11 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:37:11 user nova-compute[75378]:       <entry name="serial">fadeb1f5-4118-4a08-986a-ff08778b229d</entry>
Nov 09 03:37:11 user nova-compute[75378]:       <entry name="uuid">fadeb1f5-4118-4a08-986a-ff08778b229d</entry>
Nov 09 03:37:11 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:37:11 user nova-compute[75378]:     </system>
Nov 09 03:37:11 user nova-compute[75378]:   </sysinfo>
Nov 09 03:37:11 user nova-compute[75378]:   <os>
Nov 09 03:37:11 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:37:11 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:37:11 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:37:11 user nova-compute[75378]:   </os>
Nov 09 03:37:11 user nova-compute[75378]:   <features>
Nov 09 03:37:11 user nova-compute[75378]:     <acpi/>
Nov 09 03:37:11 user nova-compute[75378]:     <apic/>
Nov 09 03:37:11 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:37:11 user nova-compute[75378]:   </features>
Nov 09 03:37:11 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:37:11 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:37:11 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:37:11 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:37:11 user nova-compute[75378]:   </clock>
Nov 09 03:37:11 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:37:11 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:37:11 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:37:11 user nova-compute[75378]:   </cpu>
Nov 09 03:37:11 user nova-compute[75378]:   <devices>
Nov 09 03:37:11 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:37:11 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:37:11 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk"/>
Nov 09 03:37:11 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:37:11 user nova-compute[75378]:     </disk>
Nov 09 03:37:11 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:37:11 user nova-compute[75378]:       <mac address="fa:16:3e:3a:19:8c"/>
Nov 09 03:37:11 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:37:11 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:37:11 user nova-compute[75378]:       <target dev="tapc831c172-1c"/>
Nov 09 03:37:11 user nova-compute[75378]:     </interface>
Nov 09 03:37:11 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:37:11 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/console.log" append="off"/>
Nov 09 03:37:11 user nova-compute[75378]:     </serial>
Nov 09 03:37:11 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:37:11 user nova-compute[75378]:     <video>
Nov 09 03:37:11 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:37:11 user nova-compute[75378]:     </video>
Nov 09 03:37:11 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:37:11 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:37:11 user nova-compute[75378]:     </rng>
Nov 09 03:37:11 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:37:11 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:37:11 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:37:11 user nova-compute[75378]:     </memballoon>
Nov 09 03:37:11 user nova-compute[75378]:   </devices>
Nov 09 03:37:11 user nova-compute[75378]: </domain>
Nov 09 03:37:11 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:37:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1582652175',display_name='tempest-TestVolumeSwap-server-1582652175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1582652175',id=8,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyk9T16GFQ+y1h0pOF5Hrm3d7RD92EOy4TdU1mHmhgFKtaR27JmR/D69MWt8+fDMBahxH+u3ZN9qNjPU5RYIoSG14WkbOQ4znhP3S/IGfvqhP5i3qDYDpXEkvPXxUlcRQ==',key_name='tempest-keypair-1553599307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5d1f59e34b145bab300bb75cc1b7e2a',ramdisk_id='',reservation_id='r-5md8dbes',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-50463933',owner_user_name='tempest-TestVolumeSwap-50463933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:37:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ddb493bc62a46ab9d2fe559eb2587f2',uuid=fadeb1f5-4118-4a08-986a-ff08778b229d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c831c172-1cc7-428a-b240-f6ced441ef2a", "address": "fa:16:3e:3a:19:8c", "network": {"id": "7cae065f-736a-43fe-a505-62054a7c5af3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-265578846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5d1f59e34b145bab300bb75cc1b7e2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831c172-1c", "ovs_interfaceid": "c831c172-1cc7-428a-b240-f6ced441ef2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Converting VIF {"id": "c831c172-1cc7-428a-b240-f6ced441ef2a", "address": "fa:16:3e:3a:19:8c", "network": {"id": "7cae065f-736a-43fe-a505-62054a7c5af3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-265578846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5d1f59e34b145bab300bb75cc1b7e2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831c172-1c", "ovs_interfaceid": "c831c172-1cc7-428a-b240-f6ced441ef2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=c831c172-1cc7-428a-b240-f6ced441ef2a,network=Network(7cae065f-736a-43fe-a505-62054a7c5af3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc831c172-1c') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG os_vif [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=c831c172-1cc7-428a-b240-f6ced441ef2a,network=Network(7cae065f-736a-43fe-a505-62054a7c5af3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc831c172-1c') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd008fa20-56ff-5455-82ad-47d2d2bcaf60', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc831c172-1c, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc831c172-1c, col_values=(('qos', UUID('4f3625bf-1ee6-47af-af8d-50b04b99ca20')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc831c172-1c, col_values=(('external_ids', {'iface-id': 'c831c172-1cc7-428a-b240-f6ced441ef2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:19:8c', 'vm-uuid': 'fadeb1f5-4118-4a08-986a-ff08778b229d'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:11 user nova-compute[75378]: INFO os_vif [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=c831c172-1cc7-428a-b240-f6ced441ef2a,network=Network(7cae065f-736a-43fe-a505-62054a7c5af3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc831c172-1c')
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] No VIF found with MAC fa:16:3e:3a:19:8c, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.network.neutron [req-6ae67eb8-3231-4a8a-b1aa-53f6feb9adbe req-314b4704-1d18-47f6-9ee8-b9345842f0cb service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Updated VIF entry in instance network info cache for port c831c172-1cc7-428a-b240-f6ced441ef2a. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG nova.network.neutron [req-6ae67eb8-3231-4a8a-b1aa-53f6feb9adbe req-314b4704-1d18-47f6-9ee8-b9345842f0cb service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Updating instance_info_cache with network_info: [{"id": "c831c172-1cc7-428a-b240-f6ced441ef2a", "address": "fa:16:3e:3a:19:8c", "network": {"id": "7cae065f-736a-43fe-a505-62054a7c5af3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-265578846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5d1f59e34b145bab300bb75cc1b7e2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831c172-1c", "ovs_interfaceid": "c831c172-1cc7-428a-b240-f6ced441ef2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:37:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6ae67eb8-3231-4a8a-b1aa-53f6feb9adbe req-314b4704-1d18-47f6-9ee8-b9345842f0cb service nova] Releasing lock "refresh_cache-fadeb1f5-4118-4a08-986a-ff08778b229d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:37:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-68395390-a0ef-4b38-ab5a-1f711594df02 req-cefcbd85-381b-487c-8657-3c0409d0d648 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:37:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-68395390-a0ef-4b38-ab5a-1f711594df02 req-cefcbd85-381b-487c-8657-3c0409d0d648 service nova] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-68395390-a0ef-4b38-ab5a-1f711594df02 req-cefcbd85-381b-487c-8657-3c0409d0d648 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-68395390-a0ef-4b38-ab5a-1f711594df02 req-cefcbd85-381b-487c-8657-3c0409d0d648 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-68395390-a0ef-4b38-ab5a-1f711594df02 req-cefcbd85-381b-487c-8657-3c0409d0d648 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] No waiting events found dispatching network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:37:12 user nova-compute[75378]: WARNING nova.compute.manager [req-68395390-a0ef-4b38-ab5a-1f711594df02 req-cefcbd85-381b-487c-8657-3c0409d0d648 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received unexpected event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 for instance with vm_state active and task_state None.
Nov 09 03:37:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Acquiring lock "fc692659-f62e-4d29-909d-0509cf3952b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Lock "fc692659-f62e-4d29-909d-0509cf3952b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:13 user nova-compute[75378]: DEBUG nova.compute.manager [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:37:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:37:13 user nova-compute[75378]: INFO nova.compute.claims [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Claim successful on node user
Nov 09 03:37:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Cleaning up deleted instances {{(pid=75378) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] There are 0 instances to clean {{(pid=75378) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.962s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG nova.compute.manager [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75378) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG nova.compute.manager [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG nova.network.neutron [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:37:14 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:37:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG nova.compute.manager [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG nova.policy [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c8c79296ff44e45863e87cadce0cb68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8bed46ae0b24564a8a9c68eec52f022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-aded0464-aadc-4465-882c-d474c4b77507 req-8e2e3993-fed0-416f-913a-9f726d76bbd5 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-aded0464-aadc-4465-882c-d474c4b77507 req-8e2e3993-fed0-416f-913a-9f726d76bbd5 service nova] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-aded0464-aadc-4465-882c-d474c4b77507 req-8e2e3993-fed0-416f-913a-9f726d76bbd5 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-aded0464-aadc-4465-882c-d474c4b77507 req-8e2e3993-fed0-416f-913a-9f726d76bbd5 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-aded0464-aadc-4465-882c-d474c4b77507 req-8e2e3993-fed0-416f-913a-9f726d76bbd5 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] No waiting events found dispatching network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:37:14 user nova-compute[75378]: WARNING nova.compute.manager [req-aded0464-aadc-4465-882c-d474c4b77507 req-8e2e3993-fed0-416f-913a-9f726d76bbd5 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received unexpected event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 for instance with vm_state active and task_state None.
Nov 09 03:37:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-aded0464-aadc-4465-882c-d474c4b77507 req-8e2e3993-fed0-416f-913a-9f726d76bbd5 service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Received event network-vif-plugged-c831c172-1cc7-428a-b240-f6ced441ef2a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-aded0464-aadc-4465-882c-d474c4b77507 req-8e2e3993-fed0-416f-913a-9f726d76bbd5 service nova] Acquiring lock "fadeb1f5-4118-4a08-986a-ff08778b229d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-aded0464-aadc-4465-882c-d474c4b77507 req-8e2e3993-fed0-416f-913a-9f726d76bbd5 service nova] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-aded0464-aadc-4465-882c-d474c4b77507 req-8e2e3993-fed0-416f-913a-9f726d76bbd5 service nova] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-aded0464-aadc-4465-882c-d474c4b77507 req-8e2e3993-fed0-416f-913a-9f726d76bbd5 service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] No waiting events found dispatching network-vif-plugged-c831c172-1cc7-428a-b240-f6ced441ef2a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:37:14 user nova-compute[75378]: WARNING nova.compute.manager [req-aded0464-aadc-4465-882c-d474c4b77507 req-8e2e3993-fed0-416f-913a-9f726d76bbd5 service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Received unexpected event network-vif-plugged-c831c172-1cc7-428a-b240-f6ced441ef2a for instance with vm_state building and task_state spawning.
Nov 09 03:37:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-aded0464-aadc-4465-882c-d474c4b77507 req-8e2e3993-fed0-416f-913a-9f726d76bbd5 service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Received event network-vif-plugged-c831c172-1cc7-428a-b240-f6ced441ef2a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-aded0464-aadc-4465-882c-d474c4b77507 req-8e2e3993-fed0-416f-913a-9f726d76bbd5 service nova] Acquiring lock "fadeb1f5-4118-4a08-986a-ff08778b229d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-aded0464-aadc-4465-882c-d474c4b77507 req-8e2e3993-fed0-416f-913a-9f726d76bbd5 service nova] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-aded0464-aadc-4465-882c-d474c4b77507 req-8e2e3993-fed0-416f-913a-9f726d76bbd5 service nova] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-aded0464-aadc-4465-882c-d474c4b77507 req-8e2e3993-fed0-416f-913a-9f726d76bbd5 service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] No waiting events found dispatching network-vif-plugged-c831c172-1cc7-428a-b240-f6ced441ef2a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:37:14 user nova-compute[75378]: WARNING nova.compute.manager [req-aded0464-aadc-4465-882c-d474c4b77507 req-8e2e3993-fed0-416f-913a-9f726d76bbd5 service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Received unexpected event network-vif-plugged-c831c172-1cc7-428a-b240-f6ced441ef2a for instance with vm_state building and task_state spawning.
Nov 09 03:37:14 user nova-compute[75378]: DEBUG nova.compute.manager [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:37:14 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Creating image(s)
Nov 09 03:37:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Lock "/opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Lock "/opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.261s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.232s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk 1073741824" returned: 0 in 0.076s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG nova.network.neutron [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Successfully created port: ee5357d8-2dbf-42d7-90eb-01409b3f3a55 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.241s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Cannot resize image /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Ensure instance console log exists: /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.network.neutron [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Successfully updated port: ee5357d8-2dbf-42d7-90eb-01409b3f3a55 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Acquiring lock "refresh_cache-fc692659-f62e-4d29-909d-0509cf3952b4" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Acquired lock "refresh_cache-fc692659-f62e-4d29-909d-0509cf3952b4" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.network.neutron [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.network.neutron [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.compute.manager [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:16 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Instance spawned successfully.
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.network.neutron [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Updating instance_info_cache with network_info: [{"id": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "address": "fa:16:3e:2d:24:6f", "network": {"id": "fcedd8b7-ea71-40c5-9aaa-012a32d034dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-102964368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8bed46ae0b24564a8a9c68eec52f022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee5357d8-2d", "ovs_interfaceid": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Releasing lock "refresh_cache-fc692659-f62e-4d29-909d-0509cf3952b4" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.compute.manager [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Instance network_info: |[{"id": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "address": "fa:16:3e:2d:24:6f", "network": {"id": "fcedd8b7-ea71-40c5-9aaa-012a32d034dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-102964368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8bed46ae0b24564a8a9c68eec52f022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee5357d8-2d", "ovs_interfaceid": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Start _get_guest_xml network_info=[{"id": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "address": "fa:16:3e:2d:24:6f", "network": {"id": "fcedd8b7-ea71-40c5-9aaa-012a32d034dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-102964368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8bed46ae0b24564a8a9c68eec52f022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee5357d8-2d", "ovs_interfaceid": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:37:16 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:37:16 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-181845688',display_name='tempest-VolumesAssistedSnapshotsTest-server-181845688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-181845688',id=9,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+454xopdGSPXSkR9UIu7XCPexLbHJvWNhAhc/n6jRQZROXGx5mAqA2vugmKKSg/x9dqy3G6sOjRvD/tRJeRcLB8DB5L/5RwBetXsIZ9DagRs1PAxn6xWRvunNeTxgnaQ==',key_name='tempest-keypair-1299847380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8bed46ae0b24564a8a9c68eec52f022',ramdisk_id='',reservation_id='r-d8m81srw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1262744615',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1262744615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:37:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c8c79296ff44e45863e87cadce0cb68',uuid=fc692659-f62e-4d29-909d-0509cf3952b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "address": "fa:16:3e:2d:24:6f", "network": {"id": "fcedd8b7-ea71-40c5-9aaa-012a32d034dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-102964368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8bed46ae0b24564a8a9c68eec52f022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee5357d8-2d", "ovs_interfaceid": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Converting VIF {"id": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "address": "fa:16:3e:2d:24:6f", "network": {"id": "fcedd8b7-ea71-40c5-9aaa-012a32d034dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-102964368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8bed46ae0b24564a8a9c68eec52f022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee5357d8-2d", "ovs_interfaceid": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:24:6f,bridge_name='br-int',has_traffic_filtering=True,id=ee5357d8-2dbf-42d7-90eb-01409b3f3a55,network=Network(fcedd8b7-ea71-40c5-9aaa-012a32d034dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee5357d8-2d') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.objects.instance [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Lazy-loading 'pci_devices' on Instance uuid fc692659-f62e-4d29-909d-0509cf3952b4 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:37:16 user nova-compute[75378]: INFO nova.compute.manager [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Took 7.93 seconds to spawn the instance on the hypervisor.
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.compute.manager [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:37:16 user nova-compute[75378]:   <uuid>fc692659-f62e-4d29-909d-0509cf3952b4</uuid>
Nov 09 03:37:16 user nova-compute[75378]:   <name>instance-00000009</name>
Nov 09 03:37:16 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:37:16 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:37:16 user nova-compute[75378]:   <metadata>
Nov 09 03:37:16 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:37:16 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:37:16 user nova-compute[75378]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-181845688</nova:name>
Nov 09 03:37:16 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:37:16</nova:creationTime>
Nov 09 03:37:16 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:37:16 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:37:16 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:37:16 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:37:16 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:37:16 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:37:16 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:37:16 user nova-compute[75378]:       <nova:owner>
Nov 09 03:37:16 user nova-compute[75378]:         <nova:user uuid="2c8c79296ff44e45863e87cadce0cb68">tempest-VolumesAssistedSnapshotsTest-1262744615-project-member</nova:user>
Nov 09 03:37:16 user nova-compute[75378]:         <nova:project uuid="c8bed46ae0b24564a8a9c68eec52f022">tempest-VolumesAssistedSnapshotsTest-1262744615</nova:project>
Nov 09 03:37:16 user nova-compute[75378]:       </nova:owner>
Nov 09 03:37:16 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:37:16 user nova-compute[75378]:       <nova:ports>
Nov 09 03:37:16 user nova-compute[75378]:         <nova:port uuid="ee5357d8-2dbf-42d7-90eb-01409b3f3a55">
Nov 09 03:37:16 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 09 03:37:16 user nova-compute[75378]:         </nova:port>
Nov 09 03:37:16 user nova-compute[75378]:       </nova:ports>
Nov 09 03:37:16 user nova-compute[75378]:     </nova:instance>
Nov 09 03:37:16 user nova-compute[75378]:   </metadata>
Nov 09 03:37:16 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:37:16 user nova-compute[75378]:     <system>
Nov 09 03:37:16 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:37:16 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:37:16 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:37:16 user nova-compute[75378]:       <entry name="serial">fc692659-f62e-4d29-909d-0509cf3952b4</entry>
Nov 09 03:37:16 user nova-compute[75378]:       <entry name="uuid">fc692659-f62e-4d29-909d-0509cf3952b4</entry>
Nov 09 03:37:16 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:37:16 user nova-compute[75378]:     </system>
Nov 09 03:37:16 user nova-compute[75378]:   </sysinfo>
Nov 09 03:37:16 user nova-compute[75378]:   <os>
Nov 09 03:37:16 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:37:16 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:37:16 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:37:16 user nova-compute[75378]:   </os>
Nov 09 03:37:16 user nova-compute[75378]:   <features>
Nov 09 03:37:16 user nova-compute[75378]:     <acpi/>
Nov 09 03:37:16 user nova-compute[75378]:     <apic/>
Nov 09 03:37:16 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:37:16 user nova-compute[75378]:   </features>
Nov 09 03:37:16 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:37:16 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:37:16 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:37:16 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:37:16 user nova-compute[75378]:   </clock>
Nov 09 03:37:16 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:37:16 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:37:16 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:37:16 user nova-compute[75378]:   </cpu>
Nov 09 03:37:16 user nova-compute[75378]:   <devices>
Nov 09 03:37:16 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:37:16 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:37:16 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk"/>
Nov 09 03:37:16 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:37:16 user nova-compute[75378]:     </disk>
Nov 09 03:37:16 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:37:16 user nova-compute[75378]:       <mac address="fa:16:3e:2d:24:6f"/>
Nov 09 03:37:16 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:37:16 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:37:16 user nova-compute[75378]:       <target dev="tapee5357d8-2d"/>
Nov 09 03:37:16 user nova-compute[75378]:     </interface>
Nov 09 03:37:16 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:37:16 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/console.log" append="off"/>
Nov 09 03:37:16 user nova-compute[75378]:     </serial>
Nov 09 03:37:16 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:37:16 user nova-compute[75378]:     <video>
Nov 09 03:37:16 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:37:16 user nova-compute[75378]:     </video>
Nov 09 03:37:16 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:37:16 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:37:16 user nova-compute[75378]:     </rng>
Nov 09 03:37:16 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:37:16 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:37:16 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:37:16 user nova-compute[75378]:     </memballoon>
Nov 09 03:37:16 user nova-compute[75378]:   </devices>
Nov 09 03:37:16 user nova-compute[75378]: </domain>
Nov 09 03:37:16 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-181845688',display_name='tempest-VolumesAssistedSnapshotsTest-server-181845688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-181845688',id=9,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+454xopdGSPXSkR9UIu7XCPexLbHJvWNhAhc/n6jRQZROXGx5mAqA2vugmKKSg/x9dqy3G6sOjRvD/tRJeRcLB8DB5L/5RwBetXsIZ9DagRs1PAxn6xWRvunNeTxgnaQ==',key_name='tempest-keypair-1299847380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8bed46ae0b24564a8a9c68eec52f022',ramdisk_id='',reservation_id='r-d8m81srw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1262744615',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1262744615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:37:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c8c79296ff44e45863e87cadce0cb68',uuid=fc692659-f62e-4d29-909d-0509cf3952b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "address": "fa:16:3e:2d:24:6f", "network": {"id": "fcedd8b7-ea71-40c5-9aaa-012a32d034dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-102964368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8bed46ae0b24564a8a9c68eec52f022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee5357d8-2d", "ovs_interfaceid": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Converting VIF {"id": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "address": "fa:16:3e:2d:24:6f", "network": {"id": "fcedd8b7-ea71-40c5-9aaa-012a32d034dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-102964368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8bed46ae0b24564a8a9c68eec52f022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee5357d8-2d", "ovs_interfaceid": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:24:6f,bridge_name='br-int',has_traffic_filtering=True,id=ee5357d8-2dbf-42d7-90eb-01409b3f3a55,network=Network(fcedd8b7-ea71-40c5-9aaa-012a32d034dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee5357d8-2d') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG os_vif [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:24:6f,bridge_name='br-int',has_traffic_filtering=True,id=ee5357d8-2dbf-42d7-90eb-01409b3f3a55,network=Network(fcedd8b7-ea71-40c5-9aaa-012a32d034dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee5357d8-2d') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7bbea552-8d89-5bd7-a699-3f1efc07a357', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee5357d8-2d, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee5357d8-2d, col_values=(('qos', UUID('a085b2d5-8994-41a2-a6ca-98e48aa7cb65')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee5357d8-2d, col_values=(('external_ids', {'iface-id': 'ee5357d8-2dbf-42d7-90eb-01409b3f3a55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:24:6f', 'vm-uuid': 'fc692659-f62e-4d29-909d-0509cf3952b4'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:16 user nova-compute[75378]: INFO os_vif [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:24:6f,bridge_name='br-int',has_traffic_filtering=True,id=ee5357d8-2dbf-42d7-90eb-01409b3f3a55,network=Network(fcedd8b7-ea71-40c5-9aaa-012a32d034dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee5357d8-2d')
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.compute.manager [req-1e5844ea-ac28-4e68-8020-945e1cbe575c req-9e274070-9b0c-459b-9c0a-9d144c6567e6 service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Received event network-changed-ee5357d8-2dbf-42d7-90eb-01409b3f3a55 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.compute.manager [req-1e5844ea-ac28-4e68-8020-945e1cbe575c req-9e274070-9b0c-459b-9c0a-9d144c6567e6 service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Refreshing instance network info cache due to event network-changed-ee5357d8-2dbf-42d7-90eb-01409b3f3a55. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1e5844ea-ac28-4e68-8020-945e1cbe575c req-9e274070-9b0c-459b-9c0a-9d144c6567e6 service nova] Acquiring lock "refresh_cache-fc692659-f62e-4d29-909d-0509cf3952b4" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1e5844ea-ac28-4e68-8020-945e1cbe575c req-9e274070-9b0c-459b-9c0a-9d144c6567e6 service nova] Acquired lock "refresh_cache-fc692659-f62e-4d29-909d-0509cf3952b4" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.network.neutron [req-1e5844ea-ac28-4e68-8020-945e1cbe575c req-9e274070-9b0c-459b-9c0a-9d144c6567e6 service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Refreshing network info cache for port ee5357d8-2dbf-42d7-90eb-01409b3f3a55 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:37:16 user nova-compute[75378]: INFO nova.compute.manager [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Took 9.36 seconds to build instance.
Nov 09 03:37:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-43aaddbd-18d9-4c5f-abef-6ece6af27c16 tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.548s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:37:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] No VIF found with MAC fa:16:3e:2d:24:6f, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:37:17 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:37:17 user nova-compute[75378]: DEBUG nova.network.neutron [req-1e5844ea-ac28-4e68-8020-945e1cbe575c req-9e274070-9b0c-459b-9c0a-9d144c6567e6 service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Updated VIF entry in instance network info cache for port ee5357d8-2dbf-42d7-90eb-01409b3f3a55. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:37:17 user nova-compute[75378]: DEBUG nova.network.neutron [req-1e5844ea-ac28-4e68-8020-945e1cbe575c req-9e274070-9b0c-459b-9c0a-9d144c6567e6 service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Updating instance_info_cache with network_info: [{"id": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "address": "fa:16:3e:2d:24:6f", "network": {"id": "fcedd8b7-ea71-40c5-9aaa-012a32d034dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-102964368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8bed46ae0b24564a8a9c68eec52f022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee5357d8-2d", "ovs_interfaceid": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:37:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1e5844ea-ac28-4e68-8020-945e1cbe575c req-9e274070-9b0c-459b-9c0a-9d144c6567e6 service nova] Releasing lock "refresh_cache-fc692659-f62e-4d29-909d-0509cf3952b4" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:37:18 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:37:18 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:37:18 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:37:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:18 user nova-compute[75378]: DEBUG nova.compute.manager [req-da70df3f-fda1-42b3-b37a-c58ded1cf093 req-7894ddab-8d7b-4b5f-996b-77e9cb3cd78e service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Received event network-vif-plugged-ee5357d8-2dbf-42d7-90eb-01409b3f3a55 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:37:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-da70df3f-fda1-42b3-b37a-c58ded1cf093 req-7894ddab-8d7b-4b5f-996b-77e9cb3cd78e service nova] Acquiring lock "fc692659-f62e-4d29-909d-0509cf3952b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-da70df3f-fda1-42b3-b37a-c58ded1cf093 req-7894ddab-8d7b-4b5f-996b-77e9cb3cd78e service nova] Lock "fc692659-f62e-4d29-909d-0509cf3952b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-da70df3f-fda1-42b3-b37a-c58ded1cf093 req-7894ddab-8d7b-4b5f-996b-77e9cb3cd78e service nova] Lock "fc692659-f62e-4d29-909d-0509cf3952b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:18 user nova-compute[75378]: DEBUG nova.compute.manager [req-da70df3f-fda1-42b3-b37a-c58ded1cf093 req-7894ddab-8d7b-4b5f-996b-77e9cb3cd78e service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] No waiting events found dispatching network-vif-plugged-ee5357d8-2dbf-42d7-90eb-01409b3f3a55 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:37:18 user nova-compute[75378]: WARNING nova.compute.manager [req-da70df3f-fda1-42b3-b37a-c58ded1cf093 req-7894ddab-8d7b-4b5f-996b-77e9cb3cd78e service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Received unexpected event network-vif-plugged-ee5357d8-2dbf-42d7-90eb-01409b3f3a55 for instance with vm_state building and task_state spawning.
Nov 09 03:37:19 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:37:19 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:37:19 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Rebuilding the list of instances to heal {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 03:37:19 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Skipping network cache update for instance because it is Building. {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 09 03:37:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-9691c96a-287e-40f0-a7e2-70bd56d9d2d3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:37:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-9691c96a-287e-40f0-a7e2-70bd56d9d2d3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:37:19 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 03:37:19 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lazy-loading 'info_cache' on Instance uuid 9691c96a-287e-40f0-a7e2-70bd56d9d2d3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:37:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:19 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Updating instance_info_cache with network_info: [{"id": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "address": "fa:16:3e:cb:7d:a8", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f2f1d8-31", "ovs_interfaceid": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:37:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-9691c96a-287e-40f0-a7e2-70bd56d9d2d3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:37:19 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 03:37:19 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:37:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:20 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:37:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:20 user nova-compute[75378]: DEBUG nova.compute.manager [req-544fe9ee-9c88-4ec5-b8d6-2a0392884b71 req-7b0434a1-0251-43df-98fc-f0a89a51bf09 service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Received event network-vif-plugged-ee5357d8-2dbf-42d7-90eb-01409b3f3a55 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:37:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-544fe9ee-9c88-4ec5-b8d6-2a0392884b71 req-7b0434a1-0251-43df-98fc-f0a89a51bf09 service nova] Acquiring lock "fc692659-f62e-4d29-909d-0509cf3952b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-544fe9ee-9c88-4ec5-b8d6-2a0392884b71 req-7b0434a1-0251-43df-98fc-f0a89a51bf09 service nova] Lock "fc692659-f62e-4d29-909d-0509cf3952b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-544fe9ee-9c88-4ec5-b8d6-2a0392884b71 req-7b0434a1-0251-43df-98fc-f0a89a51bf09 service nova] Lock "fc692659-f62e-4d29-909d-0509cf3952b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:20 user nova-compute[75378]: DEBUG nova.compute.manager [req-544fe9ee-9c88-4ec5-b8d6-2a0392884b71 req-7b0434a1-0251-43df-98fc-f0a89a51bf09 service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] No waiting events found dispatching network-vif-plugged-ee5357d8-2dbf-42d7-90eb-01409b3f3a55 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:37:20 user nova-compute[75378]: WARNING nova.compute.manager [req-544fe9ee-9c88-4ec5-b8d6-2a0392884b71 req-7b0434a1-0251-43df-98fc-f0a89a51bf09 service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Received unexpected event network-vif-plugged-ee5357d8-2dbf-42d7-90eb-01409b3f3a55 for instance with vm_state building and task_state spawning.
Nov 09 03:37:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:21 user nova-compute[75378]: DEBUG nova.compute.manager [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:37:21 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:37:21 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Instance spawned successfully.
Nov 09 03:37:21 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:37:21 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:21 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:21 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:21 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:21 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:21 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:21 user nova-compute[75378]: INFO nova.compute.manager [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Took 6.85 seconds to spawn the instance on the hypervisor.
Nov 09 03:37:21 user nova-compute[75378]: DEBUG nova.compute.manager [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:37:21 user nova-compute[75378]: INFO nova.compute.manager [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Took 8.49 seconds to build instance.
Nov 09 03:37:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-14eedb64-69ec-488f-a385-cebe14098155 tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Lock "fc692659-f62e-4d29-909d-0509cf3952b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.704s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:25 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:37:25 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:37:25 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7556MB free_disk=25.705955505371094GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:37:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.005s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9691c96a-287e-40f0-a7e2-70bd56d9d2d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:37:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:37:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:37:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2f475dba-59f5-414a-8156-8b438601ecfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:37:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 70a7686e-042c-4be8-8182-69c62027c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:37:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 0aa21edc-dc12-46ad-925d-47bc5b576172 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:37:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 1fb5f90d-3d22-474d-947d-f939fa150f3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:37:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance fadeb1f5-4118-4a08-986a-ff08778b229d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:37:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance fc692659-f62e-4d29-909d-0509cf3952b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:37:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:37:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:37:26 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing inventories for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 03:37:26 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Updating ProviderTree inventory for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 03:37:26 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Updating inventory in ProviderTree for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 03:37:26 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing aggregate associations for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8, aggregates: None {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 03:37:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:26 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing trait associations for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8, traits: HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 03:37:27 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:37:27 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:37:27 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:37:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.410s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:27 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:37:27 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:37:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Acquiring lock "176d35dc-6397-4204-b0d3-0d27e3f967c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Lock "176d35dc-6397-4204-b0d3-0d27e3f967c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:41 user nova-compute[75378]: DEBUG nova.compute.manager [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:37:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:41 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:37:41 user nova-compute[75378]: INFO nova.compute.claims [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Claim successful on node user
Nov 09 03:37:41 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:37:41 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:37:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:41 user nova-compute[75378]: DEBUG nova.compute.manager [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:37:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:41 user nova-compute[75378]: DEBUG nova.compute.manager [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:37:41 user nova-compute[75378]: DEBUG nova.network.neutron [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:37:41 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:37:41 user nova-compute[75378]: DEBUG nova.compute.manager [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:37:41 user nova-compute[75378]: DEBUG nova.policy [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1046eb511add4fe5b474933ffcbea7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b08d524fe04e6eb949e0b25f8c483f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:37:42 user nova-compute[75378]: DEBUG nova.compute.manager [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:37:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:37:42 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Creating image(s)
Nov 09 03:37:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Acquiring lock "/opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Lock "/opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Lock "/opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.201s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.285s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:42 user nova-compute[75378]: DEBUG nova.network.neutron [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Successfully created port: 42cf6872-3077-4c5f-bc01-e0febdfd36e7 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:37:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6/disk 1073741824" returned: 0 in 0.069s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.361s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.208s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:42 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Checking if we can resize image /opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:37:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:37:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:37:42 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Cannot resize image /opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:37:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:37:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Ensure instance console log exists: /opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:37:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:43 user nova-compute[75378]: DEBUG nova.network.neutron [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Successfully updated port: 42cf6872-3077-4c5f-bc01-e0febdfd36e7 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:37:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Acquiring lock "refresh_cache-176d35dc-6397-4204-b0d3-0d27e3f967c6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:37:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Acquired lock "refresh_cache-176d35dc-6397-4204-b0d3-0d27e3f967c6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:37:43 user nova-compute[75378]: DEBUG nova.network.neutron [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:37:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-5233b6cd-cdb8-4b11-b23f-af6ddff182b5 req-3f0c8081-af0a-4fda-bd09-c045c2e378ea service nova] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Received event network-changed-42cf6872-3077-4c5f-bc01-e0febdfd36e7 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:37:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-5233b6cd-cdb8-4b11-b23f-af6ddff182b5 req-3f0c8081-af0a-4fda-bd09-c045c2e378ea service nova] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Refreshing instance network info cache due to event network-changed-42cf6872-3077-4c5f-bc01-e0febdfd36e7. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:37:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5233b6cd-cdb8-4b11-b23f-af6ddff182b5 req-3f0c8081-af0a-4fda-bd09-c045c2e378ea service nova] Acquiring lock "refresh_cache-176d35dc-6397-4204-b0d3-0d27e3f967c6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:37:43 user nova-compute[75378]: DEBUG nova.network.neutron [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.network.neutron [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Updating instance_info_cache with network_info: [{"id": "42cf6872-3077-4c5f-bc01-e0febdfd36e7", "address": "fa:16:3e:3c:8b:c9", "network": {"id": "ad335810-bbf2-489c-9e66-40066b1bf82e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-844539655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b08d524fe04e6eb949e0b25f8c483f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cf6872-30", "ovs_interfaceid": "42cf6872-3077-4c5f-bc01-e0febdfd36e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Releasing lock "refresh_cache-176d35dc-6397-4204-b0d3-0d27e3f967c6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.compute.manager [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Instance network_info: |[{"id": "42cf6872-3077-4c5f-bc01-e0febdfd36e7", "address": "fa:16:3e:3c:8b:c9", "network": {"id": "ad335810-bbf2-489c-9e66-40066b1bf82e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-844539655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b08d524fe04e6eb949e0b25f8c483f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cf6872-30", "ovs_interfaceid": "42cf6872-3077-4c5f-bc01-e0febdfd36e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5233b6cd-cdb8-4b11-b23f-af6ddff182b5 req-3f0c8081-af0a-4fda-bd09-c045c2e378ea service nova] Acquired lock "refresh_cache-176d35dc-6397-4204-b0d3-0d27e3f967c6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.network.neutron [req-5233b6cd-cdb8-4b11-b23f-af6ddff182b5 req-3f0c8081-af0a-4fda-bd09-c045c2e378ea service nova] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Refreshing network info cache for port 42cf6872-3077-4c5f-bc01-e0febdfd36e7 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Start _get_guest_xml network_info=[{"id": "42cf6872-3077-4c5f-bc01-e0febdfd36e7", "address": "fa:16:3e:3c:8b:c9", "network": {"id": "ad335810-bbf2-489c-9e66-40066b1bf82e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-844539655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b08d524fe04e6eb949e0b25f8c483f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cf6872-30", "ovs_interfaceid": "42cf6872-3077-4c5f-bc01-e0febdfd36e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:37:44 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:37:44 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:37:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1329497690',display_name='tempest-VolumesActionsTest-instance-1329497690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1329497690',id=10,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44b08d524fe04e6eb949e0b25f8c483f',ramdisk_id='',reservation_id='r-q3ieyhqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-718476384',owner_user_name='tempest-VolumesActionsTest-718476384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:37:42Z,user_data=None,user_id='1046eb511add4fe5b474933ffcbea7b3',uuid=176d35dc-6397-4204-b0d3-0d27e3f967c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42cf6872-3077-4c5f-bc01-e0febdfd36e7", "address": "fa:16:3e:3c:8b:c9", "network": {"id": "ad335810-bbf2-489c-9e66-40066b1bf82e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-844539655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b08d524fe04e6eb949e0b25f8c483f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cf6872-30", "ovs_interfaceid": "42cf6872-3077-4c5f-bc01-e0febdfd36e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Converting VIF {"id": "42cf6872-3077-4c5f-bc01-e0febdfd36e7", "address": "fa:16:3e:3c:8b:c9", "network": {"id": "ad335810-bbf2-489c-9e66-40066b1bf82e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-844539655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b08d524fe04e6eb949e0b25f8c483f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cf6872-30", "ovs_interfaceid": "42cf6872-3077-4c5f-bc01-e0febdfd36e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:8b:c9,bridge_name='br-int',has_traffic_filtering=True,id=42cf6872-3077-4c5f-bc01-e0febdfd36e7,network=Network(ad335810-bbf2-489c-9e66-40066b1bf82e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42cf6872-30') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.objects.instance [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Lazy-loading 'pci_devices' on Instance uuid 176d35dc-6397-4204-b0d3-0d27e3f967c6 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:37:44 user nova-compute[75378]:   <uuid>176d35dc-6397-4204-b0d3-0d27e3f967c6</uuid>
Nov 09 03:37:44 user nova-compute[75378]:   <name>instance-0000000a</name>
Nov 09 03:37:44 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:37:44 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:37:44 user nova-compute[75378]:   <metadata>
Nov 09 03:37:44 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:37:44 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:37:44 user nova-compute[75378]:       <nova:name>tempest-VolumesActionsTest-instance-1329497690</nova:name>
Nov 09 03:37:44 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:37:44</nova:creationTime>
Nov 09 03:37:44 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:37:44 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:37:44 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:37:44 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:37:44 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:37:44 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:37:44 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:37:44 user nova-compute[75378]:       <nova:owner>
Nov 09 03:37:44 user nova-compute[75378]:         <nova:user uuid="1046eb511add4fe5b474933ffcbea7b3">tempest-VolumesActionsTest-718476384-project-member</nova:user>
Nov 09 03:37:44 user nova-compute[75378]:         <nova:project uuid="44b08d524fe04e6eb949e0b25f8c483f">tempest-VolumesActionsTest-718476384</nova:project>
Nov 09 03:37:44 user nova-compute[75378]:       </nova:owner>
Nov 09 03:37:44 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:37:44 user nova-compute[75378]:       <nova:ports>
Nov 09 03:37:44 user nova-compute[75378]:         <nova:port uuid="42cf6872-3077-4c5f-bc01-e0febdfd36e7">
Nov 09 03:37:44 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 03:37:44 user nova-compute[75378]:         </nova:port>
Nov 09 03:37:44 user nova-compute[75378]:       </nova:ports>
Nov 09 03:37:44 user nova-compute[75378]:     </nova:instance>
Nov 09 03:37:44 user nova-compute[75378]:   </metadata>
Nov 09 03:37:44 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:37:44 user nova-compute[75378]:     <system>
Nov 09 03:37:44 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:37:44 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:37:44 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:37:44 user nova-compute[75378]:       <entry name="serial">176d35dc-6397-4204-b0d3-0d27e3f967c6</entry>
Nov 09 03:37:44 user nova-compute[75378]:       <entry name="uuid">176d35dc-6397-4204-b0d3-0d27e3f967c6</entry>
Nov 09 03:37:44 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:37:44 user nova-compute[75378]:     </system>
Nov 09 03:37:44 user nova-compute[75378]:   </sysinfo>
Nov 09 03:37:44 user nova-compute[75378]:   <os>
Nov 09 03:37:44 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:37:44 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:37:44 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:37:44 user nova-compute[75378]:   </os>
Nov 09 03:37:44 user nova-compute[75378]:   <features>
Nov 09 03:37:44 user nova-compute[75378]:     <acpi/>
Nov 09 03:37:44 user nova-compute[75378]:     <apic/>
Nov 09 03:37:44 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:37:44 user nova-compute[75378]:   </features>
Nov 09 03:37:44 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:37:44 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:37:44 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:37:44 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:37:44 user nova-compute[75378]:   </clock>
Nov 09 03:37:44 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:37:44 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:37:44 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:37:44 user nova-compute[75378]:   </cpu>
Nov 09 03:37:44 user nova-compute[75378]:   <devices>
Nov 09 03:37:44 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:37:44 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:37:44 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6/disk"/>
Nov 09 03:37:44 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:37:44 user nova-compute[75378]:     </disk>
Nov 09 03:37:44 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:37:44 user nova-compute[75378]:       <mac address="fa:16:3e:3c:8b:c9"/>
Nov 09 03:37:44 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:37:44 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:37:44 user nova-compute[75378]:       <target dev="tap42cf6872-30"/>
Nov 09 03:37:44 user nova-compute[75378]:     </interface>
Nov 09 03:37:44 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:37:44 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6/console.log" append="off"/>
Nov 09 03:37:44 user nova-compute[75378]:     </serial>
Nov 09 03:37:44 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:37:44 user nova-compute[75378]:     <video>
Nov 09 03:37:44 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:37:44 user nova-compute[75378]:     </video>
Nov 09 03:37:44 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:37:44 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:37:44 user nova-compute[75378]:     </rng>
Nov 09 03:37:44 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:37:44 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:37:44 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:37:44 user nova-compute[75378]:     </memballoon>
Nov 09 03:37:44 user nova-compute[75378]:   </devices>
Nov 09 03:37:44 user nova-compute[75378]: </domain>
Nov 09 03:37:44 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:37:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1329497690',display_name='tempest-VolumesActionsTest-instance-1329497690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1329497690',id=10,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44b08d524fe04e6eb949e0b25f8c483f',ramdisk_id='',reservation_id='r-q3ieyhqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-718476384',owner_user_name='tempest-VolumesActionsTest-718476384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:37:42Z,user_data=None,user_id='1046eb511add4fe5b474933ffcbea7b3',uuid=176d35dc-6397-4204-b0d3-0d27e3f967c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42cf6872-3077-4c5f-bc01-e0febdfd36e7", "address": "fa:16:3e:3c:8b:c9", "network": {"id": "ad335810-bbf2-489c-9e66-40066b1bf82e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-844539655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b08d524fe04e6eb949e0b25f8c483f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cf6872-30", "ovs_interfaceid": "42cf6872-3077-4c5f-bc01-e0febdfd36e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Converting VIF {"id": "42cf6872-3077-4c5f-bc01-e0febdfd36e7", "address": "fa:16:3e:3c:8b:c9", "network": {"id": "ad335810-bbf2-489c-9e66-40066b1bf82e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-844539655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b08d524fe04e6eb949e0b25f8c483f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cf6872-30", "ovs_interfaceid": "42cf6872-3077-4c5f-bc01-e0febdfd36e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:8b:c9,bridge_name='br-int',has_traffic_filtering=True,id=42cf6872-3077-4c5f-bc01-e0febdfd36e7,network=Network(ad335810-bbf2-489c-9e66-40066b1bf82e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42cf6872-30') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG os_vif [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:8b:c9,bridge_name='br-int',has_traffic_filtering=True,id=42cf6872-3077-4c5f-bc01-e0febdfd36e7,network=Network(ad335810-bbf2-489c-9e66-40066b1bf82e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42cf6872-30') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '24a938e9-de28-5260-bcad-f940517daacf', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42cf6872-30, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap42cf6872-30, col_values=(('qos', UUID('2dbaeffb-eec7-4172-8106-8f1e5dda3d8c')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap42cf6872-30, col_values=(('external_ids', {'iface-id': '42cf6872-3077-4c5f-bc01-e0febdfd36e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:8b:c9', 'vm-uuid': '176d35dc-6397-4204-b0d3-0d27e3f967c6'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:44 user nova-compute[75378]: INFO os_vif [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:8b:c9,bridge_name='br-int',has_traffic_filtering=True,id=42cf6872-3077-4c5f-bc01-e0febdfd36e7,network=Network(ad335810-bbf2-489c-9e66-40066b1bf82e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42cf6872-30')
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] No VIF found with MAC fa:16:3e:3c:8b:c9, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.network.neutron [req-5233b6cd-cdb8-4b11-b23f-af6ddff182b5 req-3f0c8081-af0a-4fda-bd09-c045c2e378ea service nova] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Updated VIF entry in instance network info cache for port 42cf6872-3077-4c5f-bc01-e0febdfd36e7. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG nova.network.neutron [req-5233b6cd-cdb8-4b11-b23f-af6ddff182b5 req-3f0c8081-af0a-4fda-bd09-c045c2e378ea service nova] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Updating instance_info_cache with network_info: [{"id": "42cf6872-3077-4c5f-bc01-e0febdfd36e7", "address": "fa:16:3e:3c:8b:c9", "network": {"id": "ad335810-bbf2-489c-9e66-40066b1bf82e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-844539655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b08d524fe04e6eb949e0b25f8c483f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cf6872-30", "ovs_interfaceid": "42cf6872-3077-4c5f-bc01-e0febdfd36e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:37:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5233b6cd-cdb8-4b11-b23f-af6ddff182b5 req-3f0c8081-af0a-4fda-bd09-c045c2e378ea service nova] Releasing lock "refresh_cache-176d35dc-6397-4204-b0d3-0d27e3f967c6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:37:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-be1fa2b2-9d50-4323-87d6-3ca5f21e76d3 req-f68a8a96-4bd8-4358-982e-37b5e35df457 service nova] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Received event network-vif-plugged-42cf6872-3077-4c5f-bc01-e0febdfd36e7 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:37:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-be1fa2b2-9d50-4323-87d6-3ca5f21e76d3 req-f68a8a96-4bd8-4358-982e-37b5e35df457 service nova] Acquiring lock "176d35dc-6397-4204-b0d3-0d27e3f967c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-be1fa2b2-9d50-4323-87d6-3ca5f21e76d3 req-f68a8a96-4bd8-4358-982e-37b5e35df457 service nova] Lock "176d35dc-6397-4204-b0d3-0d27e3f967c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-be1fa2b2-9d50-4323-87d6-3ca5f21e76d3 req-f68a8a96-4bd8-4358-982e-37b5e35df457 service nova] Lock "176d35dc-6397-4204-b0d3-0d27e3f967c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-be1fa2b2-9d50-4323-87d6-3ca5f21e76d3 req-f68a8a96-4bd8-4358-982e-37b5e35df457 service nova] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] No waiting events found dispatching network-vif-plugged-42cf6872-3077-4c5f-bc01-e0febdfd36e7 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:37:46 user nova-compute[75378]: WARNING nova.compute.manager [req-be1fa2b2-9d50-4323-87d6-3ca5f21e76d3 req-f68a8a96-4bd8-4358-982e-37b5e35df457 service nova] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Received unexpected event network-vif-plugged-42cf6872-3077-4c5f-bc01-e0febdfd36e7 for instance with vm_state building and task_state spawning.
Nov 09 03:37:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:48 user nova-compute[75378]: DEBUG nova.compute.manager [req-8159dfac-3f84-4622-b28e-d0f22de34b0d req-64452d52-8c55-4f08-925a-0c8fc3f432f5 service nova] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Received event network-vif-plugged-42cf6872-3077-4c5f-bc01-e0febdfd36e7 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:37:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8159dfac-3f84-4622-b28e-d0f22de34b0d req-64452d52-8c55-4f08-925a-0c8fc3f432f5 service nova] Acquiring lock "176d35dc-6397-4204-b0d3-0d27e3f967c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:37:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8159dfac-3f84-4622-b28e-d0f22de34b0d req-64452d52-8c55-4f08-925a-0c8fc3f432f5 service nova] Lock "176d35dc-6397-4204-b0d3-0d27e3f967c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:37:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8159dfac-3f84-4622-b28e-d0f22de34b0d req-64452d52-8c55-4f08-925a-0c8fc3f432f5 service nova] Lock "176d35dc-6397-4204-b0d3-0d27e3f967c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:48 user nova-compute[75378]: DEBUG nova.compute.manager [req-8159dfac-3f84-4622-b28e-d0f22de34b0d req-64452d52-8c55-4f08-925a-0c8fc3f432f5 service nova] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] No waiting events found dispatching network-vif-plugged-42cf6872-3077-4c5f-bc01-e0febdfd36e7 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:37:48 user nova-compute[75378]: WARNING nova.compute.manager [req-8159dfac-3f84-4622-b28e-d0f22de34b0d req-64452d52-8c55-4f08-925a-0c8fc3f432f5 service nova] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Received unexpected event network-vif-plugged-42cf6872-3077-4c5f-bc01-e0febdfd36e7 for instance with vm_state building and task_state spawning.
Nov 09 03:37:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:37:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:37:48 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Instance spawned successfully.
Nov 09 03:37:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:37:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:37:48 user nova-compute[75378]: INFO nova.compute.manager [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 09 03:37:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:37:48 user nova-compute[75378]: INFO nova.compute.manager [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Took 7.37 seconds to build instance.
Nov 09 03:37:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b74b616-83d0-4701-96eb-0cac0eac6278 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Lock "176d35dc-6397-4204-b0d3-0d27e3f967c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.487s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:37:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:37:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Acquiring lock "8adad7f0-fa15-415b-b384-bfdae665a59b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "8adad7f0-fa15-415b-b384-bfdae665a59b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:15 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:38:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:38:15 user nova-compute[75378]: INFO nova.compute.claims [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Claim successful on node user
Nov 09 03:38:15 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:38:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:15 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:38:15 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:38:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:38:15 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:38:15 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:38:15 user nova-compute[75378]: DEBUG nova.network.neutron [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:38:15 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:38:15 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:38:15 user nova-compute[75378]: DEBUG nova.policy [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '201443e0d5e84be0b662043093120ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1024d4b86f47b480b75e55108e6c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:38:15 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:38:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:38:15 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Creating image(s)
Nov 09 03:38:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Acquiring lock "/opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "/opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "/opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:38:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:16 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.200s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:16 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:16 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.171s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:16 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:16 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b/disk 1073741824" returned: 0 in 0.056s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:38:16 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:16 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.188s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:16 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:38:16 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:16 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:16 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Cannot resize image /opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:38:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:38:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Ensure instance console log exists: /opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:38:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:38:16 user nova-compute[75378]: DEBUG nova.network.neutron [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Successfully created port: 61ec79aa-e08d-4565-bee8-3f42ca74eb70 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.network.neutron [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Successfully updated port: 61ec79aa-e08d-4565-bee8-3f42ca74eb70 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Acquiring lock "refresh_cache-8adad7f0-fa15-415b-b384-bfdae665a59b" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Acquired lock "refresh_cache-8adad7f0-fa15-415b-b384-bfdae665a59b" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.network.neutron [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-304d84ef-9a61-42ce-a5b3-200189388b52 req-2bc1927e-a8f5-4bec-a82e-6f279540e581 service nova] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Received event network-changed-61ec79aa-e08d-4565-bee8-3f42ca74eb70 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-304d84ef-9a61-42ce-a5b3-200189388b52 req-2bc1927e-a8f5-4bec-a82e-6f279540e581 service nova] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Refreshing instance network info cache due to event network-changed-61ec79aa-e08d-4565-bee8-3f42ca74eb70. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-304d84ef-9a61-42ce-a5b3-200189388b52 req-2bc1927e-a8f5-4bec-a82e-6f279540e581 service nova] Acquiring lock "refresh_cache-8adad7f0-fa15-415b-b384-bfdae665a59b" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.network.neutron [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.network.neutron [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Updating instance_info_cache with network_info: [{"id": "61ec79aa-e08d-4565-bee8-3f42ca74eb70", "address": "fa:16:3e:a2:58:e3", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ec79aa-e0", "ovs_interfaceid": "61ec79aa-e08d-4565-bee8-3f42ca74eb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Releasing lock "refresh_cache-8adad7f0-fa15-415b-b384-bfdae665a59b" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Instance network_info: |[{"id": "61ec79aa-e08d-4565-bee8-3f42ca74eb70", "address": "fa:16:3e:a2:58:e3", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ec79aa-e0", "ovs_interfaceid": "61ec79aa-e08d-4565-bee8-3f42ca74eb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-304d84ef-9a61-42ce-a5b3-200189388b52 req-2bc1927e-a8f5-4bec-a82e-6f279540e581 service nova] Acquired lock "refresh_cache-8adad7f0-fa15-415b-b384-bfdae665a59b" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.network.neutron [req-304d84ef-9a61-42ce-a5b3-200189388b52 req-2bc1927e-a8f5-4bec-a82e-6f279540e581 service nova] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Refreshing network info cache for port 61ec79aa-e08d-4565-bee8-3f42ca74eb70 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Start _get_guest_xml network_info=[{"id": "61ec79aa-e08d-4565-bee8-3f42ca74eb70", "address": "fa:16:3e:a2:58:e3", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ec79aa-e0", "ovs_interfaceid": "61ec79aa-e08d-4565-bee8-3f42ca74eb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:38:17 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:38:17 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:38:17 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:38:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1067772541',display_name='tempest-ServersNegativeTestJSON-server-1067772541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1067772541',id=11,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed1024d4b86f47b480b75e55108e6c30',ramdisk_id='',reservation_id='r-foermn5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-218592793',owner_user_name='tempest-ServersNegativeTestJSON-218592793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:38:16Z,user_data=None,user_id='201443e0d5e84be0b662043093120ae3',uuid=8adad7f0-fa15-415b-b384-bfdae665a59b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61ec79aa-e08d-4565-bee8-3f42ca74eb70", "address": "fa:16:3e:a2:58:e3", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ec79aa-e0", "ovs_interfaceid": "61ec79aa-e08d-4565-bee8-3f42ca74eb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Converting VIF {"id": "61ec79aa-e08d-4565-bee8-3f42ca74eb70", "address": "fa:16:3e:a2:58:e3", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ec79aa-e0", "ovs_interfaceid": "61ec79aa-e08d-4565-bee8-3f42ca74eb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:58:e3,bridge_name='br-int',has_traffic_filtering=True,id=61ec79aa-e08d-4565-bee8-3f42ca74eb70,network=Network(9b18f037-ec04-4c7f-bfc8-17e90dd10787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ec79aa-e0') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG nova.objects.instance [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lazy-loading 'pci_devices' on Instance uuid 8adad7f0-fa15-415b-b384-bfdae665a59b {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:38:18 user nova-compute[75378]:   <uuid>8adad7f0-fa15-415b-b384-bfdae665a59b</uuid>
Nov 09 03:38:18 user nova-compute[75378]:   <name>instance-0000000b</name>
Nov 09 03:38:18 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:38:18 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:38:18 user nova-compute[75378]:   <metadata>
Nov 09 03:38:18 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:38:18 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:38:18 user nova-compute[75378]:       <nova:name>tempest-ServersNegativeTestJSON-server-1067772541</nova:name>
Nov 09 03:38:18 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:38:17</nova:creationTime>
Nov 09 03:38:18 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:38:18 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:38:18 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:38:18 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:38:18 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:38:18 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:38:18 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:38:18 user nova-compute[75378]:       <nova:owner>
Nov 09 03:38:18 user nova-compute[75378]:         <nova:user uuid="201443e0d5e84be0b662043093120ae3">tempest-ServersNegativeTestJSON-218592793-project-member</nova:user>
Nov 09 03:38:18 user nova-compute[75378]:         <nova:project uuid="ed1024d4b86f47b480b75e55108e6c30">tempest-ServersNegativeTestJSON-218592793</nova:project>
Nov 09 03:38:18 user nova-compute[75378]:       </nova:owner>
Nov 09 03:38:18 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:38:18 user nova-compute[75378]:       <nova:ports>
Nov 09 03:38:18 user nova-compute[75378]:         <nova:port uuid="61ec79aa-e08d-4565-bee8-3f42ca74eb70">
Nov 09 03:38:18 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 03:38:18 user nova-compute[75378]:         </nova:port>
Nov 09 03:38:18 user nova-compute[75378]:       </nova:ports>
Nov 09 03:38:18 user nova-compute[75378]:     </nova:instance>
Nov 09 03:38:18 user nova-compute[75378]:   </metadata>
Nov 09 03:38:18 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:38:18 user nova-compute[75378]:     <system>
Nov 09 03:38:18 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:38:18 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:38:18 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:38:18 user nova-compute[75378]:       <entry name="serial">8adad7f0-fa15-415b-b384-bfdae665a59b</entry>
Nov 09 03:38:18 user nova-compute[75378]:       <entry name="uuid">8adad7f0-fa15-415b-b384-bfdae665a59b</entry>
Nov 09 03:38:18 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:38:18 user nova-compute[75378]:     </system>
Nov 09 03:38:18 user nova-compute[75378]:   </sysinfo>
Nov 09 03:38:18 user nova-compute[75378]:   <os>
Nov 09 03:38:18 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:38:18 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:38:18 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:38:18 user nova-compute[75378]:   </os>
Nov 09 03:38:18 user nova-compute[75378]:   <features>
Nov 09 03:38:18 user nova-compute[75378]:     <acpi/>
Nov 09 03:38:18 user nova-compute[75378]:     <apic/>
Nov 09 03:38:18 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:38:18 user nova-compute[75378]:   </features>
Nov 09 03:38:18 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:38:18 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:38:18 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:38:18 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:38:18 user nova-compute[75378]:   </clock>
Nov 09 03:38:18 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:38:18 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:38:18 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:38:18 user nova-compute[75378]:   </cpu>
Nov 09 03:38:18 user nova-compute[75378]:   <devices>
Nov 09 03:38:18 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:38:18 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:38:18 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b/disk"/>
Nov 09 03:38:18 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:38:18 user nova-compute[75378]:     </disk>
Nov 09 03:38:18 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:38:18 user nova-compute[75378]:       <mac address="fa:16:3e:a2:58:e3"/>
Nov 09 03:38:18 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:38:18 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:38:18 user nova-compute[75378]:       <target dev="tap61ec79aa-e0"/>
Nov 09 03:38:18 user nova-compute[75378]:     </interface>
Nov 09 03:38:18 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:38:18 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b/console.log" append="off"/>
Nov 09 03:38:18 user nova-compute[75378]:     </serial>
Nov 09 03:38:18 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:38:18 user nova-compute[75378]:     <video>
Nov 09 03:38:18 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:38:18 user nova-compute[75378]:     </video>
Nov 09 03:38:18 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:38:18 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:38:18 user nova-compute[75378]:     </rng>
Nov 09 03:38:18 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:38:18 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:38:18 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:38:18 user nova-compute[75378]:     </memballoon>
Nov 09 03:38:18 user nova-compute[75378]:   </devices>
Nov 09 03:38:18 user nova-compute[75378]: </domain>
Nov 09 03:38:18 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:38:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1067772541',display_name='tempest-ServersNegativeTestJSON-server-1067772541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1067772541',id=11,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed1024d4b86f47b480b75e55108e6c30',ramdisk_id='',reservation_id='r-foermn5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-218592793',owner_user_name='tempest-ServersNegativeTestJSON-218592793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:38:16Z,user_data=None,user_id='201443e0d5e84be0b662043093120ae3',uuid=8adad7f0-fa15-415b-b384-bfdae665a59b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61ec79aa-e08d-4565-bee8-3f42ca74eb70", "address": "fa:16:3e:a2:58:e3", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ec79aa-e0", "ovs_interfaceid": "61ec79aa-e08d-4565-bee8-3f42ca74eb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Converting VIF {"id": "61ec79aa-e08d-4565-bee8-3f42ca74eb70", "address": "fa:16:3e:a2:58:e3", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ec79aa-e0", "ovs_interfaceid": "61ec79aa-e08d-4565-bee8-3f42ca74eb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:58:e3,bridge_name='br-int',has_traffic_filtering=True,id=61ec79aa-e08d-4565-bee8-3f42ca74eb70,network=Network(9b18f037-ec04-4c7f-bfc8-17e90dd10787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ec79aa-e0') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG os_vif [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:58:e3,bridge_name='br-int',has_traffic_filtering=True,id=61ec79aa-e08d-4565-bee8-3f42ca74eb70,network=Network(9b18f037-ec04-4c7f-bfc8-17e90dd10787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ec79aa-e0') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a8eaab8-5f4f-5f16-b675-a8497e1161e1', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61ec79aa-e0, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61ec79aa-e0, col_values=(('qos', UUID('33b0187c-33fb-4aa2-96c1-c97c6f6fa624')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61ec79aa-e0, col_values=(('external_ids', {'iface-id': '61ec79aa-e08d-4565-bee8-3f42ca74eb70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:58:e3', 'vm-uuid': '8adad7f0-fa15-415b-b384-bfdae665a59b'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:38:18 user nova-compute[75378]: INFO os_vif [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:58:e3,bridge_name='br-int',has_traffic_filtering=True,id=61ec79aa-e08d-4565-bee8-3f42ca74eb70,network=Network(9b18f037-ec04-4c7f-bfc8-17e90dd10787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ec79aa-e0')
Nov 09 03:38:18 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] No VIF found with MAC fa:16:3e:a2:58:e3, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG nova.network.neutron [req-304d84ef-9a61-42ce-a5b3-200189388b52 req-2bc1927e-a8f5-4bec-a82e-6f279540e581 service nova] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Updated VIF entry in instance network info cache for port 61ec79aa-e08d-4565-bee8-3f42ca74eb70. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG nova.network.neutron [req-304d84ef-9a61-42ce-a5b3-200189388b52 req-2bc1927e-a8f5-4bec-a82e-6f279540e581 service nova] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Updating instance_info_cache with network_info: [{"id": "61ec79aa-e08d-4565-bee8-3f42ca74eb70", "address": "fa:16:3e:a2:58:e3", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ec79aa-e0", "ovs_interfaceid": "61ec79aa-e08d-4565-bee8-3f42ca74eb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:38:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-304d84ef-9a61-42ce-a5b3-200189388b52 req-2bc1927e-a8f5-4bec-a82e-6f279540e581 service nova] Releasing lock "refresh_cache-8adad7f0-fa15-415b-b384-bfdae665a59b" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:38:19 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:38:19 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:38:19 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:38:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:38:19 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:38:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:20 user nova-compute[75378]: DEBUG nova.compute.manager [req-575f9df8-a642-4478-930f-8e8c03056f66 req-b52a8320-b8e9-4108-a26a-b3c3ce4be927 service nova] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Received event network-vif-plugged-61ec79aa-e08d-4565-bee8-3f42ca74eb70 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-575f9df8-a642-4478-930f-8e8c03056f66 req-b52a8320-b8e9-4108-a26a-b3c3ce4be927 service nova] Acquiring lock "8adad7f0-fa15-415b-b384-bfdae665a59b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-575f9df8-a642-4478-930f-8e8c03056f66 req-b52a8320-b8e9-4108-a26a-b3c3ce4be927 service nova] Lock "8adad7f0-fa15-415b-b384-bfdae665a59b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-575f9df8-a642-4478-930f-8e8c03056f66 req-b52a8320-b8e9-4108-a26a-b3c3ce4be927 service nova] Lock "8adad7f0-fa15-415b-b384-bfdae665a59b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:38:20 user nova-compute[75378]: DEBUG nova.compute.manager [req-575f9df8-a642-4478-930f-8e8c03056f66 req-b52a8320-b8e9-4108-a26a-b3c3ce4be927 service nova] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] No waiting events found dispatching network-vif-plugged-61ec79aa-e08d-4565-bee8-3f42ca74eb70 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:38:20 user nova-compute[75378]: WARNING nova.compute.manager [req-575f9df8-a642-4478-930f-8e8c03056f66 req-b52a8320-b8e9-4108-a26a-b3c3ce4be927 service nova] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Received unexpected event network-vif-plugged-61ec79aa-e08d-4565-bee8-3f42ca74eb70 for instance with vm_state building and task_state spawning.
Nov 09 03:38:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:20 user nova-compute[75378]: INFO nova.compute.manager [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Rescuing
Nov 09 03:38:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "refresh_cache-6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:38:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquired lock "refresh_cache-6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:38:20 user nova-compute[75378]: DEBUG nova.network.neutron [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:38:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:21 user nova-compute[75378]: DEBUG nova.network.neutron [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Updating instance_info_cache with network_info: [{"id": "4c53e537-1637-4f65-b393-a10e68383acb", "address": "fa:16:3e:d8:76:bf", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c53e537-16", "ovs_interfaceid": "4c53e537-1637-4f65-b393-a10e68383acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:38:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Releasing lock "refresh_cache-6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:38:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.compute.manager [req-a2f58042-1e07-4e2f-a372-4f56638402c8 req-15a8f341-8380-4b14-ae93-9aa934732eb7 service nova] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Received event network-vif-plugged-61ec79aa-e08d-4565-bee8-3f42ca74eb70 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a2f58042-1e07-4e2f-a372-4f56638402c8 req-15a8f341-8380-4b14-ae93-9aa934732eb7 service nova] Acquiring lock "8adad7f0-fa15-415b-b384-bfdae665a59b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a2f58042-1e07-4e2f-a372-4f56638402c8 req-15a8f341-8380-4b14-ae93-9aa934732eb7 service nova] Lock "8adad7f0-fa15-415b-b384-bfdae665a59b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a2f58042-1e07-4e2f-a372-4f56638402c8 req-15a8f341-8380-4b14-ae93-9aa934732eb7 service nova] Lock "8adad7f0-fa15-415b-b384-bfdae665a59b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.compute.manager [req-a2f58042-1e07-4e2f-a372-4f56638402c8 req-15a8f341-8380-4b14-ae93-9aa934732eb7 service nova] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] No waiting events found dispatching network-vif-plugged-61ec79aa-e08d-4565-bee8-3f42ca74eb70 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:38:22 user nova-compute[75378]: WARNING nova.compute.manager [req-a2f58042-1e07-4e2f-a372-4f56638402c8 req-15a8f341-8380-4b14-ae93-9aa934732eb7 service nova] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Received unexpected event network-vif-plugged-61ec79aa-e08d-4565-bee8-3f42ca74eb70 for instance with vm_state building and task_state spawning.
Nov 09 03:38:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:38:22 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Instance spawned successfully.
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.compute.manager [req-bb484ee7-d3ef-49e6-91de-428a4de81b35 req-4657e624-dfb1-4f3c-b379-be61aa8df474 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Received event network-vif-unplugged-4c53e537-1637-4f65-b393-a10e68383acb {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bb484ee7-d3ef-49e6-91de-428a4de81b35 req-4657e624-dfb1-4f3c-b379-be61aa8df474 service nova] Acquiring lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bb484ee7-d3ef-49e6-91de-428a4de81b35 req-4657e624-dfb1-4f3c-b379-be61aa8df474 service nova] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bb484ee7-d3ef-49e6-91de-428a4de81b35 req-4657e624-dfb1-4f3c-b379-be61aa8df474 service nova] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.compute.manager [req-bb484ee7-d3ef-49e6-91de-428a4de81b35 req-4657e624-dfb1-4f3c-b379-be61aa8df474 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] No waiting events found dispatching network-vif-unplugged-4c53e537-1637-4f65-b393-a10e68383acb {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:38:22 user nova-compute[75378]: WARNING nova.compute.manager [req-bb484ee7-d3ef-49e6-91de-428a4de81b35 req-4657e624-dfb1-4f3c-b379-be61aa8df474 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Received unexpected event network-vif-unplugged-4c53e537-1637-4f65-b393-a10e68383acb for instance with vm_state active and task_state rescuing.
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:22 user nova-compute[75378]: INFO nova.compute.manager [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Took 6.69 seconds to spawn the instance on the hypervisor.
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:38:22 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Instance destroyed successfully.
Nov 09 03:38:22 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Attempting rescue
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75378) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Instance directory exists: not creating {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 03:38:22 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Creating image(s)
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "/opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "/opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.objects.instance [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:22 user nova-compute[75378]: INFO nova.compute.manager [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Took 7.51 seconds to build instance.
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b6b06465-b1bc-4d54-8fb6-2f83773ff52a tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "8adad7f0-fa15-415b-b384-bfdae665a59b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.615s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.215s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue" returned: 0 in 0.049s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.objects.instance [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'migration_context' on Instance uuid 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.objects.base [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Object Instance<6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Start _get_guest_xml network_info=[{"id": "4c53e537-1637-4f65-b393-a10e68383acb", "address": "fa:16:3e:d8:76:bf", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "vif_mac": "fa:16:3e:d8:76:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c53e537-16", "ovs_interfaceid": "4c53e537-1637-4f65-b393-a10e68383acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.objects.instance [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'resources' on Instance uuid 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.objects.base [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Object Instance<6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.objects.instance [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'numa_topology' on Instance uuid 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.objects.base [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Object Instance<6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:38:22 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:38:22 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.objects.instance [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:38:22 user nova-compute[75378]: DEBUG nova.objects.base [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Object Instance<6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:38:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-126426902',display_name='tempest-ServerRescueNegativeTestJSON-server-126426902',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-126426902',id=3,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:36:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87cddc7aab3e44cf82391eebc6a167b1',ramdisk_id='',reservation_id='r-2farfnrw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1449314788',owner_user_name='tempest-ServerRescueNegativeTestJSON-1449314788-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:36:43Z,user_data=None,user_id='ab29d2c2dda547aeb386aa641f4acd24',uuid=6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c53e537-1637-4f65-b393-a10e68383acb", "address": "fa:16:3e:d8:76:bf", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "vif_mac": "fa:16:3e:d8:76:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c53e537-16", "ovs_interfaceid": "4c53e537-1637-4f65-b393-a10e68383acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:38:23 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converting VIF {"id": "4c53e537-1637-4f65-b393-a10e68383acb", "address": "fa:16:3e:d8:76:bf", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "vif_mac": "fa:16:3e:d8:76:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c53e537-16", "ovs_interfaceid": "4c53e537-1637-4f65-b393-a10e68383acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:38:23 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:76:bf,bridge_name='br-int',has_traffic_filtering=True,id=4c53e537-1637-4f65-b393-a10e68383acb,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c53e537-16') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:38:23 user nova-compute[75378]: DEBUG nova.objects.instance [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:38:23 user nova-compute[75378]: DEBUG nova.objects.base [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Object Instance<6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:38:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:38:23 user nova-compute[75378]:   <uuid>6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76</uuid>
Nov 09 03:38:23 user nova-compute[75378]:   <name>instance-00000003</name>
Nov 09 03:38:23 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:38:23 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:38:23 user nova-compute[75378]:   <metadata>
Nov 09 03:38:23 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:38:23 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:38:23 user nova-compute[75378]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-126426902</nova:name>
Nov 09 03:38:23 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:38:22</nova:creationTime>
Nov 09 03:38:23 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:38:23 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:38:23 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:38:23 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:38:23 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:38:23 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:38:23 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:38:23 user nova-compute[75378]:       <nova:owner>
Nov 09 03:38:23 user nova-compute[75378]:         <nova:user uuid="ab29d2c2dda547aeb386aa641f4acd24">tempest-ServerRescueNegativeTestJSON-1449314788-project-member</nova:user>
Nov 09 03:38:23 user nova-compute[75378]:         <nova:project uuid="87cddc7aab3e44cf82391eebc6a167b1">tempest-ServerRescueNegativeTestJSON-1449314788</nova:project>
Nov 09 03:38:23 user nova-compute[75378]:       </nova:owner>
Nov 09 03:38:23 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:38:23 user nova-compute[75378]:       <nova:ports>
Nov 09 03:38:23 user nova-compute[75378]:         <nova:port uuid="4c53e537-1637-4f65-b393-a10e68383acb">
Nov 09 03:38:23 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 03:38:23 user nova-compute[75378]:         </nova:port>
Nov 09 03:38:23 user nova-compute[75378]:       </nova:ports>
Nov 09 03:38:23 user nova-compute[75378]:     </nova:instance>
Nov 09 03:38:23 user nova-compute[75378]:   </metadata>
Nov 09 03:38:23 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:38:23 user nova-compute[75378]:     <system>
Nov 09 03:38:23 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:38:23 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:38:23 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:38:23 user nova-compute[75378]:       <entry name="serial">6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76</entry>
Nov 09 03:38:23 user nova-compute[75378]:       <entry name="uuid">6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76</entry>
Nov 09 03:38:23 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:38:23 user nova-compute[75378]:     </system>
Nov 09 03:38:23 user nova-compute[75378]:   </sysinfo>
Nov 09 03:38:23 user nova-compute[75378]:   <os>
Nov 09 03:38:23 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:38:23 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:38:23 user nova-compute[75378]:   </os>
Nov 09 03:38:23 user nova-compute[75378]:   <features>
Nov 09 03:38:23 user nova-compute[75378]:     <acpi/>
Nov 09 03:38:23 user nova-compute[75378]:     <apic/>
Nov 09 03:38:23 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:38:23 user nova-compute[75378]:   </features>
Nov 09 03:38:23 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:38:23 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:38:23 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:38:23 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:38:23 user nova-compute[75378]:   </clock>
Nov 09 03:38:23 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:38:23 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:38:23 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:38:23 user nova-compute[75378]:   </cpu>
Nov 09 03:38:23 user nova-compute[75378]:   <devices>
Nov 09 03:38:23 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:38:23 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:38:23 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue"/>
Nov 09 03:38:23 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:38:23 user nova-compute[75378]:     </disk>
Nov 09 03:38:23 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:38:23 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:38:23 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk"/>
Nov 09 03:38:23 user nova-compute[75378]:       <target dev="vdb" bus="virtio"/>
Nov 09 03:38:23 user nova-compute[75378]:     </disk>
Nov 09 03:38:23 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:38:23 user nova-compute[75378]:       <mac address="fa:16:3e:d8:76:bf"/>
Nov 09 03:38:23 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:38:23 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:38:23 user nova-compute[75378]:       <target dev="tap4c53e537-16"/>
Nov 09 03:38:23 user nova-compute[75378]:     </interface>
Nov 09 03:38:23 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:38:23 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/console.log" append="off"/>
Nov 09 03:38:23 user nova-compute[75378]:     </serial>
Nov 09 03:38:23 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:38:23 user nova-compute[75378]:     <video>
Nov 09 03:38:23 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:38:23 user nova-compute[75378]:     </video>
Nov 09 03:38:23 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:38:23 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:38:23 user nova-compute[75378]:     </rng>
Nov 09 03:38:23 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:38:23 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:38:23 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:38:23 user nova-compute[75378]:     </memballoon>
Nov 09 03:38:23 user nova-compute[75378]:   </devices>
Nov 09 03:38:23 user nova-compute[75378]: </domain>
Nov 09 03:38:23 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:38:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:23 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Instance destroyed successfully.
Nov 09 03:38:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:38:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:38:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] No VIF found with MAC fa:16:3e:d8:76:bf, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:38:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b/disk --force-share --output=json" returned: 0 in 0.376s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:24 user nova-compute[75378]: DEBUG nova.compute.manager [req-29346251-34a5-4e82-b3fc-b7ccc25eaa90 req-495248fe-02b1-4cb7-8226-3b928ef2d22c service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Received event network-vif-plugged-4c53e537-1637-4f65-b393-a10e68383acb {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-29346251-34a5-4e82-b3fc-b7ccc25eaa90 req-495248fe-02b1-4cb7-8226-3b928ef2d22c service nova] Acquiring lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-29346251-34a5-4e82-b3fc-b7ccc25eaa90 req-495248fe-02b1-4cb7-8226-3b928ef2d22c service nova] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-29346251-34a5-4e82-b3fc-b7ccc25eaa90 req-495248fe-02b1-4cb7-8226-3b928ef2d22c service nova] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:38:24 user nova-compute[75378]: DEBUG nova.compute.manager [req-29346251-34a5-4e82-b3fc-b7ccc25eaa90 req-495248fe-02b1-4cb7-8226-3b928ef2d22c service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] No waiting events found dispatching network-vif-plugged-4c53e537-1637-4f65-b393-a10e68383acb {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:38:24 user nova-compute[75378]: WARNING nova.compute.manager [req-29346251-34a5-4e82-b3fc-b7ccc25eaa90 req-495248fe-02b1-4cb7-8226-3b928ef2d22c service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Received unexpected event network-vif-plugged-4c53e537-1637-4f65-b393-a10e68383acb for instance with vm_state active and task_state rescuing.
Nov 09 03:38:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:26 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:38:26 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:38:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7027MB free_disk=25.579090118408203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG nova.compute.manager [req-eed4375b-33ab-45ec-b579-2b7b6fca5bb2 req-e8feb272-7cb1-460a-8b05-d4f2d3555181 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Received event network-vif-plugged-4c53e537-1637-4f65-b393-a10e68383acb {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-eed4375b-33ab-45ec-b579-2b7b6fca5bb2 req-e8feb272-7cb1-460a-8b05-d4f2d3555181 service nova] Acquiring lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-eed4375b-33ab-45ec-b579-2b7b6fca5bb2 req-e8feb272-7cb1-460a-8b05-d4f2d3555181 service nova] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-eed4375b-33ab-45ec-b579-2b7b6fca5bb2 req-e8feb272-7cb1-460a-8b05-d4f2d3555181 service nova] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG nova.compute.manager [req-eed4375b-33ab-45ec-b579-2b7b6fca5bb2 req-e8feb272-7cb1-460a-8b05-d4f2d3555181 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] No waiting events found dispatching network-vif-plugged-4c53e537-1637-4f65-b393-a10e68383acb {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:38:26 user nova-compute[75378]: WARNING nova.compute.manager [req-eed4375b-33ab-45ec-b579-2b7b6fca5bb2 req-e8feb272-7cb1-460a-8b05-d4f2d3555181 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Received unexpected event network-vif-plugged-4c53e537-1637-4f65-b393-a10e68383acb for instance with vm_state active and task_state rescuing.
Nov 09 03:38:26 user nova-compute[75378]: DEBUG nova.compute.manager [req-eed4375b-33ab-45ec-b579-2b7b6fca5bb2 req-e8feb272-7cb1-460a-8b05-d4f2d3555181 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Received event network-vif-plugged-4c53e537-1637-4f65-b393-a10e68383acb {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-eed4375b-33ab-45ec-b579-2b7b6fca5bb2 req-e8feb272-7cb1-460a-8b05-d4f2d3555181 service nova] Acquiring lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-eed4375b-33ab-45ec-b579-2b7b6fca5bb2 req-e8feb272-7cb1-460a-8b05-d4f2d3555181 service nova] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-eed4375b-33ab-45ec-b579-2b7b6fca5bb2 req-e8feb272-7cb1-460a-8b05-d4f2d3555181 service nova] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG nova.compute.manager [req-eed4375b-33ab-45ec-b579-2b7b6fca5bb2 req-e8feb272-7cb1-460a-8b05-d4f2d3555181 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] No waiting events found dispatching network-vif-plugged-4c53e537-1637-4f65-b393-a10e68383acb {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:38:26 user nova-compute[75378]: WARNING nova.compute.manager [req-eed4375b-33ab-45ec-b579-2b7b6fca5bb2 req-e8feb272-7cb1-460a-8b05-d4f2d3555181 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Received unexpected event network-vif-plugged-4c53e537-1637-4f65-b393-a10e68383acb for instance with vm_state active and task_state rescuing.
Nov 09 03:38:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 70a7686e-042c-4be8-8182-69c62027c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 176d35dc-6397-4204-b0d3-0d27e3f967c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 0aa21edc-dc12-46ad-925d-47bc5b576172 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 1fb5f90d-3d22-474d-947d-f939fa150f3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance fadeb1f5-4118-4a08-986a-ff08778b229d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance fc692659-f62e-4d29-909d-0509cf3952b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2f475dba-59f5-414a-8156-8b438601ecfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 8adad7f0-fa15-415b-b384-bfdae665a59b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9691c96a-287e-40f0-a7e2-70bd56d9d2d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance b44da21c-9c44-48d2-865c-85ea2f103a89 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:38:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:38:27 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:38:27 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:38:27 user nova-compute[75378]: DEBUG nova.compute.manager [None req-387c5b5e-c338-489d-8f6d-d6b880af7d85 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:38:27 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:38:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.864s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:38:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.738s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:27 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:38:27 user nova-compute[75378]: INFO nova.compute.claims [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Claim successful on node user
Nov 09 03:38:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-2661d7ce-eb8c-4293-8884-9015714753f0 req-22dfb0da-477d-4588-9145-630bebdb009b service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received event network-changed-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-2661d7ce-eb8c-4293-8884-9015714753f0 req-22dfb0da-477d-4588-9145-630bebdb009b service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Refreshing instance network info cache due to event network-changed-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:38:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2661d7ce-eb8c-4293-8884-9015714753f0 req-22dfb0da-477d-4588-9145-630bebdb009b service nova] Acquiring lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:38:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2661d7ce-eb8c-4293-8884-9015714753f0 req-22dfb0da-477d-4588-9145-630bebdb009b service nova] Acquired lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:38:27 user nova-compute[75378]: DEBUG nova.network.neutron [req-2661d7ce-eb8c-4293-8884-9015714753f0 req-22dfb0da-477d-4588-9145-630bebdb009b service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Refreshing network info cache for port d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:38:27 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:38:27 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:38:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:38:27 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:38:27 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:38:27 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:38:27 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:38:27 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:38:28 user nova-compute[75378]: INFO nova.virt.block_device [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Booting with volume 5a07c2dc-15f0-463e-9fae-97d5ee7626bc at /dev/vda
Nov 09 03:38:28 user nova-compute[75378]: DEBUG nova.policy [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '66fbe37ed9304cecaca00527cff2fcac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bff904ec1645bcaa1c5b699b104047', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:38:28 user nova-compute[75378]: DEBUG nova.network.neutron [req-2661d7ce-eb8c-4293-8884-9015714753f0 req-22dfb0da-477d-4588-9145-630bebdb009b service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Updated VIF entry in instance network info cache for port d0fa9225-bc1d-4d57-b259-5a6d1e3638f8. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:38:28 user nova-compute[75378]: DEBUG nova.network.neutron [req-2661d7ce-eb8c-4293-8884-9015714753f0 req-22dfb0da-477d-4588-9145-630bebdb009b service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Updating instance_info_cache with network_info: [{"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:38:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2661d7ce-eb8c-4293-8884-9015714753f0 req-22dfb0da-477d-4588-9145-630bebdb009b service nova] Releasing lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:38:28 user nova-compute[75378]: DEBUG os_brick.utils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:38:28 user nova-compute[75378]: INFO oslo.privsep.daemon [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp17sxzbuh/privsep.sock']
Nov 09 03:38:28 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:38:28 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:38:28 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:38:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:28 user sudo[87046]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp17sxzbuh/privsep.sock
Nov 09 03:38:28 user sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 09 03:38:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:38:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:38:28 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 03:38:28 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Updating instance_info_cache with network_info: [{"id": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "address": "fa:16:3e:a6:f3:49", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d42515-fd", "ovs_interfaceid": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:38:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:38:28 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 03:38:28 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:38:28 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:38:28 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:38:28 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:38:28 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Successfully created port: 81e8875f-2f35-4bc9-ba66-a6140aedeafc {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:38:29 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Successfully created port: 6a068d92-ddf4-406a-be66-1d4c2bd2b11d {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:38:29 user sudo[87046]: pam_unix(sudo:session): session closed for user root
Nov 09 03:38:29 user nova-compute[75378]: INFO oslo.privsep.daemon [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Spawned new privsep daemon via rootwrap
Nov 09 03:38:29 user nova-compute[75378]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 09 03:38:29 user nova-compute[75378]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 09 03:38:29 user nova-compute[75378]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 09 03:38:29 user nova-compute[75378]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87049
Nov 09 03:38:29 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Successfully created port: 8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cffb78-df49-4a9c-a214-9dcdf8de10e3]: (2,) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[876552ae-6432-4f72-90e7-0a5f7fed4275]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:38:30 user nova-compute[75378]: WARNING os_brick.initiator.connectors.nvmeof [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 09 03:38:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[69653dc9-d09e-4966-9cbe-ee02a13470f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[922703f8-d577-4099-af8a-de99b5434250]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4a026a-ec80-431e-9881-7f6c421b7f52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:38:30 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:38:30 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c07727-c939-4e81-be22-8e0f0d48526d]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG os_brick.utils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] <== get_connector_properties: return (2185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Updating existing volume attachment record: 8d4cb516-10f2-475b-8a5d-3fbede82af48 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:30 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Successfully created port: 68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:38:31 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Successfully created port: 27b8914c-2639-4117-86c1-62615361ab73 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:38:32 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Successfully updated port: 81e8875f-2f35-4bc9-ba66-a6140aedeafc {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:38:32 user nova-compute[75378]: DEBUG nova.compute.manager [req-d172d255-5cc4-43ed-9489-881059d1bda2 req-b3a2e1fb-d622-4c52-9882-fdf1adbc8fcc service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-changed-81e8875f-2f35-4bc9-ba66-a6140aedeafc {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:32 user nova-compute[75378]: DEBUG nova.compute.manager [req-d172d255-5cc4-43ed-9489-881059d1bda2 req-b3a2e1fb-d622-4c52-9882-fdf1adbc8fcc service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Refreshing instance network info cache due to event network-changed-81e8875f-2f35-4bc9-ba66-a6140aedeafc. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:38:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d172d255-5cc4-43ed-9489-881059d1bda2 req-b3a2e1fb-d622-4c52-9882-fdf1adbc8fcc service nova] Acquiring lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:38:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d172d255-5cc4-43ed-9489-881059d1bda2 req-b3a2e1fb-d622-4c52-9882-fdf1adbc8fcc service nova] Acquired lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:38:32 user nova-compute[75378]: DEBUG nova.network.neutron [req-d172d255-5cc4-43ed-9489-881059d1bda2 req-b3a2e1fb-d622-4c52-9882-fdf1adbc8fcc service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Refreshing network info cache for port 81e8875f-2f35-4bc9-ba66-a6140aedeafc {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:38:32 user nova-compute[75378]: DEBUG nova.network.neutron [req-d172d255-5cc4-43ed-9489-881059d1bda2 req-b3a2e1fb-d622-4c52-9882-fdf1adbc8fcc service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:38:32 user nova-compute[75378]: DEBUG nova.network.neutron [req-d172d255-5cc4-43ed-9489-881059d1bda2 req-b3a2e1fb-d622-4c52-9882-fdf1adbc8fcc service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:38:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d172d255-5cc4-43ed-9489-881059d1bda2 req-b3a2e1fb-d622-4c52-9882-fdf1adbc8fcc service nova] Releasing lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:38:32 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Successfully updated port: b362041e-0313-42e1-be36-6ad021228d16 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:38:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:33 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Successfully updated port: 14de84ce-7772-461d-9b7a-168604176bd3 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Successfully updated port: 6a068d92-ddf4-406a-be66-1d4c2bd2b11d {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG nova.compute.manager [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-changed-b362041e-0313-42e1-be36-6ad021228d16 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG nova.compute.manager [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Refreshing instance network info cache due to event network-changed-b362041e-0313-42e1-be36-6ad021228d16. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] Acquiring lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] Acquired lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG nova.network.neutron [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Refreshing network info cache for port b362041e-0313-42e1-be36-6ad021228d16 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG nova.network.neutron [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG nova.network.neutron [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] Releasing lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG nova.compute.manager [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-changed-14de84ce-7772-461d-9b7a-168604176bd3 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG nova.compute.manager [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Refreshing instance network info cache due to event network-changed-14de84ce-7772-461d-9b7a-168604176bd3. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] Acquiring lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] Acquired lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG nova.network.neutron [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Refreshing network info cache for port 14de84ce-7772-461d-9b7a-168604176bd3 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG nova.network.neutron [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Successfully updated port: 8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG nova.network.neutron [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] Releasing lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG nova.compute.manager [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-changed-6a068d92-ddf4-406a-be66-1d4c2bd2b11d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG nova.compute.manager [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Refreshing instance network info cache due to event network-changed-6a068d92-ddf4-406a-be66-1d4c2bd2b11d. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] Acquiring lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] Acquired lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG nova.network.neutron [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Refreshing network info cache for port 6a068d92-ddf4-406a-be66-1d4c2bd2b11d {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:38:34 user nova-compute[75378]: DEBUG nova.network.neutron [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:38:35 user nova-compute[75378]: DEBUG nova.network.neutron [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:38:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cba29150-0152-47b0-bfc0-e56d3016c86c req-04881b8e-58e9-4c9c-994e-fedd7254cefc service nova] Releasing lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:38:35 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Successfully updated port: 68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:38:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:36 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Successfully updated port: 27b8914c-2639-4117-86c1-62615361ab73 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:38:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Acquiring lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:38:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Acquired lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:38:36 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:38:36 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:38:36 user nova-compute[75378]: DEBUG nova.compute.manager [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-changed-8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:36 user nova-compute[75378]: DEBUG nova.compute.manager [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Refreshing instance network info cache due to event network-changed-8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:38:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] Acquiring lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:38:38 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Updating instance_info_cache with network_info: [{"id": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "address": "fa:16:3e:c8:1b:52", "network": {"id": "62aa759a-558d-42aa-8910-9709e02e9e1a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1100617011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e8875f-2f", "ovs_interfaceid": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b362041e-0313-42e1-be36-6ad021228d16", "address": "fa:16:3e:2e:52:a1", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362041e-03", "ovs_interfaceid": "b362041e-0313-42e1-be36-6ad021228d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14de84ce-7772-461d-9b7a-168604176bd3", "address": "fa:16:3e:e4:3c:b4", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14de84ce-77", "ovs_interfaceid": "14de84ce-7772-461d-9b7a-168604176bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "address": "fa:16:3e:bc:00:45", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a068d92-dd", "ovs_interfaceid": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "address": "fa:16:3e:88:5d:5c", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf9fd7-4e", "ovs_interfaceid": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "address": "fa:16:3e:c5:79:79", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d6cece-2c", "ovs_interfaceid": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27b8914c-2639-4117-86c1-62615361ab73", "address": "fa:16:3e:10:53:c2", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8914c-26", "ovs_interfaceid": "27b8914c-2639-4117-86c1-62615361ab73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:38:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Releasing lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:38:38 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Instance network_info: |[{"id": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "address": "fa:16:3e:c8:1b:52", "network": {"id": "62aa759a-558d-42aa-8910-9709e02e9e1a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1100617011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e8875f-2f", "ovs_interfaceid": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b362041e-0313-42e1-be36-6ad021228d16", "address": "fa:16:3e:2e:52:a1", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362041e-03", "ovs_interfaceid": "b362041e-0313-42e1-be36-6ad021228d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14de84ce-7772-461d-9b7a-168604176bd3", "address": "fa:16:3e:e4:3c:b4", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14de84ce-77", "ovs_interfaceid": "14de84ce-7772-461d-9b7a-168604176bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "address": "fa:16:3e:bc:00:45", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a068d92-dd", "ovs_interfaceid": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "address": "fa:16:3e:88:5d:5c", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf9fd7-4e", "ovs_interfaceid": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "address": "fa:16:3e:c5:79:79", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d6cece-2c", "ovs_interfaceid": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27b8914c-2639-4117-86c1-62615361ab73", "address": "fa:16:3e:10:53:c2", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8914c-26", "ovs_interfaceid": "27b8914c-2639-4117-86c1-62615361ab73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:38:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] Acquired lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:38:38 user nova-compute[75378]: DEBUG nova.network.neutron [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Refreshing network info cache for port 8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:38:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:38 user nova-compute[75378]: DEBUG nova.network.neutron [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Updated VIF entry in instance network info cache for port 8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:38:38 user nova-compute[75378]: DEBUG nova.network.neutron [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Updating instance_info_cache with network_info: [{"id": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "address": "fa:16:3e:c8:1b:52", "network": {"id": "62aa759a-558d-42aa-8910-9709e02e9e1a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1100617011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e8875f-2f", "ovs_interfaceid": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b362041e-0313-42e1-be36-6ad021228d16", "address": "fa:16:3e:2e:52:a1", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362041e-03", "ovs_interfaceid": "b362041e-0313-42e1-be36-6ad021228d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14de84ce-7772-461d-9b7a-168604176bd3", "address": "fa:16:3e:e4:3c:b4", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14de84ce-77", "ovs_interfaceid": "14de84ce-7772-461d-9b7a-168604176bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "address": "fa:16:3e:bc:00:45", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a068d92-dd", "ovs_interfaceid": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "address": "fa:16:3e:88:5d:5c", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf9fd7-4e", "ovs_interfaceid": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "address": "fa:16:3e:c5:79:79", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d6cece-2c", "ovs_interfaceid": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27b8914c-2639-4117-86c1-62615361ab73", "address": "fa:16:3e:10:53:c2", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8914c-26", "ovs_interfaceid": "27b8914c-2639-4117-86c1-62615361ab73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:38:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] Releasing lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:38:38 user nova-compute[75378]: DEBUG nova.compute.manager [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-changed-68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:38 user nova-compute[75378]: DEBUG nova.compute.manager [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Refreshing instance network info cache due to event network-changed-68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:38:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] Acquiring lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:38:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] Acquired lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:38:38 user nova-compute[75378]: DEBUG nova.network.neutron [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Refreshing network info cache for port 68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:38:39 user nova-compute[75378]: DEBUG nova.network.neutron [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Updated VIF entry in instance network info cache for port 68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:38:39 user nova-compute[75378]: DEBUG nova.network.neutron [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Updating instance_info_cache with network_info: [{"id": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "address": "fa:16:3e:c8:1b:52", "network": {"id": "62aa759a-558d-42aa-8910-9709e02e9e1a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1100617011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e8875f-2f", "ovs_interfaceid": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b362041e-0313-42e1-be36-6ad021228d16", "address": "fa:16:3e:2e:52:a1", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362041e-03", "ovs_interfaceid": "b362041e-0313-42e1-be36-6ad021228d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14de84ce-7772-461d-9b7a-168604176bd3", "address": "fa:16:3e:e4:3c:b4", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14de84ce-77", "ovs_interfaceid": "14de84ce-7772-461d-9b7a-168604176bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "address": "fa:16:3e:bc:00:45", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a068d92-dd", "ovs_interfaceid": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "address": "fa:16:3e:88:5d:5c", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf9fd7-4e", "ovs_interfaceid": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "address": "fa:16:3e:c5:79:79", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d6cece-2c", "ovs_interfaceid": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27b8914c-2639-4117-86c1-62615361ab73", "address": "fa:16:3e:10:53:c2", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8914c-26", "ovs_interfaceid": "27b8914c-2639-4117-86c1-62615361ab73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:38:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] Releasing lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:38:39 user nova-compute[75378]: DEBUG nova.compute.manager [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-changed-27b8914c-2639-4117-86c1-62615361ab73 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:39 user nova-compute[75378]: DEBUG nova.compute.manager [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Refreshing instance network info cache due to event network-changed-27b8914c-2639-4117-86c1-62615361ab73. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:38:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] Acquiring lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:38:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] Acquired lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:38:39 user nova-compute[75378]: DEBUG nova.network.neutron [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Refreshing network info cache for port 27b8914c-2639-4117-86c1-62615361ab73 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:38:40 user nova-compute[75378]: DEBUG nova.compute.manager [req-8b09c2ce-2f9e-48f2-859a-01e0aad0f5e6 req-ac3e38f5-c6b4-4c7c-a0df-0b1d607fbb64 service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Received event network-changed-cf0655e0-c321-449f-840d-89a729a9b6ad {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:40 user nova-compute[75378]: DEBUG nova.compute.manager [req-8b09c2ce-2f9e-48f2-859a-01e0aad0f5e6 req-ac3e38f5-c6b4-4c7c-a0df-0b1d607fbb64 service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Refreshing instance network info cache due to event network-changed-cf0655e0-c321-449f-840d-89a729a9b6ad. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:38:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8b09c2ce-2f9e-48f2-859a-01e0aad0f5e6 req-ac3e38f5-c6b4-4c7c-a0df-0b1d607fbb64 service nova] Acquiring lock "refresh_cache-70a7686e-042c-4be8-8182-69c62027c744" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:38:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8b09c2ce-2f9e-48f2-859a-01e0aad0f5e6 req-ac3e38f5-c6b4-4c7c-a0df-0b1d607fbb64 service nova] Acquired lock "refresh_cache-70a7686e-042c-4be8-8182-69c62027c744" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:38:40 user nova-compute[75378]: DEBUG nova.network.neutron [req-8b09c2ce-2f9e-48f2-859a-01e0aad0f5e6 req-ac3e38f5-c6b4-4c7c-a0df-0b1d607fbb64 service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Refreshing network info cache for port cf0655e0-c321-449f-840d-89a729a9b6ad {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:38:40 user nova-compute[75378]: DEBUG nova.network.neutron [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Updated VIF entry in instance network info cache for port 27b8914c-2639-4117-86c1-62615361ab73. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:38:40 user nova-compute[75378]: DEBUG nova.network.neutron [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Updating instance_info_cache with network_info: [{"id": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "address": "fa:16:3e:c8:1b:52", "network": {"id": "62aa759a-558d-42aa-8910-9709e02e9e1a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1100617011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e8875f-2f", "ovs_interfaceid": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b362041e-0313-42e1-be36-6ad021228d16", "address": "fa:16:3e:2e:52:a1", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362041e-03", "ovs_interfaceid": "b362041e-0313-42e1-be36-6ad021228d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14de84ce-7772-461d-9b7a-168604176bd3", "address": "fa:16:3e:e4:3c:b4", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14de84ce-77", "ovs_interfaceid": "14de84ce-7772-461d-9b7a-168604176bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "address": "fa:16:3e:bc:00:45", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a068d92-dd", "ovs_interfaceid": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "address": "fa:16:3e:88:5d:5c", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf9fd7-4e", "ovs_interfaceid": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "address": "fa:16:3e:c5:79:79", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d6cece-2c", "ovs_interfaceid": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27b8914c-2639-4117-86c1-62615361ab73", "address": "fa:16:3e:10:53:c2", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8914c-26", "ovs_interfaceid": "27b8914c-2639-4117-86c1-62615361ab73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:38:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-87fa80c3-ca5b-4d0e-82c5-25422214db47 req-9502c128-d5eb-4dc3-a073-64bd95b815a4 service nova] Releasing lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:38:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:40 user nova-compute[75378]: DEBUG nova.network.neutron [req-8b09c2ce-2f9e-48f2-859a-01e0aad0f5e6 req-ac3e38f5-c6b4-4c7c-a0df-0b1d607fbb64 service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Updated VIF entry in instance network info cache for port cf0655e0-c321-449f-840d-89a729a9b6ad. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:38:40 user nova-compute[75378]: DEBUG nova.network.neutron [req-8b09c2ce-2f9e-48f2-859a-01e0aad0f5e6 req-ac3e38f5-c6b4-4c7c-a0df-0b1d607fbb64 service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Updating instance_info_cache with network_info: [{"id": "cf0655e0-c321-449f-840d-89a729a9b6ad", "address": "fa:16:3e:83:d7:60", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0655e0-c3", "ovs_interfaceid": "cf0655e0-c321-449f-840d-89a729a9b6ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:38:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8b09c2ce-2f9e-48f2-859a-01e0aad0f5e6 req-ac3e38f5-c6b4-4c7c-a0df-0b1d607fbb64 service nova] Releasing lock "refresh_cache-70a7686e-042c-4be8-8182-69c62027c744" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:38:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-52eaef45-7ad6-4d5d-b7bc-6025fca8e133 req-2cc47a9e-c941-425d-89ce-eb634a861e6a service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Received event network-changed-23694ef3-48c1-4a9b-9b38-3062aed570e5 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-52eaef45-7ad6-4d5d-b7bc-6025fca8e133 req-2cc47a9e-c941-425d-89ce-eb634a861e6a service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Refreshing instance network info cache due to event network-changed-23694ef3-48c1-4a9b-9b38-3062aed570e5. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:38:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-52eaef45-7ad6-4d5d-b7bc-6025fca8e133 req-2cc47a9e-c941-425d-89ce-eb634a861e6a service nova] Acquiring lock "refresh_cache-0aa21edc-dc12-46ad-925d-47bc5b576172" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:38:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-52eaef45-7ad6-4d5d-b7bc-6025fca8e133 req-2cc47a9e-c941-425d-89ce-eb634a861e6a service nova] Acquired lock "refresh_cache-0aa21edc-dc12-46ad-925d-47bc5b576172" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:38:43 user nova-compute[75378]: DEBUG nova.network.neutron [req-52eaef45-7ad6-4d5d-b7bc-6025fca8e133 req-2cc47a9e-c941-425d-89ce-eb634a861e6a service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Refreshing network info cache for port 23694ef3-48c1-4a9b-9b38-3062aed570e5 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:38:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:43 user nova-compute[75378]: DEBUG nova.network.neutron [req-52eaef45-7ad6-4d5d-b7bc-6025fca8e133 req-2cc47a9e-c941-425d-89ce-eb634a861e6a service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Updated VIF entry in instance network info cache for port 23694ef3-48c1-4a9b-9b38-3062aed570e5. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:38:43 user nova-compute[75378]: DEBUG nova.network.neutron [req-52eaef45-7ad6-4d5d-b7bc-6025fca8e133 req-2cc47a9e-c941-425d-89ce-eb634a861e6a service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Updating instance_info_cache with network_info: [{"id": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "address": "fa:16:3e:2e:7c:ad", "network": {"id": "dbae8930-1593-4089-9f9e-4d0ee5306608", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-203847065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23694ef3-48", "ovs_interfaceid": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:38:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-52eaef45-7ad6-4d5d-b7bc-6025fca8e133 req-2cc47a9e-c941-425d-89ce-eb634a861e6a service nova] Releasing lock "refresh_cache-0aa21edc-dc12-46ad-925d-47bc5b576172" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:38:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquiring lock "interface-0aa21edc-dc12-46ad-925d-47bc5b576172-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "interface-0aa21edc-dc12-46ad-925d-47bc5b576172-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:43 user nova-compute[75378]: DEBUG nova.objects.instance [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lazy-loading 'flavor' on Instance uuid 0aa21edc-dc12-46ad-925d-47bc5b576172 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:38:43 user nova-compute[75378]: DEBUG nova.objects.instance [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lazy-loading 'pci_requests' on Instance uuid 0aa21edc-dc12-46ad-925d-47bc5b576172 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:38:43 user nova-compute[75378]: DEBUG nova.objects.base [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Object Instance<0aa21edc-dc12-46ad-925d-47bc5b576172> lazy-loaded attributes: flavor,pci_requests {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:38:43 user nova-compute[75378]: DEBUG nova.network.neutron [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:38:44 user nova-compute[75378]: DEBUG nova.policy [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b1261613bc54e7f96c70ed27d8a829e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d1e0442fe540cda81d2a5467664870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:38:44 user nova-compute[75378]: DEBUG nova.network.neutron [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Successfully created port: 46397870-ba5d-4bf9-84e7-bb1febeae42e {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:38:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:45 user nova-compute[75378]: DEBUG nova.network.neutron [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Successfully updated port: 46397870-ba5d-4bf9-84e7-bb1febeae42e {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:38:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquiring lock "refresh_cache-0aa21edc-dc12-46ad-925d-47bc5b576172" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:38:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquired lock "refresh_cache-0aa21edc-dc12-46ad-925d-47bc5b576172" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:38:45 user nova-compute[75378]: DEBUG nova.network.neutron [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:38:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-2155f3f6-5f46-4dc2-b247-27ced597fa27 req-21e47447-df43-4191-8d3c-30042675d679 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Received event network-changed-46397870-ba5d-4bf9-84e7-bb1febeae42e {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-2155f3f6-5f46-4dc2-b247-27ced597fa27 req-21e47447-df43-4191-8d3c-30042675d679 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Refreshing instance network info cache due to event network-changed-46397870-ba5d-4bf9-84e7-bb1febeae42e. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:38:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2155f3f6-5f46-4dc2-b247-27ced597fa27 req-21e47447-df43-4191-8d3c-30042675d679 service nova] Acquiring lock "refresh_cache-0aa21edc-dc12-46ad-925d-47bc5b576172" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG nova.network.neutron [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Updating instance_info_cache with network_info: [{"id": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "address": "fa:16:3e:2e:7c:ad", "network": {"id": "dbae8930-1593-4089-9f9e-4d0ee5306608", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-203847065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23694ef3-48", "ovs_interfaceid": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "address": "fa:16:3e:c9:c5:b4", "network": {"id": "336622a2-627e-4a05-b204-7ab1ef8595ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1520328787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46397870-ba", "ovs_interfaceid": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Releasing lock "refresh_cache-0aa21edc-dc12-46ad-925d-47bc5b576172" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2155f3f6-5f46-4dc2-b247-27ced597fa27 req-21e47447-df43-4191-8d3c-30042675d679 service nova] Acquired lock "refresh_cache-0aa21edc-dc12-46ad-925d-47bc5b576172" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG nova.network.neutron [req-2155f3f6-5f46-4dc2-b247-27ced597fa27 req-21e47447-df43-4191-8d3c-30042675d679 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Refreshing network info cache for port 46397870-ba5d-4bf9-84e7-bb1febeae42e {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-600308768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-600308768',id=6,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7Zi3/OBwBWFZyzirh8mZQ4BgVFx7fj6XXgOw9/PxXUG8dZzej6jh1WqLhuSvXrU5svCvjW/PsldUVgziNo99MiMWj1iBWLdTs8DNBiQq2fEkWCg0hw0gQlP+3PQUsmdg==',key_name='tempest-keypair-1523638191',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:37:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='64d1e0442fe540cda81d2a5467664870',ramdisk_id='',reservation_id='r-776ypqd0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1282324561',owner_user_name='tempest-TaggedAttachmentsTest-1282324561-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1261613bc54e7f96c70ed27d8a829e',uuid=0aa21edc-dc12-46ad-925d-47bc5b576172,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "address": "fa:16:3e:c9:c5:b4", "network": {"id": "336622a2-627e-4a05-b204-7ab1ef8595ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1520328787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46397870-ba", "ovs_interfaceid": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Converting VIF {"id": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "address": "fa:16:3e:c9:c5:b4", "network": {"id": "336622a2-627e-4a05-b204-7ab1ef8595ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1520328787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46397870-ba", "ovs_interfaceid": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:c5:b4,bridge_name='br-int',has_traffic_filtering=True,id=46397870-ba5d-4bf9-84e7-bb1febeae42e,network=Network(336622a2-627e-4a05-b204-7ab1ef8595ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46397870-ba') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG os_vif [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:c5:b4,bridge_name='br-int',has_traffic_filtering=True,id=46397870-ba5d-4bf9-84e7-bb1febeae42e,network=Network(336622a2-627e-4a05-b204-7ab1ef8595ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46397870-ba') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d160738-5ad4-503a-ab8d-a7a9b322da36', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46397870-ba, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap46397870-ba, col_values=(('qos', UUID('799664a2-35f7-42f3-bb1d-128e565cf793')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap46397870-ba, col_values=(('external_ids', {'iface-id': '46397870-ba5d-4bf9-84e7-bb1febeae42e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:c5:b4', 'vm-uuid': '0aa21edc-dc12-46ad-925d-47bc5b576172'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:46 user nova-compute[75378]: INFO os_vif [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:c5:b4,bridge_name='br-int',has_traffic_filtering=True,id=46397870-ba5d-4bf9-84e7-bb1febeae42e,network=Network(336622a2-627e-4a05-b204-7ab1ef8595ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46397870-ba')
Nov 09 03:38:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-600308768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-600308768',id=6,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7Zi3/OBwBWFZyzirh8mZQ4BgVFx7fj6XXgOw9/PxXUG8dZzej6jh1WqLhuSvXrU5svCvjW/PsldUVgziNo99MiMWj1iBWLdTs8DNBiQq2fEkWCg0hw0gQlP+3PQUsmdg==',key_name='tempest-keypair-1523638191',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:37:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='64d1e0442fe540cda81d2a5467664870',ramdisk_id='',reservation_id='r-776ypqd0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1282324561',owner_user_name='tempest-TaggedAttachmentsTest-1282324561-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1261613bc54e7f96c70ed27d8a829e',uuid=0aa21edc-dc12-46ad-925d-47bc5b576172,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "address": "fa:16:3e:c9:c5:b4", "network": {"id": "336622a2-627e-4a05-b204-7ab1ef8595ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1520328787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46397870-ba", "ovs_interfaceid": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Converting VIF {"id": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "address": "fa:16:3e:c9:c5:b4", "network": {"id": "336622a2-627e-4a05-b204-7ab1ef8595ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1520328787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46397870-ba", "ovs_interfaceid": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:c5:b4,bridge_name='br-int',has_traffic_filtering=True,id=46397870-ba5d-4bf9-84e7-bb1febeae42e,network=Network(336622a2-627e-4a05-b204-7ab1ef8595ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46397870-ba') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] attach device xml: <interface type="ethernet">
Nov 09 03:38:46 user nova-compute[75378]:   <mac address="fa:16:3e:c9:c5:b4"/>
Nov 09 03:38:46 user nova-compute[75378]:   <model type="virtio"/>
Nov 09 03:38:46 user nova-compute[75378]:   <mtu size="1442"/>
Nov 09 03:38:46 user nova-compute[75378]:   <target dev="tap46397870-ba"/>
Nov 09 03:38:46 user nova-compute[75378]: </interface>
Nov 09 03:38:46 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-6f6bfee7-4a0a-4af3-8563-92ed452c2bcd req-373b3374-25cf-4d72-b69b-321049f2d6a6 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Received event network-vif-plugged-46397870-ba5d-4bf9-84e7-bb1febeae42e {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6f6bfee7-4a0a-4af3-8563-92ed452c2bcd req-373b3374-25cf-4d72-b69b-321049f2d6a6 service nova] Acquiring lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6f6bfee7-4a0a-4af3-8563-92ed452c2bcd req-373b3374-25cf-4d72-b69b-321049f2d6a6 service nova] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6f6bfee7-4a0a-4af3-8563-92ed452c2bcd req-373b3374-25cf-4d72-b69b-321049f2d6a6 service nova] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:38:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-6f6bfee7-4a0a-4af3-8563-92ed452c2bcd req-373b3374-25cf-4d72-b69b-321049f2d6a6 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] No waiting events found dispatching network-vif-plugged-46397870-ba5d-4bf9-84e7-bb1febeae42e {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:38:46 user nova-compute[75378]: WARNING nova.compute.manager [req-6f6bfee7-4a0a-4af3-8563-92ed452c2bcd req-373b3374-25cf-4d72-b69b-321049f2d6a6 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Received unexpected event network-vif-plugged-46397870-ba5d-4bf9-84e7-bb1febeae42e for instance with vm_state active and task_state None.
Nov 09 03:38:47 user nova-compute[75378]: DEBUG nova.network.neutron [req-2155f3f6-5f46-4dc2-b247-27ced597fa27 req-21e47447-df43-4191-8d3c-30042675d679 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Updated VIF entry in instance network info cache for port 46397870-ba5d-4bf9-84e7-bb1febeae42e. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG nova.network.neutron [req-2155f3f6-5f46-4dc2-b247-27ced597fa27 req-21e47447-df43-4191-8d3c-30042675d679 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Updating instance_info_cache with network_info: [{"id": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "address": "fa:16:3e:2e:7c:ad", "network": {"id": "dbae8930-1593-4089-9f9e-4d0ee5306608", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-203847065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23694ef3-48", "ovs_interfaceid": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "address": "fa:16:3e:c9:c5:b4", "network": {"id": "336622a2-627e-4a05-b204-7ab1ef8595ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1520328787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46397870-ba", "ovs_interfaceid": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2155f3f6-5f46-4dc2-b247-27ced597fa27 req-21e47447-df43-4191-8d3c-30042675d679 service nova] Releasing lock "refresh_cache-0aa21edc-dc12-46ad-925d-47bc5b576172" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] No BDM found with device name hda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] No VIF found with MAC fa:16:3e:2e:7c:ad, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:38:47 user nova-compute[75378]:   <nova:package version="0.0.0"/>
Nov 09 03:38:47 user nova-compute[75378]:   <nova:name>tempest-device-tagging-server-600308768</nova:name>
Nov 09 03:38:47 user nova-compute[75378]:   <nova:creationTime>2023-11-09 03:38:47</nova:creationTime>
Nov 09 03:38:47 user nova-compute[75378]:   <nova:flavor name="m1.tiny">
Nov 09 03:38:47 user nova-compute[75378]:     <nova:memory>512</nova:memory>
Nov 09 03:38:47 user nova-compute[75378]:     <nova:disk>1</nova:disk>
Nov 09 03:38:47 user nova-compute[75378]:     <nova:swap>0</nova:swap>
Nov 09 03:38:47 user nova-compute[75378]:     <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:38:47 user nova-compute[75378]:     <nova:vcpus>1</nova:vcpus>
Nov 09 03:38:47 user nova-compute[75378]:   </nova:flavor>
Nov 09 03:38:47 user nova-compute[75378]:   <nova:owner>
Nov 09 03:38:47 user nova-compute[75378]:     <nova:user uuid="1b1261613bc54e7f96c70ed27d8a829e">tempest-TaggedAttachmentsTest-1282324561-project-member</nova:user>
Nov 09 03:38:47 user nova-compute[75378]:     <nova:project uuid="64d1e0442fe540cda81d2a5467664870">tempest-TaggedAttachmentsTest-1282324561</nova:project>
Nov 09 03:38:47 user nova-compute[75378]:   </nova:owner>
Nov 09 03:38:47 user nova-compute[75378]:   <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:38:47 user nova-compute[75378]:   <nova:ports>
Nov 09 03:38:47 user nova-compute[75378]:     <nova:port uuid="23694ef3-48c1-4a9b-9b38-3062aed570e5">
Nov 09 03:38:47 user nova-compute[75378]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 03:38:47 user nova-compute[75378]:     </nova:port>
Nov 09 03:38:47 user nova-compute[75378]:     <nova:port uuid="46397870-ba5d-4bf9-84e7-bb1febeae42e">
Nov 09 03:38:47 user nova-compute[75378]:       <nova:ip type="fixed" address="10.10.10.22" ipVersion="4"/>
Nov 09 03:38:47 user nova-compute[75378]:     </nova:port>
Nov 09 03:38:47 user nova-compute[75378]:   </nova:ports>
Nov 09 03:38:47 user nova-compute[75378]: </nova:instance>
Nov 09 03:38:47 user nova-compute[75378]:  {{(pid=75378) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "70a7686e-042c-4be8-8182-69c62027c744" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "70a7686e-042c-4be8-8182-69c62027c744" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lazy-loading 'flavor' on Instance uuid 70a7686e-042c-4be8-8182-69c62027c744 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a6a79787-ae0a-4a91-b755-9dc9d0c10f82 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "interface-0aa21edc-dc12-46ad-925d-47bc5b576172-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.596s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "70a7686e-042c-4be8-8182-69c62027c744" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "70a7686e-042c-4be8-8182-69c62027c744" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "70a7686e-042c-4be8-8182-69c62027c744" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:47 user nova-compute[75378]: INFO nova.compute.manager [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Attaching volume 57883fe6-d171-41f5-a6b3-9dda3515681f to /dev/vdb
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquiring lock "0aa21edc-dc12-46ad-925d-47bc5b576172" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG os_brick.utils [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG nova.objects.instance [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lazy-loading 'flavor' on Instance uuid 0aa21edc-dc12-46ad-925d-47bc5b576172 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1def760a-beb8-461d-9b88-ea2f8aee3c22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2622f0da-70a1-4560-af28-5441db8aae3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[909eb58a-2a3a-4fb3-ba14-3ab07fa09ee6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[295d9107-26bf-4ed2-b1dd-410020672d45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.132s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:38:47 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[73730624-8591-4c4e-a259-87f3b06059f2]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG os_brick.utils [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Updating existing volume attachment record: 82307c52-794f-48f7-9bf3-1fb32189c6b2 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquiring lock "0aa21edc-dc12-46ad-925d-47bc5b576172" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:47 user nova-compute[75378]: INFO nova.compute.manager [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Attaching volume e21167cc-2dae-4b81-8b66-2bc3e1ffda07 to /dev/vdb
Nov 09 03:38:48 user nova-compute[75378]: DEBUG os_brick.utils [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b2f536-7be7-4a28-8e24-01305f5aa3a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dbe800-882b-4a28-ab8a-9f8118f6edd9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9652fb89-92bf-420c-957e-1375b0762fa9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dff0a1-a3c8-4bb0-b6c5-cfe49881d2d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:38:48 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:38:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e488e144-61e7-4439-94a8-81817d1d714f]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG os_brick.utils [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Updating existing volume attachment record: 489f3d54-31b0-4d7a-b06b-cd77f1f8b67d {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG nova.compute.manager [req-1695874f-bdf4-43b9-a623-08a337bf67b2 req-d6f0d26a-ef5e-4aab-ba5a-84becebb5046 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Received event network-vif-plugged-46397870-ba5d-4bf9-84e7-bb1febeae42e {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1695874f-bdf4-43b9-a623-08a337bf67b2 req-d6f0d26a-ef5e-4aab-ba5a-84becebb5046 service nova] Acquiring lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1695874f-bdf4-43b9-a623-08a337bf67b2 req-d6f0d26a-ef5e-4aab-ba5a-84becebb5046 service nova] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1695874f-bdf4-43b9-a623-08a337bf67b2 req-d6f0d26a-ef5e-4aab-ba5a-84becebb5046 service nova] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:38:48 user nova-compute[75378]: DEBUG nova.compute.manager [req-1695874f-bdf4-43b9-a623-08a337bf67b2 req-d6f0d26a-ef5e-4aab-ba5a-84becebb5046 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] No waiting events found dispatching network-vif-plugged-46397870-ba5d-4bf9-84e7-bb1febeae42e {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:38:48 user nova-compute[75378]: WARNING nova.compute.manager [req-1695874f-bdf4-43b9-a623-08a337bf67b2 req-d6f0d26a-ef5e-4aab-ba5a-84becebb5046 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Received unexpected event network-vif-plugged-46397870-ba5d-4bf9-84e7-bb1febeae42e for instance with vm_state active and task_state None.
Nov 09 03:38:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:51 user nova-compute[75378]: DEBUG nova.compute.manager [req-bb1b28c0-8cdc-4793-bbbb-5ed9dd2b5c1a req-9855b2e8-6d0b-4225-8cdb-be9668cbba33 service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Received event network-changed-db537bed-b0bc-4295-af53-4fc336c45675 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:51 user nova-compute[75378]: DEBUG nova.compute.manager [req-bb1b28c0-8cdc-4793-bbbb-5ed9dd2b5c1a req-9855b2e8-6d0b-4225-8cdb-be9668cbba33 service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Refreshing instance network info cache due to event network-changed-db537bed-b0bc-4295-af53-4fc336c45675. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:38:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bb1b28c0-8cdc-4793-bbbb-5ed9dd2b5c1a req-9855b2e8-6d0b-4225-8cdb-be9668cbba33 service nova] Acquiring lock "refresh_cache-1fb5f90d-3d22-474d-947d-f939fa150f3f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:38:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bb1b28c0-8cdc-4793-bbbb-5ed9dd2b5c1a req-9855b2e8-6d0b-4225-8cdb-be9668cbba33 service nova] Acquired lock "refresh_cache-1fb5f90d-3d22-474d-947d-f939fa150f3f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:38:51 user nova-compute[75378]: DEBUG nova.network.neutron [req-bb1b28c0-8cdc-4793-bbbb-5ed9dd2b5c1a req-9855b2e8-6d0b-4225-8cdb-be9668cbba33 service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Refreshing network info cache for port db537bed-b0bc-4295-af53-4fc336c45675 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:38:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:51 user nova-compute[75378]: DEBUG nova.network.neutron [req-bb1b28c0-8cdc-4793-bbbb-5ed9dd2b5c1a req-9855b2e8-6d0b-4225-8cdb-be9668cbba33 service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Updated VIF entry in instance network info cache for port db537bed-b0bc-4295-af53-4fc336c45675. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:38:51 user nova-compute[75378]: DEBUG nova.network.neutron [req-bb1b28c0-8cdc-4793-bbbb-5ed9dd2b5c1a req-9855b2e8-6d0b-4225-8cdb-be9668cbba33 service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Updating instance_info_cache with network_info: [{"id": "db537bed-b0bc-4295-af53-4fc336c45675", "address": "fa:16:3e:ef:6c:72", "network": {"id": "14e65d53-261f-4171-bb08-63e3da53c090", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1182321126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db95eb923b64757988e524ce4e89dc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb537bed-b0", "ovs_interfaceid": "db537bed-b0bc-4295-af53-4fc336c45675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:38:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bb1b28c0-8cdc-4793-bbbb-5ed9dd2b5c1a req-9855b2e8-6d0b-4225-8cdb-be9668cbba33 service nova] Releasing lock "refresh_cache-1fb5f90d-3d22-474d-947d-f939fa150f3f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:38:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:38:56 user nova-compute[75378]: INFO nova.virt.block_device [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Booting with volume d7a0d227-c269-4b71-bd46-114d7c236b66 at /dev/vdb
Nov 09 03:38:57 user nova-compute[75378]: DEBUG os_brick.utils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:38:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:57 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d1049a-4ea0-4bc6-aa03-d0dfe5f3e30c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:38:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:57 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfe601e-9644-4330-81ca-047c6d1f4536]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:38:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:38:57 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0d0edf-96a1-42c4-8ba8-97eca3fa7e5b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:38:57 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[044be3d0-3b73-4b42-91f1-3ddd1165ea5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:38:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:38:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:38:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:38:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:38:57 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:38:57 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b54eb3-c121-4f9a-83d0-0f89c4837dd5]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:38:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:38:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:38:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:38:57 user nova-compute[75378]: DEBUG os_brick.utils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:38:57 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Updating existing volume attachment record: 535f62b9-344c-423e-99b0-c5a2160175b9 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:38:58 user nova-compute[75378]: DEBUG nova.compute.manager [req-36dfc117-c47d-45be-b925-3e7afdf2265f req-5039e70c-0f57-4ee4-8e71-6cadaa56d03d service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Received event network-changed-c831c172-1cc7-428a-b240-f6ced441ef2a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:38:58 user nova-compute[75378]: DEBUG nova.compute.manager [req-36dfc117-c47d-45be-b925-3e7afdf2265f req-5039e70c-0f57-4ee4-8e71-6cadaa56d03d service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Refreshing instance network info cache due to event network-changed-c831c172-1cc7-428a-b240-f6ced441ef2a. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:38:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-36dfc117-c47d-45be-b925-3e7afdf2265f req-5039e70c-0f57-4ee4-8e71-6cadaa56d03d service nova] Acquiring lock "refresh_cache-fadeb1f5-4118-4a08-986a-ff08778b229d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:38:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-36dfc117-c47d-45be-b925-3e7afdf2265f req-5039e70c-0f57-4ee4-8e71-6cadaa56d03d service nova] Acquired lock "refresh_cache-fadeb1f5-4118-4a08-986a-ff08778b229d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:38:58 user nova-compute[75378]: DEBUG nova.network.neutron [req-36dfc117-c47d-45be-b925-3e7afdf2265f req-5039e70c-0f57-4ee4-8e71-6cadaa56d03d service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Refreshing network info cache for port c831c172-1cc7-428a-b240-f6ced441ef2a {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:38:58 user nova-compute[75378]: DEBUG nova.network.neutron [req-36dfc117-c47d-45be-b925-3e7afdf2265f req-5039e70c-0f57-4ee4-8e71-6cadaa56d03d service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Updated VIF entry in instance network info cache for port c831c172-1cc7-428a-b240-f6ced441ef2a. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:38:58 user nova-compute[75378]: DEBUG nova.network.neutron [req-36dfc117-c47d-45be-b925-3e7afdf2265f req-5039e70c-0f57-4ee4-8e71-6cadaa56d03d service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Updating instance_info_cache with network_info: [{"id": "c831c172-1cc7-428a-b240-f6ced441ef2a", "address": "fa:16:3e:3a:19:8c", "network": {"id": "7cae065f-736a-43fe-a505-62054a7c5af3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-265578846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5d1f59e34b145bab300bb75cc1b7e2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831c172-1c", "ovs_interfaceid": "c831c172-1cc7-428a-b240-f6ced441ef2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:38:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-36dfc117-c47d-45be-b925-3e7afdf2265f req-5039e70c-0f57-4ee4-8e71-6cadaa56d03d service nova] Releasing lock "refresh_cache-fadeb1f5-4118-4a08-986a-ff08778b229d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:39:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:39:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:39:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-5057772f-1929-489b-a092-2ee118e70c6c req-2b1c1f68-c9f5-436e-945d-02ce8bfc88ce service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Received event network-changed-ee5357d8-2dbf-42d7-90eb-01409b3f3a55 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:39:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-5057772f-1929-489b-a092-2ee118e70c6c req-2b1c1f68-c9f5-436e-945d-02ce8bfc88ce service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Refreshing instance network info cache due to event network-changed-ee5357d8-2dbf-42d7-90eb-01409b3f3a55. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:39:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5057772f-1929-489b-a092-2ee118e70c6c req-2b1c1f68-c9f5-436e-945d-02ce8bfc88ce service nova] Acquiring lock "refresh_cache-fc692659-f62e-4d29-909d-0509cf3952b4" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:39:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5057772f-1929-489b-a092-2ee118e70c6c req-2b1c1f68-c9f5-436e-945d-02ce8bfc88ce service nova] Acquired lock "refresh_cache-fc692659-f62e-4d29-909d-0509cf3952b4" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:39:04 user nova-compute[75378]: DEBUG nova.network.neutron [req-5057772f-1929-489b-a092-2ee118e70c6c req-2b1c1f68-c9f5-436e-945d-02ce8bfc88ce service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Refreshing network info cache for port ee5357d8-2dbf-42d7-90eb-01409b3f3a55 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:39:04 user nova-compute[75378]: DEBUG nova.network.neutron [req-5057772f-1929-489b-a092-2ee118e70c6c req-2b1c1f68-c9f5-436e-945d-02ce8bfc88ce service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Updated VIF entry in instance network info cache for port ee5357d8-2dbf-42d7-90eb-01409b3f3a55. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:39:04 user nova-compute[75378]: DEBUG nova.network.neutron [req-5057772f-1929-489b-a092-2ee118e70c6c req-2b1c1f68-c9f5-436e-945d-02ce8bfc88ce service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Updating instance_info_cache with network_info: [{"id": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "address": "fa:16:3e:2d:24:6f", "network": {"id": "fcedd8b7-ea71-40c5-9aaa-012a32d034dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-102964368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8bed46ae0b24564a8a9c68eec52f022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee5357d8-2d", "ovs_interfaceid": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:39:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5057772f-1929-489b-a092-2ee118e70c6c req-2b1c1f68-c9f5-436e-945d-02ce8bfc88ce service nova] Releasing lock "refresh_cache-fc692659-f62e-4d29-909d-0509cf3952b4" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:39:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:39:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:39:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:39:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG os_brick.initiator.connector [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Factory for ISCSI on None {{(pid=75378) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQRnHBAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:39:12 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:39:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:39:12 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:39:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:39:12 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[58436974-a94b-4152-9b84-4da0a0364272]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:39:12 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea68b02-7017-4c19-93af-f9f309c5f0be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f] added
Nov 09 03:39:12 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be67846-e32a-498d-a183-6737e9adaff8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[514a85bb-6109-4016-882b-3b6a5c3d5f5d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQRnHBAt {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQRnHBAt" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf5729a-3876-437b-b70b-745b34867dd8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YQRnHBAt'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aaca4e-8169-4487-812d-3ec504f3f5da]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[309a3c4c-6144-4099-a4c4-b5fc26ae0f73]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 03:39:12 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 03:39:12 user nova-compute[75378]:  {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:39:12 user nova-compute[75378]: WARNING os_brick.initiator.connectors.iscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 03:39:12 user nova-compute[75378]: 
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[18367f1c-a939-4ae4-bdd9-c4df5c70bbcf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f, portal: 172.16.0.220,3260]
Nov 09 03:39:12 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f, portal: 172.16.0.220,3260] successful.
Nov 09 03:39:12 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae8ee14-3feb-43c0-921e-3fb6111f7fdb]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f153ff-1f36-4ce1-81f4-054c7bfbabd6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)
Nov 09 03:39:13 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)
Nov 09 03:39:13 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6b2432-c2a0-4dfc-a229-2bd787e6516a]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQRnHBAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Acquiring lock "fadeb1f5-4118-4a08-986a-ff08778b229d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG nova.objects.instance [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lazy-loading 'flavor' on Instance uuid fadeb1f5-4118-4a08-986a-ff08778b229d {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Acquiring lock "fc692659-f62e-4d29-909d-0509cf3952b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Lock "fc692659-f62e-4d29-909d-0509cf3952b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG nova.objects.instance [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Lazy-loading 'flavor' on Instance uuid fc692659-f62e-4d29-909d-0509cf3952b4 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Lock "fc692659-f62e-4d29-909d-0509cf3952b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Acquiring lock "1fb5f90d-3d22-474d-947d-f939fa150f3f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "1fb5f90d-3d22-474d-947d-f939fa150f3f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG nova.objects.instance [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lazy-loading 'flavor' on Instance uuid 1fb5f90d-3d22-474d-947d-f939fa150f3f {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "1fb5f90d-3d22-474d-947d-f939fa150f3f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INCMdrLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:39:13 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:39:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Acquiring lock "fadeb1f5-4118-4a08-986a-ff08778b229d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:39:13 user nova-compute[75378]: INFO nova.compute.manager [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Attaching volume cf663092-5cd7-48cd-9ecd-06653f9ff5ac to /dev/vdb
Nov 09 03:39:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Acquiring lock "fc692659-f62e-4d29-909d-0509cf3952b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Lock "fc692659-f62e-4d29-909d-0509cf3952b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:39:13 user nova-compute[75378]: INFO nova.compute.manager [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Attaching volume 8d522802-8fb3-4314-95af-7a6b25c02be4 to /dev/vdb
Nov 09 03:39:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Acquiring lock "1fb5f90d-3d22-474d-947d-f939fa150f3f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "1fb5f90d-3d22-474d-947d-f939fa150f3f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:39:13 user nova-compute[75378]: INFO nova.compute.manager [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Attaching volume 8c61a416-1e70-4070-8e04-c0b32194cb2d to /dev/sdc
Nov 09 03:39:13 user nova-compute[75378]: DEBUG os_brick.utils [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:39:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b19b2aa-5401-47b4-a10c-06e6a2d7fd2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f665ccb-112a-458e-acae-01804020b7c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.utils [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26436393733653137', 'path': '/dev/sdb'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436393733653137', 'path': '/dev/sdb'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[486fca39-db99-45f4-9682-8ea8f3379f21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.358s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:39:14 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:39:14 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2a3543-fb9f-451b-8eed-54e287dd85d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lazy-loading 'flavor' on Instance uuid 70a7686e-042c-4be8-8182-69c62027c744 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8c817a-f83e-4e12-984f-b14f26969c37]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8b12e8-26ec-4728-8ece-dc86fa24c640]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9d676f-afd9-4ade-b43a-de341f5d3f3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.utils [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:39:14 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 03:39:14 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:39:14 user nova-compute[75378]:   <source dev="/dev/sdb"/>
Nov 09 03:39:14 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:39:14 user nova-compute[75378]:   <serial>57883fe6-d171-41f5-a6b3-9dda3515681f</serial>
Nov 09 03:39:14 user nova-compute[75378]: </disk>
Nov 09 03:39:14 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:39:14 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab4eb56-c59e-427a-88bb-4254065b330d]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.utils [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Updating existing volume attachment record: 9c27b234-497a-49f3-b5f4-a324b015b001 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aad669b-d49d-49d9-878d-f702e52af1f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[72994a88-d962-4d8a-9bef-d0e74105b13c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31fb74f-72d1-4312-b18a-3db09a531100]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07] added
Nov 09 03:39:14 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca702f7-16ea-4a68-b5c6-e5bc7e939924]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3bcbf9-d448-4173-83ab-3b617709b636]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5c4e0d-aa4c-49c1-b869-c9e4ec9a6668]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ac3950-9917-4989-8887-eaa3d6f159fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d2399c-b126-4281-a2cc-8e2d2c5e302e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9f474c-8438-49ed-8c87-6fca5991d85f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:39:14 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdc924f-31ba-4fb4-99cf-a827ee52d1b2]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.utils [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] <== get_connector_properties: return (271ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Updating existing volume attachment record: 1a35cdfd-5789-42b8-ba4b-7e107f9e42b5 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v INCMdrLS {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:39:14 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc6c1ed-8ac2-4bd5-83f5-9e6421b9b296]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.utils [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] <== get_connector_properties: return (204ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Updating existing volume attachment record: 15d03be3-5f33-40b2-ab50-20108b3bd193 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v INCMdrLS" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a077fa77-e55a-42db-9da1-b160e703aa92]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'INCMdrLS'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2aef49a-23d2-4153-bfaf-36b9b0b26621]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0846c455-870f-480a-bf34-1e68fc53d865]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)
Nov 09 03:39:14 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)
Nov 09 03:39:14 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6930cff0-4345-439c-bdf3-739539a98fb7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07, portal: 172.16.0.220,3260]
Nov 09 03:39:14 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07, portal: 172.16.0.220,3260] successful.
Nov 09 03:39:14 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e003e730-de9a-45b8-8307-fff342cdf86a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3e2004-e473-424a-bf38-b04adc02ad47]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)
Nov 09 03:39:14 user nova-compute[75378]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)
Nov 09 03:39:14 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)
Nov 09 03:39:14 user nova-compute[75378]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)
Nov 09 03:39:14 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.450s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6504ecce-5d3e-4f61-bb03-a094b4289e9b]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INCMdrLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:39:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] No VIF found with MAC fa:16:3e:83:d7:60, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:39:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.485s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:39:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] <== connect_volume: return (1844ms) {'type': 'block', 'scsi_wwn': '26532363366633335', 'path': '/dev/sdc'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:39:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532363366633335', 'path': '/dev/sdc'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:39:15 user nova-compute[75378]: DEBUG nova.objects.instance [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lazy-loading 'flavor' on Instance uuid 0aa21edc-dc12-46ad-925d-47bc5b576172 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:39:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:39:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 03:39:15 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:39:15 user nova-compute[75378]:   <source dev="/dev/sdc"/>
Nov 09 03:39:15 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:39:15 user nova-compute[75378]:   <serial>e21167cc-2dae-4b81-8b66-2bc3e1ffda07</serial>
Nov 09 03:39:15 user nova-compute[75378]: </disk>
Nov 09 03:39:15 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 03:39:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:39:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] No BDM found with device name hda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:39:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] No VIF found with MAC fa:16:3e:2e:7c:ad, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:39:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:39:16 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:39:19 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:39:20 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:39:20 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:39:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:39:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:39:20 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 03:39:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:39:20 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Updating instance_info_cache with network_info: [{"id": "4c53e537-1637-4f65-b393-a10e68383acb", "address": "fa:16:3e:d8:76:bf", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c53e537-16", "ovs_interfaceid": "4c53e537-1637-4f65-b393-a10e68383acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:39:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:39:20 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 03:39:20 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:39:20 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:39:21 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:39:21 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:39:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:39:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:39:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:39:21 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:39:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:39:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.263s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:39:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:39:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:39:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:39:26 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:39:26 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:39:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7028MB free_disk=25.53750228881836GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:39:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:39:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:39:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9691c96a-287e-40f0-a7e2-70bd56d9d2d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:39:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:39:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:39:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2f475dba-59f5-414a-8156-8b438601ecfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:39:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 70a7686e-042c-4be8-8182-69c62027c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:39:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 0aa21edc-dc12-46ad-925d-47bc5b576172 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:39:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 1fb5f90d-3d22-474d-947d-f939fa150f3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:39:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance fadeb1f5-4118-4a08-986a-ff08778b229d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:39:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance fc692659-f62e-4d29-909d-0509cf3952b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:39:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 176d35dc-6397-4204-b0d3-0d27e3f967c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:39:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 8adad7f0-fa15-415b-b384-bfdae665a59b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:39:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance b44da21c-9c44-48d2-865c-85ea2f103a89 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:39:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:39:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:39:27 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:39:27 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:39:27 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:39:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.664s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:39:28 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:39:28 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:39:28 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:39:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:39:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:39:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:39:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXcGOzpb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:39:39 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:39:39 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:39:39 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28f5120-d260-4fee-adcd-171a2b5284b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:39:39 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4776c2b-0c52-4227-81f1-0417e9faecda]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4] added
Nov 09 03:39:39 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgJPXVKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:39:39 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc62b5c7-f665-4cf6-afe6-a547e3537edd]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d6a7e1-5919-4ac0-92f0-8e62f6f9175a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tXcGOzpb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tXcGOzpb" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7a21f4-f834-44a2-ac70-7f0e641f5ad0]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tXcGOzpb'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ba0a1341-1094-46c5-aed6-2957e328f7a2 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "70a7686e-042c-4be8-8182-69c62027c744" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 52.016s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a166747-0f56-4eec-8603-56663b7222c2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[38335ea5-75d9-4869-9e88-a7b884c0807a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)
Nov 09 03:39:39 user nova-compute[75378]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)
Nov 09 03:39:39 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)
Nov 09 03:39:39 user nova-compute[75378]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)
Nov 09 03:39:39 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd780ae8-d53f-4aa0-93ce-eab51312e260]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4, portal: 172.16.0.220,3260]
Nov 09 03:39:39 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4, portal: 172.16.0.220,3260] successful.
Nov 09 03:39:39 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c2e0d3-8f3c-451d-bbf6-04edb178361b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-602093f4-fb5e-4548-a5b1-ba1c159cba88 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 51.767s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8452aa29-e787-4334-b37d-01c89accf5bc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)
Nov 09 03:39:39 user nova-compute[75378]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)
Nov 09 03:39:39 user nova-compute[75378]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)
Nov 09 03:39:39 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)
Nov 09 03:39:39 user nova-compute[75378]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)
Nov 09 03:39:39 user nova-compute[75378]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)
Nov 09 03:39:39 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.036s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ac91b5-5a9a-48e5-a163-10f0659620ea]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:39:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXcGOzpb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:39:39 user nova-compute[75378]: INFO nova.virt.block_device [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Booting with volume e6a7fe63-54f7-459f-b608-89a2cc39300e at /dev/vdc
Nov 09 03:39:40 user nova-compute[75378]: DEBUG os_brick.utils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[276ceee8-7933-49c7-81d6-3101187f0f88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cf0e3b-3bed-4d41-b034-e15603b20da4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[244362eb-6dd1-4796-afa6-90c0bbfbe5a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b08ffbc-61df-424e-bbb7-c7640267ef8d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:39:40 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[370118e2-3fa5-4ac3-956b-4d0d08245112]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG os_brick.utils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Updating existing volume attachment record: 37a083c8-305f-4eef-ab68-9a2315f057f0 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "70a7686e-042c-4be8-8182-69c62027c744" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "70a7686e-042c-4be8-8182-69c62027c744" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:39:40 user nova-compute[75378]: INFO nova.compute.manager [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Detaching volume 57883fe6-d171-41f5-a6b3-9dda3515681f
Nov 09 03:39:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '26230653331633965', 'path': '/dev/sdd'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230653331633965', 'path': '/dev/sdd'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.338s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:39:40 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:39:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:39:40 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG nova.objects.instance [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Lazy-loading 'flavor' on Instance uuid fc692659-f62e-4d29-909d-0509cf3952b4 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f8388d-c1a7-44a4-9547-ddaaa50d3094]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:39:40 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfc0001-c1c3-4ead-886b-4ca6745a5b50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac] added
Nov 09 03:39:40 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] attach device xml: <disk type="block" device="disk">
Nov 09 03:39:40 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:39:40 user nova-compute[75378]:   <source dev="/dev/sdd"/>
Nov 09 03:39:40 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:39:40 user nova-compute[75378]:   <serial>8d522802-8fb3-4314-95af-7a6b25c02be4</serial>
Nov 09 03:39:40 user nova-compute[75378]: </disk>
Nov 09 03:39:40 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 03:39:40 user nova-compute[75378]: INFO nova.virt.block_device [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Attempting to driver detach volume 57883fe6-d171-41f5-a6b3-9dda3515681f from mountpoint /dev/vdb
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f93142-11df-4562-9033-9df541fb8388]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1498c241-9457-4041-bffb-718d300306fc]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Attempting to detach device vdb from instance 70a7686e-042c-4be8-8182-69c62027c744 from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:39:40 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:39:40 user nova-compute[75378]:   <source dev="/dev/sdb"/>
Nov 09 03:39:40 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:39:40 user nova-compute[75378]:   <serial>57883fe6-d171-41f5-a6b3-9dda3515681f</serial>
Nov 09 03:39:40 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 03:39:40 user nova-compute[75378]: </disk>
Nov 09 03:39:40 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OgJPXVKk {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:40 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Successfully detached device vdb from instance 70a7686e-042c-4be8-8182-69c62027c744 from the persistent domain config.
Nov 09 03:39:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 70a7686e-042c-4be8-8182-69c62027c744 from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:39:40 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:39:40 user nova-compute[75378]:   <source dev="/dev/sdb"/>
Nov 09 03:39:40 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:39:40 user nova-compute[75378]:   <serial>57883fe6-d171-41f5-a6b3-9dda3515681f</serial>
Nov 09 03:39:40 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 03:39:40 user nova-compute[75378]: </disk>
Nov 09 03:39:40 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OgJPXVKk" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc893a0-4ebe-439a-bf15-725b6d4dadbe]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OgJPXVKk'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2191b78-84b3-462f-b395-3ced04685bf0]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2734d31-6402-423b-8159-988c6d7e0f04]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)
Nov 09 03:39:41 user nova-compute[75378]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)
Nov 09 03:39:41 user nova-compute[75378]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)
Nov 09 03:39:41 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)
Nov 09 03:39:41 user nova-compute[75378]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)
Nov 09 03:39:41 user nova-compute[75378]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)
Nov 09 03:39:41 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b086c376-2f3a-481b-99ff-715ca5a3519a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac, portal: 172.16.0.220,3260]
Nov 09 03:39:41 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac, portal: 172.16.0.220,3260] successful.
Nov 09 03:39:41 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaea0e1-b5ff-47f4-ae46-f3c8f0a17479]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[87972763-abb8-4a96-94f1-029f9e459ef1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)
Nov 09 03:39:41 user nova-compute[75378]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)
Nov 09 03:39:41 user nova-compute[75378]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)
Nov 09 03:39:41 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:39:41 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)
Nov 09 03:39:41 user nova-compute[75378]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)
Nov 09 03:39:41 user nova-compute[75378]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)
Nov 09 03:39:41 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:39:41 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49a8fd1-3482-41e4-8299-155c93e03fa3]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgJPXVKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] No VIF found with MAC fa:16:3e:2d:24:6f, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 70a7686e-042c-4be8-8182-69c62027c744 {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 03:39:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fb6c7e28-cd0b-4e6f-b7b1-4157e92d2a48 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Lock "fc692659-f62e-4d29-909d-0509cf3952b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.145s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:39:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:39:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] <== connect_volume: return (2734ms) {'type': 'block', 'scsi_wwn': '23731646338393161', 'path': '/dev/sde'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:39:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731646338393161', 'path': '/dev/sde'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:39:42 user nova-compute[75378]: DEBUG nova.objects.instance [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lazy-loading 'flavor' on Instance uuid fadeb1f5-4118-4a08-986a-ff08778b229d {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:39:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 03:39:42 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:39:42 user nova-compute[75378]:   <source dev="/dev/sde"/>
Nov 09 03:39:42 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:39:42 user nova-compute[75378]:   <serial>cf663092-5cd7-48cd-9ecd-06653f9ff5ac</serial>
Nov 09 03:39:42 user nova-compute[75378]: </disk>
Nov 09 03:39:42 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 03:39:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquiring lock "0aa21edc-dc12-46ad-925d-47bc5b576172" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:39:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:39:42 user nova-compute[75378]: INFO nova.compute.manager [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Detaching volume e21167cc-2dae-4b81-8b66-2bc3e1ffda07
Nov 09 03:39:42 user nova-compute[75378]: INFO nova.virt.block_device [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Attempting to driver detach volume e21167cc-2dae-4b81-8b66-2bc3e1ffda07 from mountpoint /dev/vdb
Nov 09 03:39:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Attempting to detach device vdb from instance 0aa21edc-dc12-46ad-925d-47bc5b576172 from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 03:39:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:39:42 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:39:42 user nova-compute[75378]:   <source dev="/dev/sdc"/>
Nov 09 03:39:42 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:39:42 user nova-compute[75378]:   <serial>e21167cc-2dae-4b81-8b66-2bc3e1ffda07</serial>
Nov 09 03:39:42 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 09 03:39:42 user nova-compute[75378]: </disk>
Nov 09 03:39:42 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:39:42 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Successfully detached device vdb from instance 0aa21edc-dc12-46ad-925d-47bc5b576172 from the persistent domain config.
Nov 09 03:39:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0aa21edc-dc12-46ad-925d-47bc5b576172 from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 03:39:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:39:42 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:39:42 user nova-compute[75378]:   <source dev="/dev/sdc"/>
Nov 09 03:39:42 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:39:42 user nova-compute[75378]:   <serial>e21167cc-2dae-4b81-8b66-2bc3e1ffda07</serial>
Nov 09 03:39:42 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 09 03:39:42 user nova-compute[75378]: </disk>
Nov 09 03:39:42 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:39:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-83286405-a8c7-4db6-8ed9-72e8e50ce7c0 tempest-VolumesAssistedSnapshotsTest-851736728 tempest-VolumesAssistedSnapshotsTest-851736728-project] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] volume_snapshot_create: create_info: {'snapshot_id': 'a2020cd3-a833-4bbf-a794-a2972394f242', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75378) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 09 03:39:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-83286405-a8c7-4db6-8ed9-72e8e50ce7c0 tempest-VolumesAssistedSnapshotsTest-851736728 tempest-VolumesAssistedSnapshotsTest-851736728-project] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] snap xml: <domainsnapshot>
Nov 09 03:39:42 user nova-compute[75378]:   <disks>
Nov 09 03:39:42 user nova-compute[75378]:     <disk name="/dev/sdd" snapshot="external" type="file">
Nov 09 03:39:42 user nova-compute[75378]:       <source file="/dev/new_file"/>
Nov 09 03:39:42 user nova-compute[75378]:     </disk>
Nov 09 03:39:42 user nova-compute[75378]:     <disk name="vda" snapshot="no"/>
Nov 09 03:39:42 user nova-compute[75378]:   </disks>
Nov 09 03:39:42 user nova-compute[75378]: </domainsnapshot>
Nov 09 03:39:42 user nova-compute[75378]:  {{(pid=75378) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 09 03:39:42 user nova-compute[75378]: DEBUG nova.objects.instance [None req-83286405-a8c7-4db6-8ed9-72e8e50ce7c0 tempest-VolumesAssistedSnapshotsTest-851736728 tempest-VolumesAssistedSnapshotsTest-851736728-project] Lazy-loading 'system_metadata' on Instance uuid fc692659-f62e-4d29-909d-0509cf3952b4 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:39:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:39:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:39:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] No VIF found with MAC fa:16:3e:3a:19:8c, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:39:42 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-83286405-a8c7-4db6-8ed9-72e8e50ce7c0 tempest-VolumesAssistedSnapshotsTest-851736728 tempest-VolumesAssistedSnapshotsTest-851736728-project] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 09 03:39:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-8b88f582-d6c7-47d7-bd7b-b77e60ee4098 tempest-VolumesAssistedSnapshotsTest-851736728 tempest-VolumesAssistedSnapshotsTest-851736728-project] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] volume_snapshot_delete: delete_info: {'volume_id': '8d522802-8fb3-4314-95af-7a6b25c02be4'} {{(pid=75378) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [None req-8b88f582-d6c7-47d7-bd7b-b77e60ee4098 tempest-VolumesAssistedSnapshotsTest-851736728 tempest-VolumesAssistedSnapshotsTest-851736728-project] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Traceback (most recent call last):
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]     if delete_info['type'] != 'qcow2':
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4] KeyError: 'type'
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4] 
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [None req-83286405-a8c7-4db6-8ed9-72e8e50ce7c0 tempest-VolumesAssistedSnapshotsTest-851736728 tempest-VolumesAssistedSnapshotsTest-851736728-project] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Traceback (most recent call last):
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]     rv = execute(f, *args, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]     six.reraise(c, e, tb)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]     raise value
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]     rv = meth(*args, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4] 
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [None req-83286405-a8c7-4db6-8ed9-72e8e50ce7c0 tempest-VolumesAssistedSnapshotsTest-851736728 tempest-VolumesAssistedSnapshotsTest-851736728-project] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Traceback (most recent call last):
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]     self._volume_snapshot_create(context, instance, guest,
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]     rv = execute(f, *args, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]     six.reraise(c, e, tb)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]     raise value
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]     rv = meth(*args, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [instance: fc692659-f62e-4d29-909d-0509cf3952b4] 
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [None req-8b88f582-d6c7-47d7-bd7b-b77e60ee4098 tempest-VolumesAssistedSnapshotsTest-851736728 tempest-VolumesAssistedSnapshotsTest-851736728-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver 
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver 
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-85302848-efaa-4cd6-8d6c-d98e147f6cea)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver 
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver 
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver 
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server [None req-8b88f582-d6c7-47d7-bd7b-b77e60ee4098 tempest-VolumesAssistedSnapshotsTest-851736728 tempest-VolumesAssistedSnapshotsTest-851736728-project] Exception during message handling: KeyError: 'type'
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server 
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver [None req-83286405-a8c7-4db6-8ed9-72e8e50ce7c0 tempest-VolumesAssistedSnapshotsTest-851736728 tempest-VolumesAssistedSnapshotsTest-851736728-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot a2020cd3-a833-4bbf-a794-a2972394f242 could not be found.
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     raise value
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver 
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver 
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot a2020cd3-a833-4bbf-a794-a2972394f242 could not be found. (HTTP 404) (Request-ID: req-46a9f32d-a956-4f03-a16b-542d85b8b532)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver 
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver 
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot a2020cd3-a833-4bbf-a794-a2972394f242 could not be found.
Nov 09 03:39:42 user nova-compute[75378]: ERROR nova.virt.libvirt.driver 
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server [None req-83286405-a8c7-4db6-8ed9-72e8e50ce7c0 tempest-VolumesAssistedSnapshotsTest-851736728 tempest-VolumesAssistedSnapshotsTest-851736728-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise value
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 09 03:39:42 user nova-compute[75378]: ERROR oslo_messaging.rpc.server 
Nov 09 03:39:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2a233695-689e-4fdf-8a8f-4077e0cf974f tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.262s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:39:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0aa21edc-dc12-46ad-925d-47bc5b576172 {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 03:39:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Acquiring lock "fc692659-f62e-4d29-909d-0509cf3952b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:39:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Lock "fc692659-f62e-4d29-909d-0509cf3952b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:39:43 user nova-compute[75378]: INFO nova.compute.manager [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Detaching volume 8d522802-8fb3-4314-95af-7a6b25c02be4
Nov 09 03:39:43 user nova-compute[75378]: INFO nova.virt.block_device [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Attempting to driver detach volume 8d522802-8fb3-4314-95af-7a6b25c02be4 from mountpoint /dev/vdb
Nov 09 03:39:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Attempting to detach device vdb from instance fc692659-f62e-4d29-909d-0509cf3952b4 from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 03:39:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] detach device xml: <disk type="block" device="disk">
Nov 09 03:39:43 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:39:43 user nova-compute[75378]:   <source dev="/dev/sdd"/>
Nov 09 03:39:43 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:39:43 user nova-compute[75378]:   <serial>8d522802-8fb3-4314-95af-7a6b25c02be4</serial>
Nov 09 03:39:43 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 03:39:43 user nova-compute[75378]: </disk>
Nov 09 03:39:43 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:39:43 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Successfully detached device vdb from instance fc692659-f62e-4d29-909d-0509cf3952b4 from the persistent domain config.
Nov 09 03:39:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fc692659-f62e-4d29-909d-0509cf3952b4 from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 03:39:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] detach device xml: <disk type="block" device="disk">
Nov 09 03:39:43 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:39:43 user nova-compute[75378]:   <source dev="/dev/sdd"/>
Nov 09 03:39:43 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:39:43 user nova-compute[75378]:   <serial>8d522802-8fb3-4314-95af-7a6b25c02be4</serial>
Nov 09 03:39:43 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 03:39:43 user nova-compute[75378]: </disk>
Nov 09 03:39:43 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:39:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fc692659-f62e-4d29-909d-0509cf3952b4 {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 03:39:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-90891f58-f6f0-4dd0-96a0-1a9bf6da29cf tempest-TestVolumeSwap-1412310114 tempest-TestVolumeSwap-1412310114-project-admin] Acquiring lock "fadeb1f5-4118-4a08-986a-ff08778b229d" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:39:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-90891f58-f6f0-4dd0-96a0-1a9bf6da29cf tempest-TestVolumeSwap-1412310114 tempest-TestVolumeSwap-1412310114-project-admin] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:39:43 user nova-compute[75378]: DEBUG os_brick.utils [None req-90891f58-f6f0-4dd0-96a0-1a9bf6da29cf tempest-TestVolumeSwap-1412310114 tempest-TestVolumeSwap-1412310114-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:39:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:43 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d808a0-f41d-41c1-bf32-2063b61ea118]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b174ad70-36fe-4181-8260-1a1babc1f0fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e26166-d0d8-43d2-aebd-46e83aa8fff0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[71da2ca1-f6b5-4353-a520-08d36527639f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-90891f58-f6f0-4dd0-96a0-1a9bf6da29cf tempest-TestVolumeSwap-1412310114 tempest-TestVolumeSwap-1412310114-project-admin] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-90891f58-f6f0-4dd0-96a0-1a9bf6da29cf tempest-TestVolumeSwap-1412310114 tempest-TestVolumeSwap-1412310114-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:39:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90891f58-f6f0-4dd0-96a0-1a9bf6da29cf tempest-TestVolumeSwap-1412310114 tempest-TestVolumeSwap-1412310114-project-admin] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:39:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:39:44 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:39:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9673bc-bec2-4f3b-a547-9b78e2c92024]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-90891f58-f6f0-4dd0-96a0-1a9bf6da29cf tempest-TestVolumeSwap-1412310114 tempest-TestVolumeSwap-1412310114-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:39:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-90891f58-f6f0-4dd0-96a0-1a9bf6da29cf tempest-TestVolumeSwap-1412310114 tempest-TestVolumeSwap-1412310114-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:39:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-90891f58-f6f0-4dd0-96a0-1a9bf6da29cf tempest-TestVolumeSwap-1412310114 tempest-TestVolumeSwap-1412310114-project-admin] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:39:44 user nova-compute[75378]: DEBUG os_brick.utils [None req-90891f58-f6f0-4dd0-96a0-1a9bf6da29cf tempest-TestVolumeSwap-1412310114 tempest-TestVolumeSwap-1412310114-project-admin] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:39:44 user nova-compute[75378]: INFO nova.compute.manager [None req-90891f58-f6f0-4dd0-96a0-1a9bf6da29cf tempest-TestVolumeSwap-1412310114 tempest-TestVolumeSwap-1412310114-project-admin] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Swapping volume cf663092-5cd7-48cd-9ecd-06653f9ff5ac for b283bf65-ce2b-475c-8185-dd2234e0f536
Nov 09 03:39:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:39:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoVmJXek', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:39:48 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:39:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:39:48 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:39:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:39:48 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[717fb051-15bd-4aa5-8873-6639b6246329]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:39:48 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed284a9-7081-443a-9f09-dd5ffcb89de1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d] added
Nov 09 03:39:48 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6355b7-4fb3-4bab-8498-23c1864871e1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1a2619-fe74-4789-b490-a42155794d18]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RoVmJXek {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RoVmJXek" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d2d70c-0588-4fb9-b708-db67f372298c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RoVmJXek'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a18038-01fd-4246-8e62-e1130a521582]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b3990a-c0e6-4b3c-831f-0bcb1c7d115f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)
Nov 09 03:39:48 user nova-compute[75378]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)
Nov 09 03:39:48 user nova-compute[75378]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)
Nov 09 03:39:48 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:39:48 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)
Nov 09 03:39:48 user nova-compute[75378]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)
Nov 09 03:39:48 user nova-compute[75378]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)
Nov 09 03:39:48 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:39:48 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cb7d06-d4df-4c62-8c65-6d458f150fba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d, portal: 172.16.0.220,3260]
Nov 09 03:39:48 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d, portal: 172.16.0.220,3260] successful.
Nov 09 03:39:48 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:49 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a7926f-b3e2-4f1a-80d9-c30332a46754]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:39:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:49 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[49588cdf-ff44-4400-b1e7-59884eeaefd5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)
Nov 09 03:39:49 user nova-compute[75378]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)
Nov 09 03:39:49 user nova-compute[75378]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)
Nov 09 03:39:49 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:39:49 user nova-compute[75378]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)
Nov 09 03:39:49 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:39:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)
Nov 09 03:39:49 user nova-compute[75378]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)
Nov 09 03:39:49 user nova-compute[75378]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)
Nov 09 03:39:49 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:39:49 user nova-compute[75378]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)
Nov 09 03:39:49 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:39:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:39:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:39:49 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:39:49 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:39:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:39:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:39:49 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[096cd5d6-25e0-4a98-9685-b5bd533b05d7]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:39:49 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:39:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoVmJXek', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:39:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:39:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23937393733383032', 'path': '/dev/sdf'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:39:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937393733383032', 'path': '/dev/sdf'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:39:50 user nova-compute[75378]: DEBUG nova.objects.instance [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lazy-loading 'flavor' on Instance uuid 1fb5f90d-3d22-474d-947d-f939fa150f3f {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:39:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 03:39:50 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:39:50 user nova-compute[75378]:   <source dev="/dev/sdf"/>
Nov 09 03:39:50 user nova-compute[75378]:   <target dev="sdc" bus="scsi"/>
Nov 09 03:39:50 user nova-compute[75378]:   <serial>8c61a416-1e70-4070-8e04-c0b32194cb2d</serial>
Nov 09 03:39:50 user nova-compute[75378]:   <address type="drive" controller="0" unit="2"/>
Nov 09 03:39:50 user nova-compute[75378]: </disk>
Nov 09 03:39:50 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 03:39:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] No BDM found with device name sda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:39:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:39:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:39:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] No VIF found with MAC fa:16:3e:ef:6c:72, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:39:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7ef7db26-d2f6-4efe-b418-357bb64c682f tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "1fb5f90d-3d22-474d-947d-f939fa150f3f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.105s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:39:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:39:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:39:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 03:39:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:39:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:39:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:39:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Acquiring lock "1fb5f90d-3d22-474d-947d-f939fa150f3f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:39:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "1fb5f90d-3d22-474d-947d-f939fa150f3f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:39:51 user nova-compute[75378]: INFO nova.compute.manager [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Detaching volume 8c61a416-1e70-4070-8e04-c0b32194cb2d
Nov 09 03:39:51 user nova-compute[75378]: INFO nova.virt.block_device [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Attempting to driver detach volume 8c61a416-1e70-4070-8e04-c0b32194cb2d from mountpoint /dev/sdc
Nov 09 03:39:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Attempting to detach device sdc from instance 1fb5f90d-3d22-474d-947d-f939fa150f3f from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 03:39:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:39:51 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:39:51 user nova-compute[75378]:   <source dev="/dev/sdf"/>
Nov 09 03:39:51 user nova-compute[75378]:   <target dev="sdc" bus="scsi"/>
Nov 09 03:39:51 user nova-compute[75378]:   <serial>8c61a416-1e70-4070-8e04-c0b32194cb2d</serial>
Nov 09 03:39:51 user nova-compute[75378]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 09 03:39:51 user nova-compute[75378]: </disk>
Nov 09 03:39:51 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:39:51 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Successfully detached device sdc from instance 1fb5f90d-3d22-474d-947d-f939fa150f3f from the persistent domain config.
Nov 09 03:39:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 1fb5f90d-3d22-474d-947d-f939fa150f3f from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 03:39:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:39:51 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:39:51 user nova-compute[75378]:   <source dev="/dev/sdf"/>
Nov 09 03:39:51 user nova-compute[75378]:   <target dev="sdc" bus="scsi"/>
Nov 09 03:39:51 user nova-compute[75378]:   <serial>8c61a416-1e70-4070-8e04-c0b32194cb2d</serial>
Nov 09 03:39:51 user nova-compute[75378]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 09 03:39:51 user nova-compute[75378]: </disk>
Nov 09 03:39:51 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:39:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 1fb5f90d-3d22-474d-947d-f939fa150f3f {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 03:39:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:01 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 70a7686e-042c-4be8-8182-69c62027c744 is timed out.
Nov 09 03:40:01 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Successfully detached device vdb from instance 70a7686e-042c-4be8-8182-69c62027c744 from the live domain config.
Nov 09 03:40:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQRnHBAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:40:01 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:40:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[65271e4e-46b8-418d-8500-2774d6e385e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:40:01 user nova-compute[75378]: No targets found.
Nov 09 03:40:01 user nova-compute[75378]: iSNS:
Nov 09 03:40:01 user nova-compute[75378]: No targets found.
Nov 09 03:40:01 user nova-compute[75378]: STATIC:
Nov 09 03:40:01 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d
Nov 09 03:40:01 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:40:01 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:40:01 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f
Nov 09 03:40:01 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:40:01 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:40:01 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4
Nov 09 03:40:01 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:40:01 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:40:01 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac
Nov 09 03:40:01 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:40:01 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:40:01 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07
Nov 09 03:40:01 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:40:01 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:40:01 user nova-compute[75378]: FIRMWARE:
Nov 09 03:40:01 user nova-compute[75378]: No targets found.
Nov 09 03:40:01 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:40:01 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:40:01 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c76772f-f00b-44dd-9ea0-86f35b6a4ae2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ec089e-028d-41d9-9e51-f0f8c1e51255]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)
Nov 09 03:40:01 user nova-compute[75378]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)
Nov 09 03:40:01 user nova-compute[75378]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)
Nov 09 03:40:01 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:01 user nova-compute[75378]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)
Nov 09 03:40:01 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f (non-flash)
Nov 09 03:40:01 user nova-compute[75378]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)
Nov 09 03:40:01 user nova-compute[75378]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)
Nov 09 03:40:01 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:01 user nova-compute[75378]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)
Nov 09 03:40:01 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c717880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f'): ({'sdb'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Removing single pathed devices sdb {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54ee6ed-575e-4e59-9708-1b87d5b37f1e]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6aa838d-e841-4029-b475-7963623d9472]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Flushing IO for device /dev/sdb {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[72673a0a-6ed9-47fc-905a-bdd222d1125f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[401b6bbb-89b2-4526-b18f-4b0f89841024]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c808373-3841-45e2-aae2-51aa47139558]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[69203ff9-046a-4aef-bbea-8cec3cb7077b]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f, portal: 172.16.0.220,3260]
Nov 09 03:40:02 user nova-compute[75378]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f, portal: 172.16.0.220,3260] successful.
Nov 09 03:40:02 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57883fe6-d171-41f5-a6b3-9dda3515681f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d139188e-3464-47bc-a455-ca5376d6fccf]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:40:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] <== disconnect_volume: return (338ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:40:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lazy-loading 'flavor' on Instance uuid 70a7686e-042c-4be8-8182-69c62027c744 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ba5a39f7-b014-4ff1-bc77-dfea93a2f40a tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "70a7686e-042c-4be8-8182-69c62027c744" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.309s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:03 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0aa21edc-dc12-46ad-925d-47bc5b576172 is timed out.
Nov 09 03:40:03 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Successfully detached device vdb from instance 0aa21edc-dc12-46ad-925d-47bc5b576172 from the live domain config.
Nov 09 03:40:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INCMdrLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:40:03 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[86de2ed4-78dc-4aef-beef-8b1a05c25fe9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:40:03 user nova-compute[75378]: No targets found.
Nov 09 03:40:03 user nova-compute[75378]: iSNS:
Nov 09 03:40:03 user nova-compute[75378]: No targets found.
Nov 09 03:40:03 user nova-compute[75378]: STATIC:
Nov 09 03:40:03 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d
Nov 09 03:40:03 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:40:03 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:40:03 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4
Nov 09 03:40:03 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:40:03 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:40:03 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac
Nov 09 03:40:03 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:40:03 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:40:03 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07
Nov 09 03:40:03 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:40:03 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:40:03 user nova-compute[75378]: FIRMWARE:
Nov 09 03:40:03 user nova-compute[75378]: No targets found.
Nov 09 03:40:03 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:40:03 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:40:03 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3d06c4-2d1b-48c6-b849-52c3f1410528]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7304e118-73ab-451a-9863-08145e9063a2]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)
Nov 09 03:40:03 user nova-compute[75378]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)
Nov 09 03:40:03 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:03 user nova-compute[75378]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)
Nov 09 03:40:03 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 (non-flash)
Nov 09 03:40:03 user nova-compute[75378]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)
Nov 09 03:40:03 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:03 user nova-compute[75378]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)
Nov 09 03:40:03 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c7672e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07'): ({'sdc'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Removing single pathed devices sdc {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a266c8b0-e13a-4ac6-8349-5dd58942a6c5]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc8a837-f9ea-471a-bada-feabfaa45893]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Flushing IO for device /dev/sdc {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb451e8a-e8b5-4dc7-a0bd-e9aa959cbc0f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[769805b4-eae8-4245-ab98-e078c5826f48]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] SCSI volumes sdc have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ba0597-7613-444a-8f06-3726e8d09fb2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f41dcd-8a54-4225-aa64-3e212842eccc]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07, portal: 172.16.0.220,3260]
Nov 09 03:40:03 user nova-compute[75378]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07, portal: 172.16.0.220,3260] successful.
Nov 09 03:40:03 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e21167cc-2dae-4b81-8b66-2bc3e1ffda07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[875aa811-1c58-4189-8a29-22ca5a036519]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] <== disconnect_volume: return (346ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:40:03 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fc692659-f62e-4d29-909d-0509cf3952b4 is timed out.
Nov 09 03:40:03 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Successfully detached device vdb from instance fc692659-f62e-4d29-909d-0509cf3952b4 from the live domain config.
Nov 09 03:40:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXcGOzpb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:40:03 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeac17ed-284a-4c33-8c3b-4c8e14a685ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:40:03 user nova-compute[75378]: No targets found.
Nov 09 03:40:03 user nova-compute[75378]: iSNS:
Nov 09 03:40:03 user nova-compute[75378]: No targets found.
Nov 09 03:40:03 user nova-compute[75378]: STATIC:
Nov 09 03:40:03 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d
Nov 09 03:40:03 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:40:03 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:40:03 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4
Nov 09 03:40:03 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:40:03 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:40:03 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac
Nov 09 03:40:03 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:40:03 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:40:03 user nova-compute[75378]: FIRMWARE:
Nov 09 03:40:03 user nova-compute[75378]: No targets found.
Nov 09 03:40:03 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:40:03 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:40:03 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f68dc2e-44df-4039-8e3d-0ab0531c87fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bcb69f-ef10-46ad-b6e6-a0727c0739d2]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)
Nov 09 03:40:03 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:03 user nova-compute[75378]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)
Nov 09 03:40:03 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 (non-flash)
Nov 09 03:40:03 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:03 user nova-compute[75378]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)
Nov 09 03:40:03 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3b0461c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4'): ({'sdd'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Removing single pathed devices sdd {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb06a16b-5410-4dc2-90fc-fa67b84133fd]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a295808f-d080-4ea7-8c41-375fa5217fe9]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Flushing IO for device /dev/sdd {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[91963cdb-e586-442e-86ec-4a798d63c531]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[092db3b9-c5bc-42fd-9b1f-2e66a91e0235]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] SCSI volumes sdd have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d612ba5d-8964-4e08-97a5-0e74b06722ea]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2871df8c-fec2-4af7-8a5d-f3628100377a]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4, portal: 172.16.0.220,3260]
Nov 09 03:40:04 user nova-compute[75378]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4, portal: 172.16.0.220,3260] successful.
Nov 09 03:40:04 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d522802-8fb3-4314-95af-7a6b25c02be4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5c4f9f-227b-46b1-99e8-4b1885d66e7f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] <== disconnect_volume: return (312ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG nova.objects.instance [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lazy-loading 'flavor' on Instance uuid 0aa21edc-dc12-46ad-925d-47bc5b576172 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:40:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bf8e0a20-f5ae-4c51-960a-97bc942fa859 tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.524s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.volume.cinder [None req-90891f58-f6f0-4dd0-96a0-1a9bf6da29cf tempest-TestVolumeSwap-1412310114 tempest-TestVolumeSwap-1412310114-project-admin] Update attachment failed for attachment f1267ea9-eefd-4eea-8d7a-ab62c01c99b9. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2c62f47a-7d59-4fc7-9025-ab03208bcf81) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2c62f47a-7d59-4fc7-9025-ab03208bcf81)
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [None req-90891f58-f6f0-4dd0-96a0-1a9bf6da29cf tempest-TestVolumeSwap-1412310114 tempest-TestVolumeSwap-1412310114-project-admin] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Failed to connect to volume b283bf65-ce2b-475c-8185-dd2234e0f536 with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2c62f47a-7d59-4fc7-9025-ab03208bcf81)
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Traceback (most recent call last):
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]     new_cinfo = self.volume_api.attachment_update(
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]     res = method(self, ctx, *args, **kwargs)
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]     with excutils.save_and_reraise_exception():
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]     self.force_reraise()
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]     raise self.value
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]     context, '3.44', skip_version_check=True).attachments.update(
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]     return method.func(obj, *args, **kwargs)
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]     resp = self._update('/attachments/%s' % id, body)
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]     return self._cs_request(url, 'PUT', **kwargs)
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]     return self.request(url, method, **kwargs)
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d]     raise exceptions.from_response(resp, body)
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2c62f47a-7d59-4fc7-9025-ab03208bcf81)
Nov 09 03:40:04 user nova-compute[75378]: ERROR nova.compute.manager [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] 
Nov 09 03:40:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquiring lock "interface-0aa21edc-dc12-46ad-925d-47bc5b576172-46397870-ba5d-4bf9-84e7-bb1febeae42e" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "interface-0aa21edc-dc12-46ad-925d-47bc5b576172-46397870-ba5d-4bf9-84e7-bb1febeae42e" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG nova.objects.instance [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lazy-loading 'flavor' on Instance uuid 0aa21edc-dc12-46ad-925d-47bc5b576172 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-600308768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-600308768',id=6,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7Zi3/OBwBWFZyzirh8mZQ4BgVFx7fj6XXgOw9/PxXUG8dZzej6jh1WqLhuSvXrU5svCvjW/PsldUVgziNo99MiMWj1iBWLdTs8DNBiQq2fEkWCg0hw0gQlP+3PQUsmdg==',key_name='tempest-keypair-1523638191',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:37:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64d1e0442fe540cda81d2a5467664870',ramdisk_id='',reservation_id='r-776ypqd0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1282324561',owner_user_name='tempest-TaggedAttachmentsTest-1282324561-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1261613bc54e7f96c70ed27d8a829e',uuid=0aa21edc-dc12-46ad-925d-47bc5b576172,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "address": "fa:16:3e:c9:c5:b4", "network": {"id": "336622a2-627e-4a05-b204-7ab1ef8595ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1520328787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46397870-ba", "ovs_interfaceid": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Converting VIF {"id": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "address": "fa:16:3e:c9:c5:b4", "network": {"id": "336622a2-627e-4a05-b204-7ab1ef8595ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1520328787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46397870-ba", "ovs_interfaceid": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:c5:b4,bridge_name='br-int',has_traffic_filtering=True,id=46397870-ba5d-4bf9-84e7-bb1febeae42e,network=Network(336622a2-627e-4a05-b204-7ab1ef8595ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46397870-ba') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c9:c5:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap46397870-ba"/></interface> {{(pid=75378) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c9:c5:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap46397870-ba"/></interface> {{(pid=75378) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Attempting to detach device tap46397870-ba from instance 0aa21edc-dc12-46ad-925d-47bc5b576172 from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] detach device xml: <interface type="ethernet">
Nov 09 03:40:05 user nova-compute[75378]:   <mac address="fa:16:3e:c9:c5:b4"/>
Nov 09 03:40:05 user nova-compute[75378]:   <model type="virtio"/>
Nov 09 03:40:05 user nova-compute[75378]:   <mtu size="1442"/>
Nov 09 03:40:05 user nova-compute[75378]:   <target dev="tap46397870-ba"/>
Nov 09 03:40:05 user nova-compute[75378]: </interface>
Nov 09 03:40:05 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-90891f58-f6f0-4dd0-96a0-1a9bf6da29cf tempest-TestVolumeSwap-1412310114 tempest-TestVolumeSwap-1412310114-project-admin] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 21.351s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Acquiring lock "8adad7f0-fa15-415b-b384-bfdae665a59b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "8adad7f0-fa15-415b-b384-bfdae665a59b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Acquiring lock "8adad7f0-fa15-415b-b384-bfdae665a59b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "8adad7f0-fa15-415b-b384-bfdae665a59b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "8adad7f0-fa15-415b-b384-bfdae665a59b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c9:c5:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap46397870-ba"/></interface> {{(pid=75378) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 09 03:40:05 user nova-compute[75378]: INFO nova.compute.manager [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Terminating instance
Nov 09 03:40:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c9:c5:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap46397870-ba"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 09 03:40:05 user nova-compute[75378]:   <name>instance-00000006</name>
Nov 09 03:40:05 user nova-compute[75378]:   <uuid>0aa21edc-dc12-46ad-925d-47bc5b576172</uuid>
Nov 09 03:40:05 user nova-compute[75378]:   <metadata>
Nov 09 03:40:05 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:40:05 user nova-compute[75378]:   <nova:package version="0.0.0"/>
Nov 09 03:40:05 user nova-compute[75378]:   <nova:name>tempest-device-tagging-server-600308768</nova:name>
Nov 09 03:40:05 user nova-compute[75378]:   <nova:creationTime>2023-11-09 03:38:47</nova:creationTime>
Nov 09 03:40:05 user nova-compute[75378]:   <nova:flavor name="m1.tiny">
Nov 09 03:40:05 user nova-compute[75378]:     <nova:memory>512</nova:memory>
Nov 09 03:40:05 user nova-compute[75378]:     <nova:disk>1</nova:disk>
Nov 09 03:40:05 user nova-compute[75378]:     <nova:swap>0</nova:swap>
Nov 09 03:40:05 user nova-compute[75378]:     <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:40:05 user nova-compute[75378]:     <nova:vcpus>1</nova:vcpus>
Nov 09 03:40:05 user nova-compute[75378]:   </nova:flavor>
Nov 09 03:40:05 user nova-compute[75378]:   <nova:owner>
Nov 09 03:40:05 user nova-compute[75378]:     <nova:user uuid="1b1261613bc54e7f96c70ed27d8a829e">tempest-TaggedAttachmentsTest-1282324561-project-member</nova:user>
Nov 09 03:40:05 user nova-compute[75378]:     <nova:project uuid="64d1e0442fe540cda81d2a5467664870">tempest-TaggedAttachmentsTest-1282324561</nova:project>
Nov 09 03:40:05 user nova-compute[75378]:   </nova:owner>
Nov 09 03:40:05 user nova-compute[75378]:   <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:40:05 user nova-compute[75378]:   <nova:ports>
Nov 09 03:40:05 user nova-compute[75378]:     <nova:port uuid="23694ef3-48c1-4a9b-9b38-3062aed570e5">
Nov 09 03:40:05 user nova-compute[75378]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 03:40:05 user nova-compute[75378]:     </nova:port>
Nov 09 03:40:05 user nova-compute[75378]:     <nova:port uuid="46397870-ba5d-4bf9-84e7-bb1febeae42e">
Nov 09 03:40:05 user nova-compute[75378]:       <nova:ip type="fixed" address="10.10.10.22" ipVersion="4"/>
Nov 09 03:40:05 user nova-compute[75378]:     </nova:port>
Nov 09 03:40:05 user nova-compute[75378]:   </nova:ports>
Nov 09 03:40:05 user nova-compute[75378]: </nova:instance>
Nov 09 03:40:05 user nova-compute[75378]:   </metadata>
Nov 09 03:40:05 user nova-compute[75378]:   <memory unit='KiB'>524288</memory>
Nov 09 03:40:05 user nova-compute[75378]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 09 03:40:05 user nova-compute[75378]:   <vcpu placement='static'>1</vcpu>
Nov 09 03:40:05 user nova-compute[75378]:   <resource>
Nov 09 03:40:05 user nova-compute[75378]:     <partition>/machine</partition>
Nov 09 03:40:05 user nova-compute[75378]:   </resource>
Nov 09 03:40:05 user nova-compute[75378]:   <sysinfo type='smbios'>
Nov 09 03:40:05 user nova-compute[75378]:     <system>
Nov 09 03:40:05 user nova-compute[75378]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 09 03:40:05 user nova-compute[75378]:       <entry name='product'>OpenStack Nova</entry>
Nov 09 03:40:05 user nova-compute[75378]:       <entry name='version'>0.0.0</entry>
Nov 09 03:40:05 user nova-compute[75378]:       <entry name='serial'>0aa21edc-dc12-46ad-925d-47bc5b576172</entry>
Nov 09 03:40:05 user nova-compute[75378]:       <entry name='uuid'>0aa21edc-dc12-46ad-925d-47bc5b576172</entry>
Nov 09 03:40:05 user nova-compute[75378]:       <entry name='family'>Virtual Machine</entry>
Nov 09 03:40:05 user nova-compute[75378]:     </system>
Nov 09 03:40:05 user nova-compute[75378]:   </sysinfo>
Nov 09 03:40:05 user nova-compute[75378]:   <os>
Nov 09 03:40:05 user nova-compute[75378]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 09 03:40:05 user nova-compute[75378]:     <boot dev='hd'/>
Nov 09 03:40:05 user nova-compute[75378]:     <smbios mode='sysinfo'/>
Nov 09 03:40:05 user nova-compute[75378]:   </os>
Nov 09 03:40:05 user nova-compute[75378]:   <features>
Nov 09 03:40:05 user nova-compute[75378]:     <acpi/>
Nov 09 03:40:05 user nova-compute[75378]:     <apic/>
Nov 09 03:40:05 user nova-compute[75378]:     <vmcoreinfo state='on'/>
Nov 09 03:40:05 user nova-compute[75378]:   </features>
Nov 09 03:40:05 user nova-compute[75378]:   <cpu mode='custom' match='exact' check='full'>
Nov 09 03:40:05 user nova-compute[75378]:     <model fallback='forbid'>Nehalem</model>
Nov 09 03:40:05 user nova-compute[75378]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 09 03:40:05 user nova-compute[75378]:     <feature policy='require' name='vme'/>
Nov 09 03:40:05 user nova-compute[75378]:     <feature policy='require' name='x2apic'/>
Nov 09 03:40:05 user nova-compute[75378]:     <feature policy='require' name='hypervisor'/>
Nov 09 03:40:05 user nova-compute[75378]:   </cpu>
Nov 09 03:40:05 user nova-compute[75378]:   <clock offset='utc'>
Nov 09 03:40:05 user nova-compute[75378]:     <timer name='pit' tickpolicy='delay'/>
Nov 09 03:40:05 user nova-compute[75378]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 09 03:40:05 user nova-compute[75378]:     <timer name='hpet' present='no'/>
Nov 09 03:40:05 user nova-compute[75378]:   </clock>
Nov 09 03:40:05 user nova-compute[75378]:   <on_poweroff>destroy</on_poweroff>
Nov 09 03:40:05 user nova-compute[75378]:   <on_reboot>restart</on_reboot>
Nov 09 03:40:05 user nova-compute[75378]:   <on_crash>destroy</on_crash>
Nov 09 03:40:05 user nova-compute[75378]:   <devices>
Nov 09 03:40:05 user nova-compute[75378]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 09 03:40:05 user nova-compute[75378]:     <disk type='file' device='disk'>
Nov 09 03:40:05 user nova-compute[75378]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 09 03:40:05 user nova-compute[75378]:       <source file='/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk' index='2'/>
Nov 09 03:40:05 user nova-compute[75378]:       <backingStore type='file' index='3'>
Nov 09 03:40:05 user nova-compute[75378]:         <format type='raw'/>
Nov 09 03:40:05 user nova-compute[75378]:         <source file='/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a'/>
Nov 09 03:40:05 user nova-compute[75378]:         <backingStore/>
Nov 09 03:40:05 user nova-compute[75378]:       </backingStore>
Nov 09 03:40:05 user nova-compute[75378]:       <target dev='vda' bus='virtio'/>
Nov 09 03:40:05 user nova-compute[75378]:       <alias name='virtio-disk0'/>
Nov 09 03:40:05 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 09 03:40:05 user nova-compute[75378]:     </disk>
Nov 09 03:40:05 user nova-compute[75378]:     <disk type='file' device='cdrom'>
Nov 09 03:40:05 user nova-compute[75378]:       <driver name='qemu' type='raw' cache='none'/>
Nov 09 03:40:05 user nova-compute[75378]:       <source file='/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk.config' index='1'/>
Nov 09 03:40:05 user nova-compute[75378]:       <backingStore/>
Nov 09 03:40:05 user nova-compute[75378]:       <target dev='hda' bus='ide'/>
Nov 09 03:40:05 user nova-compute[75378]:       <readonly/>
Nov 09 03:40:05 user nova-compute[75378]:       <alias name='ide0-0-0'/>
Nov 09 03:40:05 user nova-compute[75378]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 09 03:40:05 user nova-compute[75378]:     </disk>
Nov 09 03:40:05 user nova-compute[75378]:     <controller type='usb' index='0' model='none'>
Nov 09 03:40:05 user nova-compute[75378]:       <alias name='usb'/>
Nov 09 03:40:05 user nova-compute[75378]:     </controller>
Nov 09 03:40:05 user nova-compute[75378]:     <controller type='pci' index='0' model='pci-root'>
Nov 09 03:40:05 user nova-compute[75378]:       <alias name='pci.0'/>
Nov 09 03:40:05 user nova-compute[75378]:     </controller>
Nov 09 03:40:05 user nova-compute[75378]:     <controller type='ide' index='0'>
Nov 09 03:40:05 user nova-compute[75378]:       <alias name='ide'/>
Nov 09 03:40:05 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 09 03:40:05 user nova-compute[75378]:     </controller>
Nov 09 03:40:05 user nova-compute[75378]:     <interface type='ethernet'>
Nov 09 03:40:05 user nova-compute[75378]:       <mac address='fa:16:3e:2e:7c:ad'/>
Nov 09 03:40:05 user nova-compute[75378]:       <target dev='tap23694ef3-48'/>
Nov 09 03:40:05 user nova-compute[75378]:       <model type='virtio'/>
Nov 09 03:40:05 user nova-compute[75378]:       <mtu size='1442'/>
Nov 09 03:40:05 user nova-compute[75378]:       <alias name='net0'/>
Nov 09 03:40:05 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 09 03:40:05 user nova-compute[75378]:     </interface>
Nov 09 03:40:05 user nova-compute[75378]:     <interface type='ethernet'>
Nov 09 03:40:05 user nova-compute[75378]:       <mac address='fa:16:3e:c9:c5:b4'/>
Nov 09 03:40:05 user nova-compute[75378]:       <target dev='tap46397870-ba'/>
Nov 09 03:40:05 user nova-compute[75378]:       <model type='virtio'/>
Nov 09 03:40:05 user nova-compute[75378]:       <mtu size='1442'/>
Nov 09 03:40:05 user nova-compute[75378]:       <alias name='net1'/>
Nov 09 03:40:05 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 09 03:40:05 user nova-compute[75378]:     </interface>
Nov 09 03:40:05 user nova-compute[75378]:     <serial type='pty'>
Nov 09 03:40:05 user nova-compute[75378]:       <source path='/dev/pts/5'/>
Nov 09 03:40:05 user nova-compute[75378]:       <log file='/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/console.log' append='off'/>
Nov 09 03:40:05 user nova-compute[75378]:       <target type='isa-serial' port='0'>
Nov 09 03:40:05 user nova-compute[75378]:         <model name='isa-serial'/>
Nov 09 03:40:05 user nova-compute[75378]:       </target>
Nov 09 03:40:05 user nova-compute[75378]:       <alias name='serial0'/>
Nov 09 03:40:05 user nova-compute[75378]:     </serial>
Nov 09 03:40:05 user nova-compute[75378]:     <console type='pty' tty='/dev/pts/5'>
Nov 09 03:40:05 user nova-compute[75378]:       <source path='/dev/pts/5'/>
Nov 09 03:40:05 user nova-compute[75378]:       <log file='/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/console.log' append='off'/>
Nov 09 03:40:05 user nova-compute[75378]:       <target type='serial' port='0'/>
Nov 09 03:40:05 user nova-compute[75378]:       <alias name='serial0'/>
Nov 09 03:40:05 user nova-compute[75378]:     </console>
Nov 09 03:40:05 user nova-compute[75378]:     <input type='mouse' bus='ps2'>
Nov 09 03:40:05 user nova-compute[75378]:       <alias name='input0'/>
Nov 09 03:40:05 user nova-compute[75378]:     </input>
Nov 09 03:40:05 user nova-compute[75378]:     <input type='keyboard' bus='ps2'>
Nov 09 03:40:05 user nova-compute[75378]:       <alias name='input1'/>
Nov 09 03:40:05 user nova-compute[75378]:     </input>
Nov 09 03:40:05 user nova-compute[75378]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 09 03:40:05 user nova-compute[75378]:       <listen type='address' address='0.0.0.0'/>
Nov 09 03:40:05 user nova-compute[75378]:     </graphics>
Nov 09 03:40:05 user nova-compute[75378]:     <audio id='1' type='none'/>
Nov 09 03:40:05 user nova-compute[75378]:     <video>
Nov 09 03:40:05 user nova-compute[75378]:       <model type='virtio' heads='1' primary='yes'/>
Nov 09 03:40:05 user nova-compute[75378]:       <alias name='video0'/>
Nov 09 03:40:05 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 09 03:40:05 user nova-compute[75378]:     </video>
Nov 09 03:40:05 user nova-compute[75378]:     <memballoon model='virtio'>
Nov 09 03:40:05 user nova-compute[75378]:       <stats period='10'/>
Nov 09 03:40:05 user nova-compute[75378]:       <alias name='balloon0'/>
Nov 09 03:40:05 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 09 03:40:05 user nova-compute[75378]:     </memballoon>
Nov 09 03:40:05 user nova-compute[75378]:     <rng model='virtio'>
Nov 09 03:40:05 user nova-compute[75378]:       <backend model='random'>/dev/urandom</backend>
Nov 09 03:40:05 user nova-compute[75378]:       <alias name='rng0'/>
Nov 09 03:40:05 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 09 03:40:05 user nova-compute[75378]:     </rng>
Nov 09 03:40:05 user nova-compute[75378]:   </devices>
Nov 09 03:40:05 user nova-compute[75378]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 09 03:40:05 user nova-compute[75378]:     <label>libvirt-0aa21edc-dc12-46ad-925d-47bc5b576172</label>
Nov 09 03:40:05 user nova-compute[75378]:     <imagelabel>libvirt-0aa21edc-dc12-46ad-925d-47bc5b576172</imagelabel>
Nov 09 03:40:05 user nova-compute[75378]:   </seclabel>
Nov 09 03:40:05 user nova-compute[75378]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 09 03:40:05 user nova-compute[75378]:     <label>+64055:+108</label>
Nov 09 03:40:05 user nova-compute[75378]:     <imagelabel>+64055:+108</imagelabel>
Nov 09 03:40:05 user nova-compute[75378]:   </seclabel>
Nov 09 03:40:05 user nova-compute[75378]: </domain>
Nov 09 03:40:05 user nova-compute[75378]:  {{(pid=75378) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 09 03:40:05 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Successfully detached device tap46397870-ba from instance 0aa21edc-dc12-46ad-925d-47bc5b576172 from the persistent domain config.
Nov 09 03:40:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] (1/8): Attempting to detach device tap46397870-ba with device alias net1 from instance 0aa21edc-dc12-46ad-925d-47bc5b576172 from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] detach device xml: <interface type="ethernet">
Nov 09 03:40:05 user nova-compute[75378]:   <mac address="fa:16:3e:c9:c5:b4"/>
Nov 09 03:40:05 user nova-compute[75378]:   <model type="virtio"/>
Nov 09 03:40:05 user nova-compute[75378]:   <mtu size="1442"/>
Nov 09 03:40:05 user nova-compute[75378]:   <target dev="tap46397870-ba"/>
Nov 09 03:40:05 user nova-compute[75378]: </interface>
Nov 09 03:40:05 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG nova.compute.manager [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server [None req-90891f58-f6f0-4dd0-96a0-1a9bf6da29cf tempest-TestVolumeSwap-1412310114 tempest-TestVolumeSwap-1412310114-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2c62f47a-7d59-4fc7-9025-ab03208bcf81)
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7903, in swap_volume
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7901, in _do_locked_swap_volume
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7945, in _do_swap_volume
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7794, in _swap_volume
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2c62f47a-7d59-4fc7-9025-ab03208bcf81)
Nov 09 03:40:05 user nova-compute[75378]: ERROR oslo_messaging.rpc.server 
Nov 09 03:40:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Start waiting for the detach event from libvirt for device tap46397870-ba with device alias net1 for instance 0aa21edc-dc12-46ad-925d-47bc5b576172 {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG nova.compute.manager [req-3c0675c3-01a8-48c1-95b1-6979bea47003 req-198944d5-f147-40e8-81bb-8e119ed5e2cb service nova] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Received event network-vif-unplugged-61ec79aa-e08d-4565-bee8-3f42ca74eb70 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3c0675c3-01a8-48c1-95b1-6979bea47003 req-198944d5-f147-40e8-81bb-8e119ed5e2cb service nova] Acquiring lock "8adad7f0-fa15-415b-b384-bfdae665a59b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3c0675c3-01a8-48c1-95b1-6979bea47003 req-198944d5-f147-40e8-81bb-8e119ed5e2cb service nova] Lock "8adad7f0-fa15-415b-b384-bfdae665a59b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3c0675c3-01a8-48c1-95b1-6979bea47003 req-198944d5-f147-40e8-81bb-8e119ed5e2cb service nova] Lock "8adad7f0-fa15-415b-b384-bfdae665a59b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG nova.compute.manager [req-3c0675c3-01a8-48c1-95b1-6979bea47003 req-198944d5-f147-40e8-81bb-8e119ed5e2cb service nova] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] No waiting events found dispatching network-vif-unplugged-61ec79aa-e08d-4565-bee8-3f42ca74eb70 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG nova.compute.manager [req-3c0675c3-01a8-48c1-95b1-6979bea47003 req-198944d5-f147-40e8-81bb-8e119ed5e2cb service nova] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Received event network-vif-unplugged-61ec79aa-e08d-4565-bee8-3f42ca74eb70 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:06 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Instance destroyed successfully.
Nov 09 03:40:06 user nova-compute[75378]: DEBUG nova.objects.instance [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lazy-loading 'resources' on Instance uuid 8adad7f0-fa15-415b-b384-bfdae665a59b {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:40:06 user nova-compute[75378]: DEBUG nova.objects.instance [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Lazy-loading 'flavor' on Instance uuid fc692659-f62e-4d29-909d-0509cf3952b4 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:40:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:38:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1067772541',display_name='tempest-ServersNegativeTestJSON-server-1067772541',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1067772541',id=11,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:38:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed1024d4b86f47b480b75e55108e6c30',ramdisk_id='',reservation_id='r-foermn5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-218592793',owner_user_name='tempest-ServersNegativeTestJSON-218592793-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:38:23Z,user_data=None,user_id='201443e0d5e84be0b662043093120ae3',uuid=8adad7f0-fa15-415b-b384-bfdae665a59b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61ec79aa-e08d-4565-bee8-3f42ca74eb70", "address": "fa:16:3e:a2:58:e3", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ec79aa-e0", "ovs_interfaceid": "61ec79aa-e08d-4565-bee8-3f42ca74eb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:40:06 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Converting VIF {"id": "61ec79aa-e08d-4565-bee8-3f42ca74eb70", "address": "fa:16:3e:a2:58:e3", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ec79aa-e0", "ovs_interfaceid": "61ec79aa-e08d-4565-bee8-3f42ca74eb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:06 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:58:e3,bridge_name='br-int',has_traffic_filtering=True,id=61ec79aa-e08d-4565-bee8-3f42ca74eb70,network=Network(9b18f037-ec04-4c7f-bfc8-17e90dd10787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ec79aa-e0') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:06 user nova-compute[75378]: DEBUG os_vif [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:58:e3,bridge_name='br-int',has_traffic_filtering=True,id=61ec79aa-e08d-4565-bee8-3f42ca74eb70,network=Network(9b18f037-ec04-4c7f-bfc8-17e90dd10787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ec79aa-e0') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:40:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61ec79aa-e0, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33b0187c-33fb-4aa2-96c1-c97c6f6fa624) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8e18ba7a-9350-4b07-90c6-6c6b60c0c593 tempest-VolumesAssistedSnapshotsTest-2063418853 tempest-VolumesAssistedSnapshotsTest-2063418853-project-admin] Lock "fc692659-f62e-4d29-909d-0509cf3952b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.140s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:06 user nova-compute[75378]: INFO os_vif [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:58:e3,bridge_name='br-int',has_traffic_filtering=True,id=61ec79aa-e08d-4565-bee8-3f42ca74eb70,network=Network(9b18f037-ec04-4c7f-bfc8-17e90dd10787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ec79aa-e0')
Nov 09 03:40:06 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Deleting instance files /opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b_del
Nov 09 03:40:06 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Deletion of /opt/stack/data/nova/instances/8adad7f0-fa15-415b-b384-bfdae665a59b_del complete
Nov 09 03:40:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75378) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 09 03:40:06 user nova-compute[75378]: INFO nova.virt.libvirt.host [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] UEFI support detected
Nov 09 03:40:06 user nova-compute[75378]: INFO nova.compute.manager [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 09 03:40:06 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:40:06 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:40:06 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:40:07 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:40:07 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Took 0.99 seconds to deallocate network for instance.
Nov 09 03:40:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-be41f185-ea88-45e6-a8af-aa57c3a14868 req-c4cf1a6c-3f90-4f12-9298-24a14528e0b0 service nova] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Received event network-vif-deleted-61ec79aa-e08d-4565-bee8-3f42ca74eb70 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-9dac73b2-7ced-42e8-8fef-ee7ac274af44 req-67fc6d6e-ba30-4267-a59e-347a47017690 service nova] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Received event network-vif-plugged-61ec79aa-e08d-4565-bee8-3f42ca74eb70 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9dac73b2-7ced-42e8-8fef-ee7ac274af44 req-67fc6d6e-ba30-4267-a59e-347a47017690 service nova] Acquiring lock "8adad7f0-fa15-415b-b384-bfdae665a59b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9dac73b2-7ced-42e8-8fef-ee7ac274af44 req-67fc6d6e-ba30-4267-a59e-347a47017690 service nova] Lock "8adad7f0-fa15-415b-b384-bfdae665a59b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9dac73b2-7ced-42e8-8fef-ee7ac274af44 req-67fc6d6e-ba30-4267-a59e-347a47017690 service nova] Lock "8adad7f0-fa15-415b-b384-bfdae665a59b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-9dac73b2-7ced-42e8-8fef-ee7ac274af44 req-67fc6d6e-ba30-4267-a59e-347a47017690 service nova] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] No waiting events found dispatching network-vif-plugged-61ec79aa-e08d-4565-bee8-3f42ca74eb70 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:07 user nova-compute[75378]: WARNING nova.compute.manager [req-9dac73b2-7ced-42e8-8fef-ee7ac274af44 req-67fc6d6e-ba30-4267-a59e-347a47017690 service nova] [instance: 8adad7f0-fa15-415b-b384-bfdae665a59b] Received unexpected event network-vif-plugged-61ec79aa-e08d-4565-bee8-3f42ca74eb70 for instance with vm_state deleted and task_state None.
Nov 09 03:40:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-9dac73b2-7ced-42e8-8fef-ee7ac274af44 req-67fc6d6e-ba30-4267-a59e-347a47017690 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Received event network-vif-unplugged-46397870-ba5d-4bf9-84e7-bb1febeae42e {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9dac73b2-7ced-42e8-8fef-ee7ac274af44 req-67fc6d6e-ba30-4267-a59e-347a47017690 service nova] Acquiring lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9dac73b2-7ced-42e8-8fef-ee7ac274af44 req-67fc6d6e-ba30-4267-a59e-347a47017690 service nova] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9dac73b2-7ced-42e8-8fef-ee7ac274af44 req-67fc6d6e-ba30-4267-a59e-347a47017690 service nova] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-9dac73b2-7ced-42e8-8fef-ee7ac274af44 req-67fc6d6e-ba30-4267-a59e-347a47017690 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] No waiting events found dispatching network-vif-unplugged-46397870-ba5d-4bf9-84e7-bb1febeae42e {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:07 user nova-compute[75378]: WARNING nova.compute.manager [req-9dac73b2-7ced-42e8-8fef-ee7ac274af44 req-67fc6d6e-ba30-4267-a59e-347a47017690 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Received unexpected event network-vif-unplugged-46397870-ba5d-4bf9-84e7-bb1febeae42e for instance with vm_state active and task_state None.
Nov 09 03:40:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-9dac73b2-7ced-42e8-8fef-ee7ac274af44 req-67fc6d6e-ba30-4267-a59e-347a47017690 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Received event network-vif-plugged-46397870-ba5d-4bf9-84e7-bb1febeae42e {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9dac73b2-7ced-42e8-8fef-ee7ac274af44 req-67fc6d6e-ba30-4267-a59e-347a47017690 service nova] Acquiring lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9dac73b2-7ced-42e8-8fef-ee7ac274af44 req-67fc6d6e-ba30-4267-a59e-347a47017690 service nova] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9dac73b2-7ced-42e8-8fef-ee7ac274af44 req-67fc6d6e-ba30-4267-a59e-347a47017690 service nova] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-9dac73b2-7ced-42e8-8fef-ee7ac274af44 req-67fc6d6e-ba30-4267-a59e-347a47017690 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] No waiting events found dispatching network-vif-plugged-46397870-ba5d-4bf9-84e7-bb1febeae42e {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:07 user nova-compute[75378]: WARNING nova.compute.manager [req-9dac73b2-7ced-42e8-8fef-ee7ac274af44 req-67fc6d6e-ba30-4267-a59e-347a47017690 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Received unexpected event network-vif-plugged-46397870-ba5d-4bf9-84e7-bb1febeae42e for instance with vm_state active and task_state None.
Nov 09 03:40:07 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:40:07 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:40:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:07 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Deleted allocations for instance 8adad7f0-fa15-415b-b384-bfdae665a59b
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5f2c3d29-3dbf-436f-9cde-9e1e033b8e60 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "8adad7f0-fa15-415b-b384-bfdae665a59b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.818s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:40:08 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Creating image(s)
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Did not create local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Ensure instance console log exists: /opt/stack/data/nova/instances/b44da21c-9c44-48d2-865c-85ea2f103a89/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Start _get_guest_xml network_info=[{"id": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "address": "fa:16:3e:c8:1b:52", "network": {"id": "62aa759a-558d-42aa-8910-9709e02e9e1a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1100617011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e8875f-2f", "ovs_interfaceid": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b362041e-0313-42e1-be36-6ad021228d16", "address": "fa:16:3e:2e:52:a1", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362041e-03", "ovs_interfaceid": "b362041e-0313-42e1-be36-6ad021228d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14de84ce-7772-461d-9b7a-168604176bd3", "address": "fa:16:3e:e4:3c:b4", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14de84ce-77", "ovs_interfaceid": "14de84ce-7772-461d-9b7a-168604176bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "address": "fa:16:3e:bc:00:45", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a068d92-dd", "ovs_interfaceid": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "address": "fa:16:3e:88:5d:5c", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf9fd7-4e", "ovs_interfaceid": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "address": "fa:16:3e:c5:79:79", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d6cece-2c", "ovs_interfaceid": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27b8914c-2639-4117-86c1-62615361ab73", "address": "fa:16:3e:10:53:c2", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8914c-26", "ovs_interfaceid": "27b8914c-2639-4117-86c1-62615361ab73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xCamerOc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b44da21c-9c44-48d2-865c-85ea2f103a89', 'attached_at': '', 'detached_at': '', 'volume_id': '5a07c2dc-15f0-463e-9fae-97d5ee7626bc', 'serial': '5a07c2dc-15f0-463e-9fae-97d5ee7626bc'}, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': '8d4cb516-10f2-475b-8a5d-3fbede82af48', 'disk_bus': 'virtio', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUuneXVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b44da21c-9c44-48d2-865c-85ea2f103a89', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7a0d227-c269-4b71-bd46-114d7c236b66', 'serial': 'd7a0d227-c269-4b71-bd46-114d7c236b66'}, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': 1, 'guest_format': None, 'attachment_id': '535f62b9-344c-423e-99b0-c5a2160175b9', 'disk_bus': 'virtio', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BetjfVCk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b44da21c-9c44-48d2-865c-85ea2f103a89', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6a7fe63-54f7-459f-b608-89a2cc39300e', 'serial': 'e6a7fe63-54f7-459f-b608-89a2cc39300e'}, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'boot_index': 2, 'guest_format': None, 'attachment_id': '37a083c8-305f-4eef-ab68-9a2315f057f0', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:40:08 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:40:08 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xCamerOc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:40:08 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:40:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:40:08 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:40:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:40:08 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d268dc-06a0-4de5-93b2-744250f6abb6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:40:08 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0be65d-00a1-44da-88e3-82c60835ec03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc] added
Nov 09 03:40:08 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d188ee2a-478f-4fba-acdb-acafdbcb1588]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d8b984-b0ff-4360-aeb9-e03a9d0d543e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xCamerOc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xCamerOc" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ca63f1-f558-4b1d-9cce-09c1dc10b7cd]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xCamerOc'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4072a92-fdc1-4692-a729-8a954daf6be8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f2a3e2-0374-48c6-b49e-a78ed34392dc]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:08 user nova-compute[75378]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)
Nov 09 03:40:08 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:08 user nova-compute[75378]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)
Nov 09 03:40:08 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:40:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260 --login" returned: 0 in 1.058s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfdd6b3-376b-46a1-8a65-cc435f4fe559]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc, portal: 172.16.0.220,3260]
Nov 09 03:40:10 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc, portal: 172.16.0.220,3260] successful.
Nov 09 03:40:10 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[367cde06-b924-4c36-8f71-35b6bec4371d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc03b208-1879-47d2-a13f-9d2481199770]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:10 user nova-compute[75378]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)
Nov 09 03:40:10 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:40:10 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:40:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:10 user nova-compute[75378]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)
Nov 09 03:40:10 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:40:10 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:40:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.289s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:40:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:40:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] HCTL ('33', '-', '-', 0) found on session 7 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:40:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:40:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[423866c0-b64a-4a8f-9f5f-2b48caef58d9]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Searching for a device in session 7 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:40:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xCamerOc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.330s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] <== connect_volume: return (2332ms) {'type': 'block', 'scsi_wwn': '23330646631633639', 'path': '/dev/sdb'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330646631633639', 'path': '/dev/sdb'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUuneXVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:40:11 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:40:11 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:40:11 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3a00f7-27dd-4ffc-952c-5042c8cee699]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:40:11 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b36f018-f334-48c7-9af4-b155f5a2f02f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66] added
Nov 09 03:40:11 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dd710a-67a3-4fd5-90f5-b40a3ba0fffa]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[052754a7-b5f1-4c72-a628-37b97b2ca226]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sUuneXVT {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sUuneXVT" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[51334a12-28cb-4204-a512-73b4a8a359c7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sUuneXVT'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aeff501-6b29-4492-8022-68555988e3c2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[11aa9a99-1d7b-4bbd-addd-10be9fcbb4cf]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:11 user nova-compute[75378]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)
Nov 09 03:40:11 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:40:11 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:11 user nova-compute[75378]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)
Nov 09 03:40:11 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:40:11 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba77d37d-d306-43aa-bbc1-be07531bbefb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66, portal: 172.16.0.220,3260]
Nov 09 03:40:11 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66, portal: 172.16.0.220,3260] successful.
Nov 09 03:40:11 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f938331-321d-433f-bfa8-06940c7f7b6f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d894c732-b867-4270-b0a1-754076ea758a]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:11 user nova-compute[75378]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)
Nov 09 03:40:11 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:40:11 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:40:11 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:11 user nova-compute[75378]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)
Nov 09 03:40:11 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:40:11 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:40:11 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] HCTL ('34', '-', '-', 0) found on session 8 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d01b324-b9e2-4f4c-8dd9-42e76241d7c6]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Searching for a device in session 8 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:40:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUuneXVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:40:12 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 1fb5f90d-3d22-474d-947d-f939fa150f3f is timed out.
Nov 09 03:40:12 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Successfully detached device sdc from instance 1fb5f90d-3d22-474d-947d-f939fa150f3f from the live domain config.
Nov 09 03:40:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RoVmJXek', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:40:12 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23131636638633737', 'path': '/dev/sdc'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131636638633737', 'path': '/dev/sdc'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.325s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5571fa-d2c7-493f-91f4-015b08baae85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:40:12 user nova-compute[75378]: No targets found.
Nov 09 03:40:12 user nova-compute[75378]: iSNS:
Nov 09 03:40:12 user nova-compute[75378]: No targets found.
Nov 09 03:40:12 user nova-compute[75378]: STATIC:
Nov 09 03:40:12 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d
Nov 09 03:40:12 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:40:12 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:40:12 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc
Nov 09 03:40:12 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:40:12 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:40:12 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac
Nov 09 03:40:12 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:40:12 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:40:12 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66
Nov 09 03:40:12 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:40:12 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:40:12 user nova-compute[75378]: FIRMWARE:
Nov 09 03:40:12 user nova-compute[75378]: No targets found.
Nov 09 03:40:12 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:40:12 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:40:12 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BetjfVCk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:40:12 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[34431b45-52ee-4b5b-a299-226f7e873515]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb9e068-2884-4ce1-b553-cce06660b8e1]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:12 user nova-compute[75378]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)
Nov 09 03:40:12 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:40:12 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:40:12 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:12 user nova-compute[75378]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d (non-flash)
Nov 09 03:40:12 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:40:12 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:40:12 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3d12bfd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d'): ({'sdf'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Removing single pathed devices sdf {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ba99ef-b74e-4cf3-aa76-598bb81aec65]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf49368-dbcf-49d3-addb-d0cd1c45fa58]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Flushing IO for device /dev/sdf {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd863832-1d6d-46f1-912d-d73ec426f55c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e7c0c1-3888-4543-b3df-55e9e53f2132]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] SCSI volumes sdf have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4408d38b-753a-4cbf-8e4d-a87e8a5d9643]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be8e765-c7b5-4f46-bb01-1ec45b95fd77]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d, portal: 172.16.0.220,3260]
Nov 09 03:40:12 user nova-compute[75378]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d, portal: 172.16.0.220,3260] successful.
Nov 09 03:40:12 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c61a416-1e70-4070-8e04-c0b32194cb2d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[71411847-b02d-4808-830e-5d83754bf618]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] <== disconnect_volume: return (655ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.306s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:40:12 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:40:12 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8d361a-9e95-42d6-9855-465f67f43bfa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:40:12 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7facbf-523f-4a41-9d6d-007a79246220]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e] added
Nov 09 03:40:12 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11e236d-3a05-400c-a140-c261c708f127]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af3a178-2916-4962-83c1-2167990d31ca]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BetjfVCk {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BetjfVCk" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[90034335-ebaf-4aed-aa6b-0a3516e9a46c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BetjfVCk'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d873dd7-d6d1-47a1-9fe2-64567ea81f9e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c5d31c-ce1c-454a-a102-48fe9f2ccb27]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:13 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:40:13 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:40:13 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:13 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:40:13 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:40:13 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f0b7c7-1719-440e-b164-203f543214d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e, portal: 172.16.0.220,3260]
Nov 09 03:40:13 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e, portal: 172.16.0.220,3260] successful.
Nov 09 03:40:13 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bbc0c5-3a52-47f7-bf36-b1a2f7bd7726]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[780f2353-51d8-41d3-8785-47d1d301cf9e]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:13 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:40:13 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:40:13 user nova-compute[75378]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)
Nov 09 03:40:13 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:13 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:40:13 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:40:13 user nova-compute[75378]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)
Nov 09 03:40:13 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] HCTL ('35', '-', '-', 0) found on session 9 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47e4751-f12e-47ae-bb79-f71d98c0a9b6]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Searching for a device in session 9 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:40:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BetjfVCk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] <== connect_volume: return (1639ms) {'type': 'block', 'scsi_wwn': '23234663962663764', 'path': '/dev/sdd'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234663962663764', 'path': '/dev/sdd'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759562300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759562300',id=12,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLpVVwyl8BqRutcz1Z1rjRkn5KYFVJGHdPuc/qH9BU1+uH8f+QbP8mAj4IQUSMX73qfwGcYvSUGn85uoPNOzXrZVzj/mGJaW0ZnAems0r1+Fr7AoCSWIaeXco1QzQ96A==',key_name='tempest-keypair-2137942302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bff904ec1645bcaa1c5b699b104047',ramdisk_id='',reservation_id='r-0zanfhh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-715356366',owner_user_name='tempest-TaggedBootDevicesTest-715356366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:38:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66fbe37ed9304cecaca00527cff2fcac',uuid=b44da21c-9c44-48d2-865c-85ea2f103a89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "address": "fa:16:3e:c8:1b:52", "network": {"id": "62aa759a-558d-42aa-8910-9709e02e9e1a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1100617011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e8875f-2f", "ovs_interfaceid": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converting VIF {"id": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "address": "fa:16:3e:c8:1b:52", "network": {"id": "62aa759a-558d-42aa-8910-9709e02e9e1a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1100617011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e8875f-2f", "ovs_interfaceid": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:1b:52,bridge_name='br-int',has_traffic_filtering=True,id=81e8875f-2f35-4bc9-ba66-a6140aedeafc,network=Network(62aa759a-558d-42aa-8910-9709e02e9e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e8875f-2f') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759562300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759562300',id=12,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLpVVwyl8BqRutcz1Z1rjRkn5KYFVJGHdPuc/qH9BU1+uH8f+QbP8mAj4IQUSMX73qfwGcYvSUGn85uoPNOzXrZVzj/mGJaW0ZnAems0r1+Fr7AoCSWIaeXco1QzQ96A==',key_name='tempest-keypair-2137942302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bff904ec1645bcaa1c5b699b104047',ramdisk_id='',reservation_id='r-0zanfhh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-715356366',owner_user_name='tempest-TaggedBootDevicesTest-715356366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:38:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66fbe37ed9304cecaca00527cff2fcac',uuid=b44da21c-9c44-48d2-865c-85ea2f103a89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b362041e-0313-42e1-be36-6ad021228d16", "address": "fa:16:3e:2e:52:a1", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362041e-03", "ovs_interfaceid": "b362041e-0313-42e1-be36-6ad021228d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converting VIF {"id": "b362041e-0313-42e1-be36-6ad021228d16", "address": "fa:16:3e:2e:52:a1", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362041e-03", "ovs_interfaceid": "b362041e-0313-42e1-be36-6ad021228d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:52:a1,bridge_name='br-int',has_traffic_filtering=True,id=b362041e-0313-42e1-be36-6ad021228d16,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb362041e-03') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759562300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759562300',id=12,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLpVVwyl8BqRutcz1Z1rjRkn5KYFVJGHdPuc/qH9BU1+uH8f+QbP8mAj4IQUSMX73qfwGcYvSUGn85uoPNOzXrZVzj/mGJaW0ZnAems0r1+Fr7AoCSWIaeXco1QzQ96A==',key_name='tempest-keypair-2137942302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bff904ec1645bcaa1c5b699b104047',ramdisk_id='',reservation_id='r-0zanfhh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-715356366',owner_user_name='tempest-TaggedBootDevicesTest-715356366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:38:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66fbe37ed9304cecaca00527cff2fcac',uuid=b44da21c-9c44-48d2-865c-85ea2f103a89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14de84ce-7772-461d-9b7a-168604176bd3", "address": "fa:16:3e:e4:3c:b4", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14de84ce-77", "ovs_interfaceid": "14de84ce-7772-461d-9b7a-168604176bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converting VIF {"id": "14de84ce-7772-461d-9b7a-168604176bd3", "address": "fa:16:3e:e4:3c:b4", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14de84ce-77", "ovs_interfaceid": "14de84ce-7772-461d-9b7a-168604176bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:3c:b4,bridge_name='br-int',has_traffic_filtering=True,id=14de84ce-7772-461d-9b7a-168604176bd3,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap14de84ce-77') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759562300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759562300',id=12,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLpVVwyl8BqRutcz1Z1rjRkn5KYFVJGHdPuc/qH9BU1+uH8f+QbP8mAj4IQUSMX73qfwGcYvSUGn85uoPNOzXrZVzj/mGJaW0ZnAems0r1+Fr7AoCSWIaeXco1QzQ96A==',key_name='tempest-keypair-2137942302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bff904ec1645bcaa1c5b699b104047',ramdisk_id='',reservation_id='r-0zanfhh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-715356366',owner_user_name='tempest-TaggedBootDevicesTest-715356366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:38:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66fbe37ed9304cecaca00527cff2fcac',uuid=b44da21c-9c44-48d2-865c-85ea2f103a89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "address": "fa:16:3e:bc:00:45", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a068d92-dd", "ovs_interfaceid": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converting VIF {"id": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "address": "fa:16:3e:bc:00:45", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a068d92-dd", "ovs_interfaceid": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:00:45,bridge_name='br-int',has_traffic_filtering=True,id=6a068d92-ddf4-406a-be66-1d4c2bd2b11d,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a068d92-dd') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759562300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759562300',id=12,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLpVVwyl8BqRutcz1Z1rjRkn5KYFVJGHdPuc/qH9BU1+uH8f+QbP8mAj4IQUSMX73qfwGcYvSUGn85uoPNOzXrZVzj/mGJaW0ZnAems0r1+Fr7AoCSWIaeXco1QzQ96A==',key_name='tempest-keypair-2137942302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bff904ec1645bcaa1c5b699b104047',ramdisk_id='',reservation_id='r-0zanfhh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-715356366',owner_user_name='tempest-TaggedBootDevicesTest-715356366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:38:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66fbe37ed9304cecaca00527cff2fcac',uuid=b44da21c-9c44-48d2-865c-85ea2f103a89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "address": "fa:16:3e:88:5d:5c", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf9fd7-4e", "ovs_interfaceid": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converting VIF {"id": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "address": "fa:16:3e:88:5d:5c", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf9fd7-4e", "ovs_interfaceid": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:5d:5c,bridge_name='br-int',has_traffic_filtering=True,id=8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccf9fd7-4e') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759562300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759562300',id=12,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLpVVwyl8BqRutcz1Z1rjRkn5KYFVJGHdPuc/qH9BU1+uH8f+QbP8mAj4IQUSMX73qfwGcYvSUGn85uoPNOzXrZVzj/mGJaW0ZnAems0r1+Fr7AoCSWIaeXco1QzQ96A==',key_name='tempest-keypair-2137942302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bff904ec1645bcaa1c5b699b104047',ramdisk_id='',reservation_id='r-0zanfhh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-715356366',owner_user_name='tempest-TaggedBootDevicesTest-715356366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:38:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66fbe37ed9304cecaca00527cff2fcac',uuid=b44da21c-9c44-48d2-865c-85ea2f103a89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "address": "fa:16:3e:c5:79:79", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d6cece-2c", "ovs_interfaceid": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converting VIF {"id": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "address": "fa:16:3e:c5:79:79", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d6cece-2c", "ovs_interfaceid": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:79:79,bridge_name='br-int',has_traffic_filtering=True,id=68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983,network=Network(891f687a-6a37-4713-a0f0-40baac281590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d6cece-2c') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759562300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759562300',id=12,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLpVVwyl8BqRutcz1Z1rjRkn5KYFVJGHdPuc/qH9BU1+uH8f+QbP8mAj4IQUSMX73qfwGcYvSUGn85uoPNOzXrZVzj/mGJaW0ZnAems0r1+Fr7AoCSWIaeXco1QzQ96A==',key_name='tempest-keypair-2137942302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bff904ec1645bcaa1c5b699b104047',ramdisk_id='',reservation_id='r-0zanfhh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-715356366',owner_user_name='tempest-TaggedBootDevicesTest-715356366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:38:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66fbe37ed9304cecaca00527cff2fcac',uuid=b44da21c-9c44-48d2-865c-85ea2f103a89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27b8914c-2639-4117-86c1-62615361ab73", "address": "fa:16:3e:10:53:c2", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8914c-26", "ovs_interfaceid": "27b8914c-2639-4117-86c1-62615361ab73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converting VIF {"id": "27b8914c-2639-4117-86c1-62615361ab73", "address": "fa:16:3e:10:53:c2", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8914c-26", "ovs_interfaceid": "27b8914c-2639-4117-86c1-62615361ab73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:53:c2,bridge_name='br-int',has_traffic_filtering=True,id=27b8914c-2639-4117-86c1-62615361ab73,network=Network(891f687a-6a37-4713-a0f0-40baac281590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8914c-26') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lazy-loading 'pci_devices' on Instance uuid b44da21c-9c44-48d2-865c-85ea2f103a89 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:40:14 user nova-compute[75378]:   <uuid>b44da21c-9c44-48d2-865c-85ea2f103a89</uuid>
Nov 09 03:40:14 user nova-compute[75378]:   <name>instance-0000000c</name>
Nov 09 03:40:14 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:40:14 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:40:14 user nova-compute[75378]:   <metadata>
Nov 09 03:40:14 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:40:14 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:40:14 user nova-compute[75378]:       <nova:name>tempest-device-tagging-server-759562300</nova:name>
Nov 09 03:40:14 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:40:08</nova:creationTime>
Nov 09 03:40:14 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:40:14 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:40:14 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:40:14 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:40:14 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:40:14 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:40:14 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:40:14 user nova-compute[75378]:       <nova:owner>
Nov 09 03:40:14 user nova-compute[75378]:         <nova:user uuid="66fbe37ed9304cecaca00527cff2fcac">tempest-TaggedBootDevicesTest-715356366-project-member</nova:user>
Nov 09 03:40:14 user nova-compute[75378]:         <nova:project uuid="f0bff904ec1645bcaa1c5b699b104047">tempest-TaggedBootDevicesTest-715356366</nova:project>
Nov 09 03:40:14 user nova-compute[75378]:       </nova:owner>
Nov 09 03:40:14 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:40:14 user nova-compute[75378]:       <nova:ports>
Nov 09 03:40:14 user nova-compute[75378]:         <nova:port uuid="81e8875f-2f35-4bc9-ba66-a6140aedeafc">
Nov 09 03:40:14 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 09 03:40:14 user nova-compute[75378]:         </nova:port>
Nov 09 03:40:14 user nova-compute[75378]:         <nova:port uuid="b362041e-0313-42e1-be36-6ad021228d16">
Nov 09 03:40:14 user nova-compute[75378]:           <nova:ip type="fixed" address="10.1.1.20" ipVersion="4"/>
Nov 09 03:40:14 user nova-compute[75378]:         </nova:port>
Nov 09 03:40:14 user nova-compute[75378]:         <nova:port uuid="14de84ce-7772-461d-9b7a-168604176bd3">
Nov 09 03:40:14 user nova-compute[75378]:           <nova:ip type="fixed" address="10.1.1.34" ipVersion="4"/>
Nov 09 03:40:14 user nova-compute[75378]:         </nova:port>
Nov 09 03:40:14 user nova-compute[75378]:         <nova:port uuid="6a068d92-ddf4-406a-be66-1d4c2bd2b11d">
Nov 09 03:40:14 user nova-compute[75378]:           <nova:ip type="fixed" address="10.1.1.106" ipVersion="4"/>
Nov 09 03:40:14 user nova-compute[75378]:         </nova:port>
Nov 09 03:40:14 user nova-compute[75378]:         <nova:port uuid="8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a">
Nov 09 03:40:14 user nova-compute[75378]:           <nova:ip type="fixed" address="10.1.1.98" ipVersion="4"/>
Nov 09 03:40:14 user nova-compute[75378]:         </nova:port>
Nov 09 03:40:14 user nova-compute[75378]:         <nova:port uuid="68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983">
Nov 09 03:40:14 user nova-compute[75378]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 09 03:40:14 user nova-compute[75378]:         </nova:port>
Nov 09 03:40:14 user nova-compute[75378]:         <nova:port uuid="27b8914c-2639-4117-86c1-62615361ab73">
Nov 09 03:40:14 user nova-compute[75378]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 09 03:40:14 user nova-compute[75378]:         </nova:port>
Nov 09 03:40:14 user nova-compute[75378]:       </nova:ports>
Nov 09 03:40:14 user nova-compute[75378]:     </nova:instance>
Nov 09 03:40:14 user nova-compute[75378]:   </metadata>
Nov 09 03:40:14 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:40:14 user nova-compute[75378]:     <system>
Nov 09 03:40:14 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:40:14 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:40:14 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:40:14 user nova-compute[75378]:       <entry name="serial">b44da21c-9c44-48d2-865c-85ea2f103a89</entry>
Nov 09 03:40:14 user nova-compute[75378]:       <entry name="uuid">b44da21c-9c44-48d2-865c-85ea2f103a89</entry>
Nov 09 03:40:14 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:40:14 user nova-compute[75378]:     </system>
Nov 09 03:40:14 user nova-compute[75378]:   </sysinfo>
Nov 09 03:40:14 user nova-compute[75378]:   <os>
Nov 09 03:40:14 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:40:14 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:40:14 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:40:14 user nova-compute[75378]:   </os>
Nov 09 03:40:14 user nova-compute[75378]:   <features>
Nov 09 03:40:14 user nova-compute[75378]:     <acpi/>
Nov 09 03:40:14 user nova-compute[75378]:     <apic/>
Nov 09 03:40:14 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:40:14 user nova-compute[75378]:   </features>
Nov 09 03:40:14 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:40:14 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:40:14 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:40:14 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:40:14 user nova-compute[75378]:   </clock>
Nov 09 03:40:14 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:40:14 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:40:14 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:40:14 user nova-compute[75378]:   </cpu>
Nov 09 03:40:14 user nova-compute[75378]:   <devices>
Nov 09 03:40:14 user nova-compute[75378]:     <disk type="file" device="cdrom">
Nov 09 03:40:14 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none"/>
Nov 09 03:40:14 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/b44da21c-9c44-48d2-865c-85ea2f103a89/disk.config"/>
Nov 09 03:40:14 user nova-compute[75378]:       <target dev="hda" bus="ide"/>
Nov 09 03:40:14 user nova-compute[75378]:     </disk>
Nov 09 03:40:14 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 03:40:14 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:40:14 user nova-compute[75378]:       <source dev="/dev/sdb"/>
Nov 09 03:40:14 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:40:14 user nova-compute[75378]:       <serial>5a07c2dc-15f0-463e-9fae-97d5ee7626bc</serial>
Nov 09 03:40:14 user nova-compute[75378]:     </disk>
Nov 09 03:40:14 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 03:40:14 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:40:14 user nova-compute[75378]:       <source dev="/dev/sdc"/>
Nov 09 03:40:14 user nova-compute[75378]:       <target dev="vdb" bus="virtio"/>
Nov 09 03:40:14 user nova-compute[75378]:       <serial>d7a0d227-c269-4b71-bd46-114d7c236b66</serial>
Nov 09 03:40:14 user nova-compute[75378]:     </disk>
Nov 09 03:40:14 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 03:40:14 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:40:14 user nova-compute[75378]:       <source dev="/dev/sdd"/>
Nov 09 03:40:14 user nova-compute[75378]:       <target dev="vdc" bus="virtio"/>
Nov 09 03:40:14 user nova-compute[75378]:       <serial>e6a7fe63-54f7-459f-b608-89a2cc39300e</serial>
Nov 09 03:40:14 user nova-compute[75378]:     </disk>
Nov 09 03:40:14 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:40:14 user nova-compute[75378]:       <mac address="fa:16:3e:c8:1b:52"/>
Nov 09 03:40:14 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:40:14 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:40:14 user nova-compute[75378]:       <target dev="tap81e8875f-2f"/>
Nov 09 03:40:14 user nova-compute[75378]:     </interface>
Nov 09 03:40:14 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:40:14 user nova-compute[75378]:       <mac address="fa:16:3e:2e:52:a1"/>
Nov 09 03:40:14 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:40:14 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:40:14 user nova-compute[75378]:       <target dev="tapb362041e-03"/>
Nov 09 03:40:14 user nova-compute[75378]:     </interface>
Nov 09 03:40:14 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:40:14 user nova-compute[75378]:       <mac address="fa:16:3e:e4:3c:b4"/>
Nov 09 03:40:14 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:40:14 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:40:14 user nova-compute[75378]:       <target dev="tap14de84ce-77"/>
Nov 09 03:40:14 user nova-compute[75378]:     </interface>
Nov 09 03:40:14 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:40:14 user nova-compute[75378]:       <mac address="fa:16:3e:bc:00:45"/>
Nov 09 03:40:14 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:40:14 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:40:14 user nova-compute[75378]:       <target dev="tap6a068d92-dd"/>
Nov 09 03:40:14 user nova-compute[75378]:     </interface>
Nov 09 03:40:14 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:40:14 user nova-compute[75378]:       <mac address="fa:16:3e:88:5d:5c"/>
Nov 09 03:40:14 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:40:14 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:40:14 user nova-compute[75378]:       <target dev="tap8ccf9fd7-4e"/>
Nov 09 03:40:14 user nova-compute[75378]:     </interface>
Nov 09 03:40:14 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:40:14 user nova-compute[75378]:       <mac address="fa:16:3e:c5:79:79"/>
Nov 09 03:40:14 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:40:14 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:40:14 user nova-compute[75378]:       <target dev="tap68d6cece-2c"/>
Nov 09 03:40:14 user nova-compute[75378]:     </interface>
Nov 09 03:40:14 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:40:14 user nova-compute[75378]:       <mac address="fa:16:3e:10:53:c2"/>
Nov 09 03:40:14 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:40:14 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:40:14 user nova-compute[75378]:       <target dev="tap27b8914c-26"/>
Nov 09 03:40:14 user nova-compute[75378]:     </interface>
Nov 09 03:40:14 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:40:14 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/b44da21c-9c44-48d2-865c-85ea2f103a89/console.log" append="off"/>
Nov 09 03:40:14 user nova-compute[75378]:     </serial>
Nov 09 03:40:14 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:40:14 user nova-compute[75378]:     <video>
Nov 09 03:40:14 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:40:14 user nova-compute[75378]:     </video>
Nov 09 03:40:14 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:40:14 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:40:14 user nova-compute[75378]:     </rng>
Nov 09 03:40:14 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:40:14 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:40:14 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:40:14 user nova-compute[75378]:     </memballoon>
Nov 09 03:40:14 user nova-compute[75378]:   </devices>
Nov 09 03:40:14 user nova-compute[75378]: </domain>
Nov 09 03:40:14 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759562300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759562300',id=12,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLpVVwyl8BqRutcz1Z1rjRkn5KYFVJGHdPuc/qH9BU1+uH8f+QbP8mAj4IQUSMX73qfwGcYvSUGn85uoPNOzXrZVzj/mGJaW0ZnAems0r1+Fr7AoCSWIaeXco1QzQ96A==',key_name='tempest-keypair-2137942302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bff904ec1645bcaa1c5b699b104047',ramdisk_id='',reservation_id='r-0zanfhh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-715356366',owner_user_name='tempest-TaggedBootDevicesTest-715356366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:38:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66fbe37ed9304cecaca00527cff2fcac',uuid=b44da21c-9c44-48d2-865c-85ea2f103a89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "address": "fa:16:3e:c8:1b:52", "network": {"id": "62aa759a-558d-42aa-8910-9709e02e9e1a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1100617011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e8875f-2f", "ovs_interfaceid": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converting VIF {"id": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "address": "fa:16:3e:c8:1b:52", "network": {"id": "62aa759a-558d-42aa-8910-9709e02e9e1a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1100617011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e8875f-2f", "ovs_interfaceid": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:1b:52,bridge_name='br-int',has_traffic_filtering=True,id=81e8875f-2f35-4bc9-ba66-a6140aedeafc,network=Network(62aa759a-558d-42aa-8910-9709e02e9e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e8875f-2f') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG os_vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:1b:52,bridge_name='br-int',has_traffic_filtering=True,id=81e8875f-2f35-4bc9-ba66-a6140aedeafc,network=Network(62aa759a-558d-42aa-8910-9709e02e9e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e8875f-2f') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7888edc-2af3-5f9d-a87d-20f706358427', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81e8875f-2f, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81e8875f-2f, col_values=(('qos', UUID('fbbebc15-ee9a-4020-930b-dcef9449b203')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81e8875f-2f, col_values=(('external_ids', {'iface-id': '81e8875f-2f35-4bc9-ba66-a6140aedeafc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:1b:52', 'vm-uuid': 'b44da21c-9c44-48d2-865c-85ea2f103a89'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: INFO os_vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:1b:52,bridge_name='br-int',has_traffic_filtering=True,id=81e8875f-2f35-4bc9-ba66-a6140aedeafc,network=Network(62aa759a-558d-42aa-8910-9709e02e9e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e8875f-2f')
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759562300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759562300',id=12,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLpVVwyl8BqRutcz1Z1rjRkn5KYFVJGHdPuc/qH9BU1+uH8f+QbP8mAj4IQUSMX73qfwGcYvSUGn85uoPNOzXrZVzj/mGJaW0ZnAems0r1+Fr7AoCSWIaeXco1QzQ96A==',key_name='tempest-keypair-2137942302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bff904ec1645bcaa1c5b699b104047',ramdisk_id='',reservation_id='r-0zanfhh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-715356366',owner_user_name='tempest-TaggedBootDevicesTest-715356366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:38:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66fbe37ed9304cecaca00527cff2fcac',uuid=b44da21c-9c44-48d2-865c-85ea2f103a89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b362041e-0313-42e1-be36-6ad021228d16", "address": "fa:16:3e:2e:52:a1", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362041e-03", "ovs_interfaceid": "b362041e-0313-42e1-be36-6ad021228d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converting VIF {"id": "b362041e-0313-42e1-be36-6ad021228d16", "address": "fa:16:3e:2e:52:a1", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362041e-03", "ovs_interfaceid": "b362041e-0313-42e1-be36-6ad021228d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:52:a1,bridge_name='br-int',has_traffic_filtering=True,id=b362041e-0313-42e1-be36-6ad021228d16,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb362041e-03') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG os_vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:52:a1,bridge_name='br-int',has_traffic_filtering=True,id=b362041e-0313-42e1-be36-6ad021228d16,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb362041e-03') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00c16bac-ae30-5add-940e-95f96ee95e13', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb362041e-03, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb362041e-03, col_values=(('qos', UUID('d55d31cc-14f1-4dd9-8c43-93df8e32d777')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb362041e-03, col_values=(('external_ids', {'iface-id': 'b362041e-0313-42e1-be36-6ad021228d16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:52:a1', 'vm-uuid': 'b44da21c-9c44-48d2-865c-85ea2f103a89'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: INFO os_vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:52:a1,bridge_name='br-int',has_traffic_filtering=True,id=b362041e-0313-42e1-be36-6ad021228d16,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb362041e-03')
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759562300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759562300',id=12,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLpVVwyl8BqRutcz1Z1rjRkn5KYFVJGHdPuc/qH9BU1+uH8f+QbP8mAj4IQUSMX73qfwGcYvSUGn85uoPNOzXrZVzj/mGJaW0ZnAems0r1+Fr7AoCSWIaeXco1QzQ96A==',key_name='tempest-keypair-2137942302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bff904ec1645bcaa1c5b699b104047',ramdisk_id='',reservation_id='r-0zanfhh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-715356366',owner_user_name='tempest-TaggedBootDevicesTest-715356366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:38:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66fbe37ed9304cecaca00527cff2fcac',uuid=b44da21c-9c44-48d2-865c-85ea2f103a89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14de84ce-7772-461d-9b7a-168604176bd3", "address": "fa:16:3e:e4:3c:b4", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14de84ce-77", "ovs_interfaceid": "14de84ce-7772-461d-9b7a-168604176bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converting VIF {"id": "14de84ce-7772-461d-9b7a-168604176bd3", "address": "fa:16:3e:e4:3c:b4", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14de84ce-77", "ovs_interfaceid": "14de84ce-7772-461d-9b7a-168604176bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:3c:b4,bridge_name='br-int',has_traffic_filtering=True,id=14de84ce-7772-461d-9b7a-168604176bd3,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap14de84ce-77') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG os_vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:3c:b4,bridge_name='br-int',has_traffic_filtering=True,id=14de84ce-7772-461d-9b7a-168604176bd3,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap14de84ce-77') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3aa1e69b-d2db-594b-a5a9-b8fb2e17489d', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14de84ce-77, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap14de84ce-77, col_values=(('qos', UUID('3c71270c-abd6-4e23-872e-48503c78e677')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap14de84ce-77, col_values=(('external_ids', {'iface-id': '14de84ce-7772-461d-9b7a-168604176bd3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:3c:b4', 'vm-uuid': 'b44da21c-9c44-48d2-865c-85ea2f103a89'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: INFO os_vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:3c:b4,bridge_name='br-int',has_traffic_filtering=True,id=14de84ce-7772-461d-9b7a-168604176bd3,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap14de84ce-77')
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759562300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759562300',id=12,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLpVVwyl8BqRutcz1Z1rjRkn5KYFVJGHdPuc/qH9BU1+uH8f+QbP8mAj4IQUSMX73qfwGcYvSUGn85uoPNOzXrZVzj/mGJaW0ZnAems0r1+Fr7AoCSWIaeXco1QzQ96A==',key_name='tempest-keypair-2137942302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bff904ec1645bcaa1c5b699b104047',ramdisk_id='',reservation_id='r-0zanfhh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-715356366',owner_user_name='tempest-TaggedBootDevicesTest-715356366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:38:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66fbe37ed9304cecaca00527cff2fcac',uuid=b44da21c-9c44-48d2-865c-85ea2f103a89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "address": "fa:16:3e:bc:00:45", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a068d92-dd", "ovs_interfaceid": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converting VIF {"id": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "address": "fa:16:3e:bc:00:45", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a068d92-dd", "ovs_interfaceid": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:00:45,bridge_name='br-int',has_traffic_filtering=True,id=6a068d92-ddf4-406a-be66-1d4c2bd2b11d,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a068d92-dd') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG os_vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:00:45,bridge_name='br-int',has_traffic_filtering=True,id=6a068d92-ddf4-406a-be66-1d4c2bd2b11d,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a068d92-dd') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b260d050-75a0-5d27-941a-36daf59d863f', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a068d92-dd, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a068d92-dd, col_values=(('qos', UUID('f974eb76-d0f1-4129-b06c-d517eee46226')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a068d92-dd, col_values=(('external_ids', {'iface-id': '6a068d92-ddf4-406a-be66-1d4c2bd2b11d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:00:45', 'vm-uuid': 'b44da21c-9c44-48d2-865c-85ea2f103a89'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: INFO os_vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:00:45,bridge_name='br-int',has_traffic_filtering=True,id=6a068d92-ddf4-406a-be66-1d4c2bd2b11d,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a068d92-dd')
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759562300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759562300',id=12,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLpVVwyl8BqRutcz1Z1rjRkn5KYFVJGHdPuc/qH9BU1+uH8f+QbP8mAj4IQUSMX73qfwGcYvSUGn85uoPNOzXrZVzj/mGJaW0ZnAems0r1+Fr7AoCSWIaeXco1QzQ96A==',key_name='tempest-keypair-2137942302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bff904ec1645bcaa1c5b699b104047',ramdisk_id='',reservation_id='r-0zanfhh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-715356366',owner_user_name='tempest-TaggedBootDevicesTest-715356366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:38:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66fbe37ed9304cecaca00527cff2fcac',uuid=b44da21c-9c44-48d2-865c-85ea2f103a89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "address": "fa:16:3e:88:5d:5c", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf9fd7-4e", "ovs_interfaceid": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converting VIF {"id": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "address": "fa:16:3e:88:5d:5c", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf9fd7-4e", "ovs_interfaceid": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:5d:5c,bridge_name='br-int',has_traffic_filtering=True,id=8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccf9fd7-4e') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG os_vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:5d:5c,bridge_name='br-int',has_traffic_filtering=True,id=8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccf9fd7-4e') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ccdd15e-adfa-5e90-a392-c81582ad8e32', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ccf9fd7-4e, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ccf9fd7-4e, col_values=(('qos', UUID('6a975d50-7623-49d7-9221-9f0fef557100')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ccf9fd7-4e, col_values=(('external_ids', {'iface-id': '8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:5d:5c', 'vm-uuid': 'b44da21c-9c44-48d2-865c-85ea2f103a89'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: INFO os_vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:5d:5c,bridge_name='br-int',has_traffic_filtering=True,id=8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccf9fd7-4e')
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759562300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759562300',id=12,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLpVVwyl8BqRutcz1Z1rjRkn5KYFVJGHdPuc/qH9BU1+uH8f+QbP8mAj4IQUSMX73qfwGcYvSUGn85uoPNOzXrZVzj/mGJaW0ZnAems0r1+Fr7AoCSWIaeXco1QzQ96A==',key_name='tempest-keypair-2137942302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bff904ec1645bcaa1c5b699b104047',ramdisk_id='',reservation_id='r-0zanfhh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-715356366',owner_user_name='tempest-TaggedBootDevicesTest-715356366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:38:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66fbe37ed9304cecaca00527cff2fcac',uuid=b44da21c-9c44-48d2-865c-85ea2f103a89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "address": "fa:16:3e:c5:79:79", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d6cece-2c", "ovs_interfaceid": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converting VIF {"id": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "address": "fa:16:3e:c5:79:79", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d6cece-2c", "ovs_interfaceid": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:79:79,bridge_name='br-int',has_traffic_filtering=True,id=68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983,network=Network(891f687a-6a37-4713-a0f0-40baac281590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d6cece-2c') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG os_vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:79:79,bridge_name='br-int',has_traffic_filtering=True,id=68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983,network=Network(891f687a-6a37-4713-a0f0-40baac281590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d6cece-2c') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a48f129-6a1d-5b66-9d1d-1cc4bcad3628', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68d6cece-2c, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68d6cece-2c, col_values=(('qos', UUID('71b3b1ce-6f72-47cc-b894-24daeb08254b')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68d6cece-2c, col_values=(('external_ids', {'iface-id': '68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:79:79', 'vm-uuid': 'b44da21c-9c44-48d2-865c-85ea2f103a89'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: INFO os_vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:79:79,bridge_name='br-int',has_traffic_filtering=True,id=68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983,network=Network(891f687a-6a37-4713-a0f0-40baac281590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d6cece-2c')
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759562300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759562300',id=12,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLpVVwyl8BqRutcz1Z1rjRkn5KYFVJGHdPuc/qH9BU1+uH8f+QbP8mAj4IQUSMX73qfwGcYvSUGn85uoPNOzXrZVzj/mGJaW0ZnAems0r1+Fr7AoCSWIaeXco1QzQ96A==',key_name='tempest-keypair-2137942302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0bff904ec1645bcaa1c5b699b104047',ramdisk_id='',reservation_id='r-0zanfhh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-715356366',owner_user_name='tempest-TaggedBootDevicesTest-715356366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:38:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66fbe37ed9304cecaca00527cff2fcac',uuid=b44da21c-9c44-48d2-865c-85ea2f103a89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27b8914c-2639-4117-86c1-62615361ab73", "address": "fa:16:3e:10:53:c2", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8914c-26", "ovs_interfaceid": "27b8914c-2639-4117-86c1-62615361ab73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converting VIF {"id": "27b8914c-2639-4117-86c1-62615361ab73", "address": "fa:16:3e:10:53:c2", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8914c-26", "ovs_interfaceid": "27b8914c-2639-4117-86c1-62615361ab73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:53:c2,bridge_name='br-int',has_traffic_filtering=True,id=27b8914c-2639-4117-86c1-62615361ab73,network=Network(891f687a-6a37-4713-a0f0-40baac281590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8914c-26') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG os_vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:53:c2,bridge_name='br-int',has_traffic_filtering=True,id=27b8914c-2639-4117-86c1-62615361ab73,network=Network(891f687a-6a37-4713-a0f0-40baac281590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8914c-26') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bed32f65-7ef4-5860-a201-75abc10ed102', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27b8914c-26, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27b8914c-26, col_values=(('qos', UUID('41aa7a62-7fcf-47f3-8567-5bf1d59eabae')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27b8914c-26, col_values=(('external_ids', {'iface-id': '27b8914c-2639-4117-86c1-62615361ab73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:53:c2', 'vm-uuid': 'b44da21c-9c44-48d2-865c-85ea2f103a89'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:15 user nova-compute[75378]: INFO os_vif [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:53:c2,bridge_name='br-int',has_traffic_filtering=True,id=27b8914c-2639-4117-86c1-62615361ab73,network=Network(891f687a-6a37-4713-a0f0-40baac281590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8914c-26')
Nov 09 03:40:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] No BDM found with device name hda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:40:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:40:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] No VIF found with MAC fa:16:3e:c8:1b:52, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:40:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] No VIF found with MAC fa:16:3e:88:5d:5c, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:40:15 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Using config drive
Nov 09 03:40:15 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Creating config drive at /opt/stack/data/nova/instances/b44da21c-9c44-48d2-865c-85ea2f103a89/disk.config
Nov 09 03:40:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b44da21c-9c44-48d2-865c-85ea2f103a89/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2ivk231z {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b44da21c-9c44-48d2-865c-85ea2f103a89/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2ivk231z" returned: 0 in 0.169s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:16 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:40:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Acquiring lock "176d35dc-6397-4204-b0d3-0d27e3f967c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Lock "176d35dc-6397-4204-b0d3-0d27e3f967c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Acquiring lock "176d35dc-6397-4204-b0d3-0d27e3f967c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Lock "176d35dc-6397-4204-b0d3-0d27e3f967c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Lock "176d35dc-6397-4204-b0d3-0d27e3f967c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:16 user nova-compute[75378]: INFO nova.compute.manager [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Terminating instance
Nov 09 03:40:16 user nova-compute[75378]: DEBUG nova.compute.manager [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:40:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-d236763d-09ae-4290-9642-841793177051 req-e56750d8-d674-4c5c-a7f7-c9ee377d9595 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-plugged-81e8875f-2f35-4bc9-ba66-a6140aedeafc {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d236763d-09ae-4290-9642-841793177051 req-e56750d8-d674-4c5c-a7f7-c9ee377d9595 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d236763d-09ae-4290-9642-841793177051 req-e56750d8-d674-4c5c-a7f7-c9ee377d9595 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d236763d-09ae-4290-9642-841793177051 req-e56750d8-d674-4c5c-a7f7-c9ee377d9595 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-d236763d-09ae-4290-9642-841793177051 req-e56750d8-d674-4c5c-a7f7-c9ee377d9595 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-plugged-81e8875f-2f35-4bc9-ba66-a6140aedeafc {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:17 user nova-compute[75378]: WARNING nova.compute.manager [req-d236763d-09ae-4290-9642-841793177051 req-e56750d8-d674-4c5c-a7f7-c9ee377d9595 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received unexpected event network-vif-plugged-81e8875f-2f35-4bc9-ba66-a6140aedeafc for instance with vm_state building and task_state spawning.
Nov 09 03:40:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-0d4a5eb4-dd44-47cf-b77d-8cdd35ae4089 req-a0357a22-70a0-409a-8ee0-e6139065d8d8 service nova] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Received event network-vif-unplugged-42cf6872-3077-4c5f-bc01-e0febdfd36e7 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0d4a5eb4-dd44-47cf-b77d-8cdd35ae4089 req-a0357a22-70a0-409a-8ee0-e6139065d8d8 service nova] Acquiring lock "176d35dc-6397-4204-b0d3-0d27e3f967c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0d4a5eb4-dd44-47cf-b77d-8cdd35ae4089 req-a0357a22-70a0-409a-8ee0-e6139065d8d8 service nova] Lock "176d35dc-6397-4204-b0d3-0d27e3f967c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0d4a5eb4-dd44-47cf-b77d-8cdd35ae4089 req-a0357a22-70a0-409a-8ee0-e6139065d8d8 service nova] Lock "176d35dc-6397-4204-b0d3-0d27e3f967c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-0d4a5eb4-dd44-47cf-b77d-8cdd35ae4089 req-a0357a22-70a0-409a-8ee0-e6139065d8d8 service nova] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] No waiting events found dispatching network-vif-unplugged-42cf6872-3077-4c5f-bc01-e0febdfd36e7 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-0d4a5eb4-dd44-47cf-b77d-8cdd35ae4089 req-a0357a22-70a0-409a-8ee0-e6139065d8d8 service nova] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Received event network-vif-unplugged-42cf6872-3077-4c5f-bc01-e0febdfd36e7 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG nova.objects.instance [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lazy-loading 'flavor' on Instance uuid 1fb5f90d-3d22-474d-947d-f939fa150f3f {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d9ec46d8-cfb1-4035-813e-4b1b662d0382 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "1fb5f90d-3d22-474d-947d-f939fa150f3f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.242s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG nova.compute.manager [req-20437ded-50ad-48d9-926e-0719d1dc5b4d req-51c4bd70-b24b-4ee3-8eef-9e2f7f31b2e6 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-plugged-14de84ce-7772-461d-9b7a-168604176bd3 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-20437ded-50ad-48d9-926e-0719d1dc5b4d req-51c4bd70-b24b-4ee3-8eef-9e2f7f31b2e6 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-20437ded-50ad-48d9-926e-0719d1dc5b4d req-51c4bd70-b24b-4ee3-8eef-9e2f7f31b2e6 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-20437ded-50ad-48d9-926e-0719d1dc5b4d req-51c4bd70-b24b-4ee3-8eef-9e2f7f31b2e6 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG nova.compute.manager [req-20437ded-50ad-48d9-926e-0719d1dc5b4d req-51c4bd70-b24b-4ee3-8eef-9e2f7f31b2e6 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-plugged-14de84ce-7772-461d-9b7a-168604176bd3 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:18 user nova-compute[75378]: WARNING nova.compute.manager [req-20437ded-50ad-48d9-926e-0719d1dc5b4d req-51c4bd70-b24b-4ee3-8eef-9e2f7f31b2e6 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received unexpected event network-vif-plugged-14de84ce-7772-461d-9b7a-168604176bd3 for instance with vm_state building and task_state spawning.
Nov 09 03:40:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:18 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Instance destroyed successfully.
Nov 09 03:40:18 user nova-compute[75378]: DEBUG nova.objects.instance [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Lazy-loading 'resources' on Instance uuid 176d35dc-6397-4204-b0d3-0d27e3f967c6 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:37:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1329497690',display_name='tempest-VolumesActionsTest-instance-1329497690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1329497690',id=10,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:37:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44b08d524fe04e6eb949e0b25f8c483f',ramdisk_id='',reservation_id='r-q3ieyhqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-718476384',owner_user_name='tempest-VolumesActionsTest-718476384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:37:49Z,user_data=None,user_id='1046eb511add4fe5b474933ffcbea7b3',uuid=176d35dc-6397-4204-b0d3-0d27e3f967c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42cf6872-3077-4c5f-bc01-e0febdfd36e7", "address": "fa:16:3e:3c:8b:c9", "network": {"id": "ad335810-bbf2-489c-9e66-40066b1bf82e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-844539655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b08d524fe04e6eb949e0b25f8c483f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cf6872-30", "ovs_interfaceid": "42cf6872-3077-4c5f-bc01-e0febdfd36e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Converting VIF {"id": "42cf6872-3077-4c5f-bc01-e0febdfd36e7", "address": "fa:16:3e:3c:8b:c9", "network": {"id": "ad335810-bbf2-489c-9e66-40066b1bf82e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-844539655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44b08d524fe04e6eb949e0b25f8c483f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cf6872-30", "ovs_interfaceid": "42cf6872-3077-4c5f-bc01-e0febdfd36e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:8b:c9,bridge_name='br-int',has_traffic_filtering=True,id=42cf6872-3077-4c5f-bc01-e0febdfd36e7,network=Network(ad335810-bbf2-489c-9e66-40066b1bf82e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42cf6872-30') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG os_vif [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:8b:c9,bridge_name='br-int',has_traffic_filtering=True,id=42cf6872-3077-4c5f-bc01-e0febdfd36e7,network=Network(ad335810-bbf2-489c-9e66-40066b1bf82e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42cf6872-30') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42cf6872-30, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2dbaeffb-eec7-4172-8106-8f1e5dda3d8c) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:18 user nova-compute[75378]: INFO os_vif [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:8b:c9,bridge_name='br-int',has_traffic_filtering=True,id=42cf6872-3077-4c5f-bc01-e0febdfd36e7,network=Network(ad335810-bbf2-489c-9e66-40066b1bf82e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42cf6872-30')
Nov 09 03:40:18 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Deleting instance files /opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6_del
Nov 09 03:40:18 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Deletion of /opt/stack/data/nova/instances/176d35dc-6397-4204-b0d3-0d27e3f967c6_del complete
Nov 09 03:40:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Acquiring lock "1fb5f90d-3d22-474d-947d-f939fa150f3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "1fb5f90d-3d22-474d-947d-f939fa150f3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Acquiring lock "1fb5f90d-3d22-474d-947d-f939fa150f3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "1fb5f90d-3d22-474d-947d-f939fa150f3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "1fb5f90d-3d22-474d-947d-f939fa150f3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:18 user nova-compute[75378]: INFO nova.compute.manager [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Terminating instance
Nov 09 03:40:18 user nova-compute[75378]: DEBUG nova.compute.manager [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:40:18 user nova-compute[75378]: INFO nova.compute.manager [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Took 1.75 seconds to destroy the instance on the hypervisor.
Nov 09 03:40:18 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-b6ad20e3-234d-465d-937b-f2f929cd7a8b req-46915353-43d8-418b-bba4-209999f57585 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-plugged-81e8875f-2f35-4bc9-ba66-a6140aedeafc {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b6ad20e3-234d-465d-937b-f2f929cd7a8b req-46915353-43d8-418b-bba4-209999f57585 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b6ad20e3-234d-465d-937b-f2f929cd7a8b req-46915353-43d8-418b-bba4-209999f57585 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b6ad20e3-234d-465d-937b-f2f929cd7a8b req-46915353-43d8-418b-bba4-209999f57585 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-b6ad20e3-234d-465d-937b-f2f929cd7a8b req-46915353-43d8-418b-bba4-209999f57585 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-plugged-81e8875f-2f35-4bc9-ba66-a6140aedeafc {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:19 user nova-compute[75378]: WARNING nova.compute.manager [req-b6ad20e3-234d-465d-937b-f2f929cd7a8b req-46915353-43d8-418b-bba4-209999f57585 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received unexpected event network-vif-plugged-81e8875f-2f35-4bc9-ba66-a6140aedeafc for instance with vm_state building and task_state spawning.
Nov 09 03:40:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-b6ad20e3-234d-465d-937b-f2f929cd7a8b req-46915353-43d8-418b-bba4-209999f57585 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-plugged-6a068d92-ddf4-406a-be66-1d4c2bd2b11d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b6ad20e3-234d-465d-937b-f2f929cd7a8b req-46915353-43d8-418b-bba4-209999f57585 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b6ad20e3-234d-465d-937b-f2f929cd7a8b req-46915353-43d8-418b-bba4-209999f57585 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b6ad20e3-234d-465d-937b-f2f929cd7a8b req-46915353-43d8-418b-bba4-209999f57585 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-b6ad20e3-234d-465d-937b-f2f929cd7a8b req-46915353-43d8-418b-bba4-209999f57585 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-plugged-6a068d92-ddf4-406a-be66-1d4c2bd2b11d {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:19 user nova-compute[75378]: WARNING nova.compute.manager [req-b6ad20e3-234d-465d-937b-f2f929cd7a8b req-46915353-43d8-418b-bba4-209999f57585 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received unexpected event network-vif-plugged-6a068d92-ddf4-406a-be66-1d4c2bd2b11d for instance with vm_state building and task_state spawning.
Nov 09 03:40:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-b6ad20e3-234d-465d-937b-f2f929cd7a8b req-46915353-43d8-418b-bba4-209999f57585 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-plugged-6a068d92-ddf4-406a-be66-1d4c2bd2b11d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b6ad20e3-234d-465d-937b-f2f929cd7a8b req-46915353-43d8-418b-bba4-209999f57585 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b6ad20e3-234d-465d-937b-f2f929cd7a8b req-46915353-43d8-418b-bba4-209999f57585 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b6ad20e3-234d-465d-937b-f2f929cd7a8b req-46915353-43d8-418b-bba4-209999f57585 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-b6ad20e3-234d-465d-937b-f2f929cd7a8b req-46915353-43d8-418b-bba4-209999f57585 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-plugged-6a068d92-ddf4-406a-be66-1d4c2bd2b11d {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:19 user nova-compute[75378]: WARNING nova.compute.manager [req-b6ad20e3-234d-465d-937b-f2f929cd7a8b req-46915353-43d8-418b-bba4-209999f57585 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received unexpected event network-vif-plugged-6a068d92-ddf4-406a-be66-1d4c2bd2b11d for instance with vm_state building and task_state spawning.
Nov 09 03:40:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Received event network-vif-plugged-42cf6872-3077-4c5f-bc01-e0febdfd36e7 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] Acquiring lock "176d35dc-6397-4204-b0d3-0d27e3f967c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] Lock "176d35dc-6397-4204-b0d3-0d27e3f967c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] Lock "176d35dc-6397-4204-b0d3-0d27e3f967c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] No waiting events found dispatching network-vif-plugged-42cf6872-3077-4c5f-bc01-e0febdfd36e7 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:19 user nova-compute[75378]: WARNING nova.compute.manager [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Received unexpected event network-vif-plugged-42cf6872-3077-4c5f-bc01-e0febdfd36e7 for instance with vm_state active and task_state deleting.
Nov 09 03:40:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-plugged-b362041e-0313-42e1-be36-6ad021228d16 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-plugged-b362041e-0313-42e1-be36-6ad021228d16 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:19 user nova-compute[75378]: WARNING nova.compute.manager [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received unexpected event network-vif-plugged-b362041e-0313-42e1-be36-6ad021228d16 for instance with vm_state building and task_state spawning.
Nov 09 03:40:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-plugged-b362041e-0313-42e1-be36-6ad021228d16 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-plugged-b362041e-0313-42e1-be36-6ad021228d16 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:19 user nova-compute[75378]: WARNING nova.compute.manager [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received unexpected event network-vif-plugged-b362041e-0313-42e1-be36-6ad021228d16 for instance with vm_state building and task_state spawning.
Nov 09 03:40:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Received event network-vif-unplugged-db537bed-b0bc-4295-af53-4fc336c45675 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] Acquiring lock "1fb5f90d-3d22-474d-947d-f939fa150f3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] Lock "1fb5f90d-3d22-474d-947d-f939fa150f3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] Lock "1fb5f90d-3d22-474d-947d-f939fa150f3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] No waiting events found dispatching network-vif-unplugged-db537bed-b0bc-4295-af53-4fc336c45675 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Received event network-vif-unplugged-db537bed-b0bc-4295-af53-4fc336c45675 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Received event network-vif-plugged-db537bed-b0bc-4295-af53-4fc336c45675 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] Acquiring lock "1fb5f90d-3d22-474d-947d-f939fa150f3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] Lock "1fb5f90d-3d22-474d-947d-f939fa150f3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] Lock "1fb5f90d-3d22-474d-947d-f939fa150f3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] No waiting events found dispatching network-vif-plugged-db537bed-b0bc-4295-af53-4fc336c45675 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:19 user nova-compute[75378]: WARNING nova.compute.manager [req-7eb9d3c2-8b8e-4a8e-9abf-54dd8fa029cd req-2c51c7ee-4cd6-4bf8-84d2-a8963dfc1b29 service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Received unexpected event network-vif-plugged-db537bed-b0bc-4295-af53-4fc336c45675 for instance with vm_state active and task_state deleting.
Nov 09 03:40:19 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:40:19 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Took 1.02 seconds to deallocate network for instance.
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:20 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Instance destroyed successfully.
Nov 09 03:40:20 user nova-compute[75378]: DEBUG nova.objects.instance [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lazy-loading 'resources' on Instance uuid 1fb5f90d-3d22-474d-947d-f939fa150f3f {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:36:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1488682605',display_name='tempest-AttachSCSIVolumeTestJSON-server-1488682605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1488682605',id=7,image_ref='360e2ba6-50f3-41c0-9228-6c814915c8d6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjKqxvnzbpvtEoLi4XzsXY7P5jPG9kSkT2NxZCP3vVk8E5pCIeaFhjuY7OpRVb0cM0aQpUndYBoVPASBAe7SsXXvWR7AaNYI3uOQ0JU7LmSmr3r8aSmgeJOq27B9wS2Cw==',key_name='tempest-keypair-550667506',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:37:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8db95eb923b64757988e524ce4e89dc0',ramdisk_id='',reservation_id='r-72jum4bj',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='360e2ba6-50f3-41c0-9228-6c814915c8d6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1066171224',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1066171224-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:37:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8ed2cec9cb74b03bff46c13a22ed9ff',uuid=1fb5f90d-3d22-474d-947d-f939fa150f3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db537bed-b0bc-4295-af53-4fc336c45675", "address": "fa:16:3e:ef:6c:72", "network": {"id": "14e65d53-261f-4171-bb08-63e3da53c090", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1182321126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db95eb923b64757988e524ce4e89dc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb537bed-b0", "ovs_interfaceid": "db537bed-b0bc-4295-af53-4fc336c45675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Converting VIF {"id": "db537bed-b0bc-4295-af53-4fc336c45675", "address": "fa:16:3e:ef:6c:72", "network": {"id": "14e65d53-261f-4171-bb08-63e3da53c090", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1182321126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8db95eb923b64757988e524ce4e89dc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb537bed-b0", "ovs_interfaceid": "db537bed-b0bc-4295-af53-4fc336c45675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:6c:72,bridge_name='br-int',has_traffic_filtering=True,id=db537bed-b0bc-4295-af53-4fc336c45675,network=Network(14e65d53-261f-4171-bb08-63e3da53c090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb537bed-b0') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG os_vif [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:6c:72,bridge_name='br-int',has_traffic_filtering=True,id=db537bed-b0bc-4295-af53-4fc336c45675,network=Network(14e65d53-261f-4171-bb08-63e3da53c090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb537bed-b0') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb537bed-b0, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a50f960-5ca8-41b9-937a-1d4234fc601c) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:20 user nova-compute[75378]: INFO os_vif [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:6c:72,bridge_name='br-int',has_traffic_filtering=True,id=db537bed-b0bc-4295-af53-4fc336c45675,network=Network(14e65d53-261f-4171-bb08-63e3da53c090),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb537bed-b0')
Nov 09 03:40:20 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Deleting instance files /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f_del
Nov 09 03:40:20 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Deletion of /opt/stack/data/nova/instances/1fb5f90d-3d22-474d-947d-f939fa150f3f_del complete
Nov 09 03:40:20 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG nova.compute.manager [req-18e640c2-1f12-4b5c-90d8-6ce32276853e req-6940cd77-8f52-4564-87b9-305ebb0ddd64 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-plugged-14de84ce-7772-461d-9b7a-168604176bd3 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-18e640c2-1f12-4b5c-90d8-6ce32276853e req-6940cd77-8f52-4564-87b9-305ebb0ddd64 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-18e640c2-1f12-4b5c-90d8-6ce32276853e req-6940cd77-8f52-4564-87b9-305ebb0ddd64 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-18e640c2-1f12-4b5c-90d8-6ce32276853e req-6940cd77-8f52-4564-87b9-305ebb0ddd64 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG nova.compute.manager [req-18e640c2-1f12-4b5c-90d8-6ce32276853e req-6940cd77-8f52-4564-87b9-305ebb0ddd64 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-plugged-14de84ce-7772-461d-9b7a-168604176bd3 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:20 user nova-compute[75378]: WARNING nova.compute.manager [req-18e640c2-1f12-4b5c-90d8-6ce32276853e req-6940cd77-8f52-4564-87b9-305ebb0ddd64 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received unexpected event network-vif-plugged-14de84ce-7772-461d-9b7a-168604176bd3 for instance with vm_state building and task_state spawning.
Nov 09 03:40:20 user nova-compute[75378]: DEBUG nova.compute.manager [req-18e640c2-1f12-4b5c-90d8-6ce32276853e req-6940cd77-8f52-4564-87b9-305ebb0ddd64 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-plugged-68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-18e640c2-1f12-4b5c-90d8-6ce32276853e req-6940cd77-8f52-4564-87b9-305ebb0ddd64 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-18e640c2-1f12-4b5c-90d8-6ce32276853e req-6940cd77-8f52-4564-87b9-305ebb0ddd64 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-18e640c2-1f12-4b5c-90d8-6ce32276853e req-6940cd77-8f52-4564-87b9-305ebb0ddd64 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG nova.compute.manager [req-18e640c2-1f12-4b5c-90d8-6ce32276853e req-6940cd77-8f52-4564-87b9-305ebb0ddd64 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-plugged-68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:20 user nova-compute[75378]: WARNING nova.compute.manager [req-18e640c2-1f12-4b5c-90d8-6ce32276853e req-6940cd77-8f52-4564-87b9-305ebb0ddd64 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received unexpected event network-vif-plugged-68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983 for instance with vm_state building and task_state spawning.
Nov 09 03:40:20 user nova-compute[75378]: DEBUG nova.compute.manager [req-18e640c2-1f12-4b5c-90d8-6ce32276853e req-6940cd77-8f52-4564-87b9-305ebb0ddd64 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-plugged-68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-18e640c2-1f12-4b5c-90d8-6ce32276853e req-6940cd77-8f52-4564-87b9-305ebb0ddd64 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-18e640c2-1f12-4b5c-90d8-6ce32276853e req-6940cd77-8f52-4564-87b9-305ebb0ddd64 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-18e640c2-1f12-4b5c-90d8-6ce32276853e req-6940cd77-8f52-4564-87b9-305ebb0ddd64 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG nova.compute.manager [req-18e640c2-1f12-4b5c-90d8-6ce32276853e req-6940cd77-8f52-4564-87b9-305ebb0ddd64 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-plugged-68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:20 user nova-compute[75378]: WARNING nova.compute.manager [req-18e640c2-1f12-4b5c-90d8-6ce32276853e req-6940cd77-8f52-4564-87b9-305ebb0ddd64 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received unexpected event network-vif-plugged-68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983 for instance with vm_state building and task_state spawning.
Nov 09 03:40:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:20 user nova-compute[75378]: INFO nova.compute.manager [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Took 1.76 seconds to destroy the instance on the hypervisor.
Nov 09 03:40:20 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.724s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:20 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Deleted allocations for instance 176d35dc-6397-4204-b0d3-0d27e3f967c6
Nov 09 03:40:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-117ded61-81e2-45ca-970f-80c6802bfa19 tempest-VolumesActionsTest-718476384 tempest-VolumesActionsTest-718476384-project-member] Lock "176d35dc-6397-4204-b0d3-0d27e3f967c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.773s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG nova.compute.manager [req-d5d2b1ce-9629-45f5-91ef-d21ec51693a0 req-21c2b0bb-7049-459c-8f7a-b55c41e8bdd0 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-plugged-27b8914c-2639-4117-86c1-62615361ab73 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d5d2b1ce-9629-45f5-91ef-d21ec51693a0 req-21c2b0bb-7049-459c-8f7a-b55c41e8bdd0 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d5d2b1ce-9629-45f5-91ef-d21ec51693a0 req-21c2b0bb-7049-459c-8f7a-b55c41e8bdd0 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d5d2b1ce-9629-45f5-91ef-d21ec51693a0 req-21c2b0bb-7049-459c-8f7a-b55c41e8bdd0 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG nova.compute.manager [req-d5d2b1ce-9629-45f5-91ef-d21ec51693a0 req-21c2b0bb-7049-459c-8f7a-b55c41e8bdd0 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-plugged-27b8914c-2639-4117-86c1-62615361ab73 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:21 user nova-compute[75378]: WARNING nova.compute.manager [req-d5d2b1ce-9629-45f5-91ef-d21ec51693a0 req-21c2b0bb-7049-459c-8f7a-b55c41e8bdd0 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received unexpected event network-vif-plugged-27b8914c-2639-4117-86c1-62615361ab73 for instance with vm_state building and task_state spawning.
Nov 09 03:40:21 user nova-compute[75378]: DEBUG nova.compute.manager [req-d5d2b1ce-9629-45f5-91ef-d21ec51693a0 req-21c2b0bb-7049-459c-8f7a-b55c41e8bdd0 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-plugged-27b8914c-2639-4117-86c1-62615361ab73 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d5d2b1ce-9629-45f5-91ef-d21ec51693a0 req-21c2b0bb-7049-459c-8f7a-b55c41e8bdd0 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d5d2b1ce-9629-45f5-91ef-d21ec51693a0 req-21c2b0bb-7049-459c-8f7a-b55c41e8bdd0 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d5d2b1ce-9629-45f5-91ef-d21ec51693a0 req-21c2b0bb-7049-459c-8f7a-b55c41e8bdd0 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG nova.compute.manager [req-d5d2b1ce-9629-45f5-91ef-d21ec51693a0 req-21c2b0bb-7049-459c-8f7a-b55c41e8bdd0 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-plugged-27b8914c-2639-4117-86c1-62615361ab73 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:21 user nova-compute[75378]: WARNING nova.compute.manager [req-d5d2b1ce-9629-45f5-91ef-d21ec51693a0 req-21c2b0bb-7049-459c-8f7a-b55c41e8bdd0 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received unexpected event network-vif-plugged-27b8914c-2639-4117-86c1-62615361ab73 for instance with vm_state building and task_state spawning.
Nov 09 03:40:21 user nova-compute[75378]: DEBUG nova.compute.manager [req-4b925838-d212-4fce-8ff8-474e8dff89c1 req-a3d4cad4-9076-44d1-8aa7-aa2ded52377a service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-plugged-8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4b925838-d212-4fce-8ff8-474e8dff89c1 req-a3d4cad4-9076-44d1-8aa7-aa2ded52377a service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4b925838-d212-4fce-8ff8-474e8dff89c1 req-a3d4cad4-9076-44d1-8aa7-aa2ded52377a service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4b925838-d212-4fce-8ff8-474e8dff89c1 req-a3d4cad4-9076-44d1-8aa7-aa2ded52377a service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG nova.compute.manager [req-4b925838-d212-4fce-8ff8-474e8dff89c1 req-a3d4cad4-9076-44d1-8aa7-aa2ded52377a service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-plugged-8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:21 user nova-compute[75378]: WARNING nova.compute.manager [req-4b925838-d212-4fce-8ff8-474e8dff89c1 req-a3d4cad4-9076-44d1-8aa7-aa2ded52377a service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received unexpected event network-vif-plugged-8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a for instance with vm_state building and task_state spawning.
Nov 09 03:40:21 user nova-compute[75378]: DEBUG nova.compute.manager [req-4b925838-d212-4fce-8ff8-474e8dff89c1 req-a3d4cad4-9076-44d1-8aa7-aa2ded52377a service nova] [instance: 176d35dc-6397-4204-b0d3-0d27e3f967c6] Received event network-vif-deleted-42cf6872-3077-4c5f-bc01-e0febdfd36e7 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG nova.compute.manager [req-4b925838-d212-4fce-8ff8-474e8dff89c1 req-a3d4cad4-9076-44d1-8aa7-aa2ded52377a service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-plugged-8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4b925838-d212-4fce-8ff8-474e8dff89c1 req-a3d4cad4-9076-44d1-8aa7-aa2ded52377a service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4b925838-d212-4fce-8ff8-474e8dff89c1 req-a3d4cad4-9076-44d1-8aa7-aa2ded52377a service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4b925838-d212-4fce-8ff8-474e8dff89c1 req-a3d4cad4-9076-44d1-8aa7-aa2ded52377a service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG nova.compute.manager [req-4b925838-d212-4fce-8ff8-474e8dff89c1 req-a3d4cad4-9076-44d1-8aa7-aa2ded52377a service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-plugged-8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:21 user nova-compute[75378]: WARNING nova.compute.manager [req-4b925838-d212-4fce-8ff8-474e8dff89c1 req-a3d4cad4-9076-44d1-8aa7-aa2ded52377a service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received unexpected event network-vif-plugged-8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a for instance with vm_state building and task_state spawning.
Nov 09 03:40:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Updating instance_info_cache with network_info: [{"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:40:21 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:40:21 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Took 1.61 seconds to deallocate network for instance.
Nov 09 03:40:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:22 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:40:22 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:40:22 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:40:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:22 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Deleted allocations for instance 1fb5f90d-3d22-474d-947d-f939fa150f3f
Nov 09 03:40:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-40a5a15d-75ef-4a9f-9e4e-f2efcb2ca6e8 tempest-AttachSCSIVolumeTestJSON-1066171224 tempest-AttachSCSIVolumeTestJSON-1066171224-project-member] Lock "1fb5f90d-3d22-474d-947d-f939fa150f3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.010s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:22 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:40:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:40:22 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Instance spawned successfully.
Nov 09 03:40:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:40:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:40:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:40:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:40:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:40:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:40:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:40:22 user nova-compute[75378]: INFO nova.compute.manager [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Took 14.06 seconds to spawn the instance on the hypervisor.
Nov 09 03:40:22 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:40:22 user nova-compute[75378]: INFO nova.compute.manager [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Took 116.45 seconds to build instance.
Nov 09 03:40:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ab811ed0-a971-44f0-8ce9-332e90f97250 tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 116.597s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:23 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:40:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:23 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:40:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:23 user nova-compute[75378]: DEBUG nova.compute.manager [req-0dfbe2c1-b58c-46d2-abf1-1ff5373f8b82 req-40cd5efc-0b1b-4be6-a95a-b3fd5b870497 service nova] [instance: 1fb5f90d-3d22-474d-947d-f939fa150f3f] Received event network-vif-deleted-db537bed-b0bc-4295-af53-4fc336c45675 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:25 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Waiting for libvirt event about the detach of device tap46397870-ba with device alias net1 from instance 0aa21edc-dc12-46ad-925d-47bc5b576172 is timed out.
Nov 09 03:40:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c9:c5:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap46397870-ba"/></interface> {{(pid=75378) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c9:c5:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap46397870-ba"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 09 03:40:25 user nova-compute[75378]:   <name>instance-00000006</name>
Nov 09 03:40:25 user nova-compute[75378]:   <uuid>0aa21edc-dc12-46ad-925d-47bc5b576172</uuid>
Nov 09 03:40:25 user nova-compute[75378]:   <metadata>
Nov 09 03:40:25 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:40:25 user nova-compute[75378]:   <nova:package version="0.0.0"/>
Nov 09 03:40:25 user nova-compute[75378]:   <nova:name>tempest-device-tagging-server-600308768</nova:name>
Nov 09 03:40:25 user nova-compute[75378]:   <nova:creationTime>2023-11-09 03:38:47</nova:creationTime>
Nov 09 03:40:25 user nova-compute[75378]:   <nova:flavor name="m1.tiny">
Nov 09 03:40:25 user nova-compute[75378]:     <nova:memory>512</nova:memory>
Nov 09 03:40:25 user nova-compute[75378]:     <nova:disk>1</nova:disk>
Nov 09 03:40:25 user nova-compute[75378]:     <nova:swap>0</nova:swap>
Nov 09 03:40:25 user nova-compute[75378]:     <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:40:25 user nova-compute[75378]:     <nova:vcpus>1</nova:vcpus>
Nov 09 03:40:25 user nova-compute[75378]:   </nova:flavor>
Nov 09 03:40:25 user nova-compute[75378]:   <nova:owner>
Nov 09 03:40:25 user nova-compute[75378]:     <nova:user uuid="1b1261613bc54e7f96c70ed27d8a829e">tempest-TaggedAttachmentsTest-1282324561-project-member</nova:user>
Nov 09 03:40:25 user nova-compute[75378]:     <nova:project uuid="64d1e0442fe540cda81d2a5467664870">tempest-TaggedAttachmentsTest-1282324561</nova:project>
Nov 09 03:40:25 user nova-compute[75378]:   </nova:owner>
Nov 09 03:40:25 user nova-compute[75378]:   <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:40:25 user nova-compute[75378]:   <nova:ports>
Nov 09 03:40:25 user nova-compute[75378]:     <nova:port uuid="23694ef3-48c1-4a9b-9b38-3062aed570e5">
Nov 09 03:40:25 user nova-compute[75378]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 03:40:25 user nova-compute[75378]:     </nova:port>
Nov 09 03:40:25 user nova-compute[75378]:     <nova:port uuid="46397870-ba5d-4bf9-84e7-bb1febeae42e">
Nov 09 03:40:25 user nova-compute[75378]:       <nova:ip type="fixed" address="10.10.10.22" ipVersion="4"/>
Nov 09 03:40:25 user nova-compute[75378]:     </nova:port>
Nov 09 03:40:25 user nova-compute[75378]:   </nova:ports>
Nov 09 03:40:25 user nova-compute[75378]: </nova:instance>
Nov 09 03:40:25 user nova-compute[75378]:   </metadata>
Nov 09 03:40:25 user nova-compute[75378]:   <memory unit='KiB'>524288</memory>
Nov 09 03:40:25 user nova-compute[75378]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 09 03:40:25 user nova-compute[75378]:   <vcpu placement='static'>1</vcpu>
Nov 09 03:40:25 user nova-compute[75378]:   <resource>
Nov 09 03:40:25 user nova-compute[75378]:     <partition>/machine</partition>
Nov 09 03:40:25 user nova-compute[75378]:   </resource>
Nov 09 03:40:25 user nova-compute[75378]:   <sysinfo type='smbios'>
Nov 09 03:40:25 user nova-compute[75378]:     <system>
Nov 09 03:40:25 user nova-compute[75378]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 09 03:40:25 user nova-compute[75378]:       <entry name='product'>OpenStack Nova</entry>
Nov 09 03:40:25 user nova-compute[75378]:       <entry name='version'>0.0.0</entry>
Nov 09 03:40:25 user nova-compute[75378]:       <entry name='serial'>0aa21edc-dc12-46ad-925d-47bc5b576172</entry>
Nov 09 03:40:25 user nova-compute[75378]:       <entry name='uuid'>0aa21edc-dc12-46ad-925d-47bc5b576172</entry>
Nov 09 03:40:25 user nova-compute[75378]:       <entry name='family'>Virtual Machine</entry>
Nov 09 03:40:25 user nova-compute[75378]:     </system>
Nov 09 03:40:25 user nova-compute[75378]:   </sysinfo>
Nov 09 03:40:25 user nova-compute[75378]:   <os>
Nov 09 03:40:25 user nova-compute[75378]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 09 03:40:25 user nova-compute[75378]:     <boot dev='hd'/>
Nov 09 03:40:25 user nova-compute[75378]:     <smbios mode='sysinfo'/>
Nov 09 03:40:25 user nova-compute[75378]:   </os>
Nov 09 03:40:25 user nova-compute[75378]:   <features>
Nov 09 03:40:25 user nova-compute[75378]:     <acpi/>
Nov 09 03:40:25 user nova-compute[75378]:     <apic/>
Nov 09 03:40:25 user nova-compute[75378]:     <vmcoreinfo state='on'/>
Nov 09 03:40:25 user nova-compute[75378]:   </features>
Nov 09 03:40:25 user nova-compute[75378]:   <cpu mode='custom' match='exact' check='full'>
Nov 09 03:40:25 user nova-compute[75378]:     <model fallback='forbid'>Nehalem</model>
Nov 09 03:40:25 user nova-compute[75378]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 09 03:40:25 user nova-compute[75378]:     <feature policy='require' name='vme'/>
Nov 09 03:40:25 user nova-compute[75378]:     <feature policy='require' name='x2apic'/>
Nov 09 03:40:25 user nova-compute[75378]:     <feature policy='require' name='hypervisor'/>
Nov 09 03:40:25 user nova-compute[75378]:   </cpu>
Nov 09 03:40:25 user nova-compute[75378]:   <clock offset='utc'>
Nov 09 03:40:25 user nova-compute[75378]:     <timer name='pit' tickpolicy='delay'/>
Nov 09 03:40:25 user nova-compute[75378]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 09 03:40:25 user nova-compute[75378]:     <timer name='hpet' present='no'/>
Nov 09 03:40:25 user nova-compute[75378]:   </clock>
Nov 09 03:40:25 user nova-compute[75378]:   <on_poweroff>destroy</on_poweroff>
Nov 09 03:40:25 user nova-compute[75378]:   <on_reboot>restart</on_reboot>
Nov 09 03:40:25 user nova-compute[75378]:   <on_crash>destroy</on_crash>
Nov 09 03:40:25 user nova-compute[75378]:   <devices>
Nov 09 03:40:25 user nova-compute[75378]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 09 03:40:25 user nova-compute[75378]:     <disk type='file' device='disk'>
Nov 09 03:40:25 user nova-compute[75378]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 09 03:40:25 user nova-compute[75378]:       <source file='/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk' index='2'/>
Nov 09 03:40:25 user nova-compute[75378]:       <backingStore type='file' index='3'>
Nov 09 03:40:25 user nova-compute[75378]:         <format type='raw'/>
Nov 09 03:40:25 user nova-compute[75378]:         <source file='/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a'/>
Nov 09 03:40:25 user nova-compute[75378]:         <backingStore/>
Nov 09 03:40:25 user nova-compute[75378]:       </backingStore>
Nov 09 03:40:25 user nova-compute[75378]:       <target dev='vda' bus='virtio'/>
Nov 09 03:40:25 user nova-compute[75378]:       <alias name='virtio-disk0'/>
Nov 09 03:40:25 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 09 03:40:25 user nova-compute[75378]:     </disk>
Nov 09 03:40:25 user nova-compute[75378]:     <disk type='file' device='cdrom'>
Nov 09 03:40:25 user nova-compute[75378]:       <driver name='qemu' type='raw' cache='none'/>
Nov 09 03:40:25 user nova-compute[75378]:       <source file='/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk.config' index='1'/>
Nov 09 03:40:25 user nova-compute[75378]:       <backingStore/>
Nov 09 03:40:25 user nova-compute[75378]:       <target dev='hda' bus='ide'/>
Nov 09 03:40:25 user nova-compute[75378]:       <readonly/>
Nov 09 03:40:25 user nova-compute[75378]:       <alias name='ide0-0-0'/>
Nov 09 03:40:25 user nova-compute[75378]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 09 03:40:25 user nova-compute[75378]:     </disk>
Nov 09 03:40:25 user nova-compute[75378]:     <controller type='usb' index='0' model='none'>
Nov 09 03:40:25 user nova-compute[75378]:       <alias name='usb'/>
Nov 09 03:40:25 user nova-compute[75378]:     </controller>
Nov 09 03:40:25 user nova-compute[75378]:     <controller type='pci' index='0' model='pci-root'>
Nov 09 03:40:25 user nova-compute[75378]:       <alias name='pci.0'/>
Nov 09 03:40:25 user nova-compute[75378]:     </controller>
Nov 09 03:40:25 user nova-compute[75378]:     <controller type='ide' index='0'>
Nov 09 03:40:25 user nova-compute[75378]:       <alias name='ide'/>
Nov 09 03:40:25 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 09 03:40:25 user nova-compute[75378]:     </controller>
Nov 09 03:40:25 user nova-compute[75378]:     <interface type='ethernet'>
Nov 09 03:40:25 user nova-compute[75378]:       <mac address='fa:16:3e:2e:7c:ad'/>
Nov 09 03:40:25 user nova-compute[75378]:       <target dev='tap23694ef3-48'/>
Nov 09 03:40:25 user nova-compute[75378]:       <model type='virtio'/>
Nov 09 03:40:25 user nova-compute[75378]:       <mtu size='1442'/>
Nov 09 03:40:25 user nova-compute[75378]:       <alias name='net0'/>
Nov 09 03:40:25 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 09 03:40:25 user nova-compute[75378]:     </interface>
Nov 09 03:40:25 user nova-compute[75378]:     <serial type='pty'>
Nov 09 03:40:25 user nova-compute[75378]:       <source path='/dev/pts/5'/>
Nov 09 03:40:25 user nova-compute[75378]:       <log file='/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/console.log' append='off'/>
Nov 09 03:40:25 user nova-compute[75378]:       <target type='isa-serial' port='0'>
Nov 09 03:40:25 user nova-compute[75378]:         <model name='isa-serial'/>
Nov 09 03:40:25 user nova-compute[75378]:       </target>
Nov 09 03:40:25 user nova-compute[75378]:       <alias name='serial0'/>
Nov 09 03:40:25 user nova-compute[75378]:     </serial>
Nov 09 03:40:25 user nova-compute[75378]:     <console type='pty' tty='/dev/pts/5'>
Nov 09 03:40:25 user nova-compute[75378]:       <source path='/dev/pts/5'/>
Nov 09 03:40:25 user nova-compute[75378]:       <log file='/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/console.log' append='off'/>
Nov 09 03:40:25 user nova-compute[75378]:       <target type='serial' port='0'/>
Nov 09 03:40:25 user nova-compute[75378]:       <alias name='serial0'/>
Nov 09 03:40:25 user nova-compute[75378]:     </console>
Nov 09 03:40:25 user nova-compute[75378]:     <input type='mouse' bus='ps2'>
Nov 09 03:40:25 user nova-compute[75378]:       <alias name='input0'/>
Nov 09 03:40:25 user nova-compute[75378]:     </input>
Nov 09 03:40:25 user nova-compute[75378]:     <input type='keyboard' bus='ps2'>
Nov 09 03:40:25 user nova-compute[75378]:       <alias name='input1'/>
Nov 09 03:40:25 user nova-compute[75378]:     </input>
Nov 09 03:40:25 user nova-compute[75378]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 09 03:40:25 user nova-compute[75378]:       <listen type='address' address='0.0.0.0'/>
Nov 09 03:40:25 user nova-compute[75378]:     </graphics>
Nov 09 03:40:25 user nova-compute[75378]:     <audio id='1' type='none'/>
Nov 09 03:40:25 user nova-compute[75378]:     <video>
Nov 09 03:40:25 user nova-compute[75378]:       <model type='virtio' heads='1' primary='yes'/>
Nov 09 03:40:25 user nova-compute[75378]:       <alias name='video0'/>
Nov 09 03:40:25 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 09 03:40:25 user nova-compute[75378]:     </video>
Nov 09 03:40:25 user nova-compute[75378]:     <memballoon model='virtio'>
Nov 09 03:40:25 user nova-compute[75378]:       <stats period='10'/>
Nov 09 03:40:25 user nova-compute[75378]:       <alias name='balloon0'/>
Nov 09 03:40:25 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 09 03:40:25 user nova-compute[75378]:     </memballoon>
Nov 09 03:40:25 user nova-compute[75378]:     <rng model='virtio'>
Nov 09 03:40:25 user nova-compute[75378]:       <backend model='random'>/dev/urandom</backend>
Nov 09 03:40:25 user nova-compute[75378]:       <alias name='rng0'/>
Nov 09 03:40:25 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 09 03:40:25 user nova-compute[75378]:     </rng>
Nov 09 03:40:25 user nova-compute[75378]:   </devices>
Nov 09 03:40:25 user nova-compute[75378]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 09 03:40:25 user nova-compute[75378]:     <label>libvirt-0aa21edc-dc12-46ad-925d-47bc5b576172</label>
Nov 09 03:40:25 user nova-compute[75378]:     <imagelabel>libvirt-0aa21edc-dc12-46ad-925d-47bc5b576172</imagelabel>
Nov 09 03:40:25 user nova-compute[75378]:   </seclabel>
Nov 09 03:40:25 user nova-compute[75378]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 09 03:40:25 user nova-compute[75378]:     <label>+64055:+108</label>
Nov 09 03:40:25 user nova-compute[75378]:     <imagelabel>+64055:+108</imagelabel>
Nov 09 03:40:25 user nova-compute[75378]:   </seclabel>
Nov 09 03:40:25 user nova-compute[75378]: </domain>
Nov 09 03:40:25 user nova-compute[75378]:  {{(pid=75378) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 09 03:40:25 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Successfully detached device tap46397870-ba from instance 0aa21edc-dc12-46ad-925d-47bc5b576172 from the live domain config.
Nov 09 03:40:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-600308768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-600308768',id=6,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7Zi3/OBwBWFZyzirh8mZQ4BgVFx7fj6XXgOw9/PxXUG8dZzej6jh1WqLhuSvXrU5svCvjW/PsldUVgziNo99MiMWj1iBWLdTs8DNBiQq2fEkWCg0hw0gQlP+3PQUsmdg==',key_name='tempest-keypair-1523638191',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:37:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64d1e0442fe540cda81d2a5467664870',ramdisk_id='',reservation_id='r-776ypqd0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1282324561',owner_user_name='tempest-TaggedAttachmentsTest-1282324561-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1261613bc54e7f96c70ed27d8a829e',uuid=0aa21edc-dc12-46ad-925d-47bc5b576172,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "address": "fa:16:3e:c9:c5:b4", "network": {"id": "336622a2-627e-4a05-b204-7ab1ef8595ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1520328787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46397870-ba", "ovs_interfaceid": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Converting VIF {"id": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "address": "fa:16:3e:c9:c5:b4", "network": {"id": "336622a2-627e-4a05-b204-7ab1ef8595ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1520328787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46397870-ba", "ovs_interfaceid": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:c5:b4,bridge_name='br-int',has_traffic_filtering=True,id=46397870-ba5d-4bf9-84e7-bb1febeae42e,network=Network(336622a2-627e-4a05-b204-7ab1ef8595ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46397870-ba') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG os_vif [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:c5:b4,bridge_name='br-int',has_traffic_filtering=True,id=46397870-ba5d-4bf9-84e7-bb1febeae42e,network=Network(336622a2-627e-4a05-b204-7ab1ef8595ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46397870-ba') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46397870-ba, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=799664a2-35f7-42f3-bb1d-128e565cf793) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:25 user nova-compute[75378]: INFO os_vif [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:c5:b4,bridge_name='br-int',has_traffic_filtering=True,id=46397870-ba5d-4bf9-84e7-bb1febeae42e,network=Network(336622a2-627e-4a05-b204-7ab1ef8595ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46397870-ba')
Nov 09 03:40:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:40:25 user nova-compute[75378]:   <nova:package version="0.0.0"/>
Nov 09 03:40:25 user nova-compute[75378]:   <nova:name>tempest-device-tagging-server-600308768</nova:name>
Nov 09 03:40:25 user nova-compute[75378]:   <nova:creationTime>2023-11-09 03:40:25</nova:creationTime>
Nov 09 03:40:25 user nova-compute[75378]:   <nova:flavor name="m1.tiny">
Nov 09 03:40:25 user nova-compute[75378]:     <nova:memory>512</nova:memory>
Nov 09 03:40:25 user nova-compute[75378]:     <nova:disk>1</nova:disk>
Nov 09 03:40:25 user nova-compute[75378]:     <nova:swap>0</nova:swap>
Nov 09 03:40:25 user nova-compute[75378]:     <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:40:25 user nova-compute[75378]:     <nova:vcpus>1</nova:vcpus>
Nov 09 03:40:25 user nova-compute[75378]:   </nova:flavor>
Nov 09 03:40:25 user nova-compute[75378]:   <nova:owner>
Nov 09 03:40:25 user nova-compute[75378]:     <nova:user uuid="1b1261613bc54e7f96c70ed27d8a829e">tempest-TaggedAttachmentsTest-1282324561-project-member</nova:user>
Nov 09 03:40:25 user nova-compute[75378]:     <nova:project uuid="64d1e0442fe540cda81d2a5467664870">tempest-TaggedAttachmentsTest-1282324561</nova:project>
Nov 09 03:40:25 user nova-compute[75378]:   </nova:owner>
Nov 09 03:40:25 user nova-compute[75378]:   <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:40:25 user nova-compute[75378]:   <nova:ports>
Nov 09 03:40:25 user nova-compute[75378]:     <nova:port uuid="23694ef3-48c1-4a9b-9b38-3062aed570e5">
Nov 09 03:40:25 user nova-compute[75378]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 03:40:25 user nova-compute[75378]:     </nova:port>
Nov 09 03:40:25 user nova-compute[75378]:   </nova:ports>
Nov 09 03:40:25 user nova-compute[75378]: </nova:instance>
Nov 09 03:40:25 user nova-compute[75378]:  {{(pid=75378) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "2f475dba-59f5-414a-8156-8b438601ecfd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG nova.objects.instance [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lazy-loading 'flavor' on Instance uuid 2f475dba-59f5-414a-8156-8b438601ecfd {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:40:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "2f475dba-59f5-414a-8156-8b438601ecfd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.204s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "2f475dba-59f5-414a-8156-8b438601ecfd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:26 user nova-compute[75378]: INFO nova.compute.manager [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Attaching volume 93b2608a-e6b8-4844-820c-71f0cd80f3be to /dev/vdb
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG os_brick.utils [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5920126c-59c7-4454-bdae-eb213de52859]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG nova.compute.manager [req-2361435e-2eae-47c3-a559-8f067210f091 req-e18d7b1e-6e85-4fec-97f7-f9a02f7ff25d service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Received event network-vif-deleted-46397870-ba5d-4bf9-84e7-bb1febeae42e {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:26 user nova-compute[75378]: INFO nova.compute.manager [req-2361435e-2eae-47c3-a559-8f067210f091 req-e18d7b1e-6e85-4fec-97f7-f9a02f7ff25d service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Neutron deleted interface 46397870-ba5d-4bf9-84e7-bb1febeae42e; detaching it from the instance and deleting it from the info cache
Nov 09 03:40:26 user nova-compute[75378]: DEBUG nova.network.neutron [req-2361435e-2eae-47c3-a559-8f067210f091 req-e18d7b1e-6e85-4fec-97f7-f9a02f7ff25d service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Updating instance_info_cache with network_info: [{"id": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "address": "fa:16:3e:2e:7c:ad", "network": {"id": "dbae8930-1593-4089-9f9e-4d0ee5306608", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-203847065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23694ef3-48", "ovs_interfaceid": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[820feb00-97ad-4906-a91b-fe56c0926926]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG nova.objects.instance [req-2361435e-2eae-47c3-a559-8f067210f091 req-e18d7b1e-6e85-4fec-97f7-f9a02f7ff25d service nova] Lazy-loading 'system_metadata' on Instance uuid 0aa21edc-dc12-46ad-925d-47bc5b576172 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquiring lock "refresh_cache-0aa21edc-dc12-46ad-925d-47bc5b576172" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquired lock "refresh_cache-0aa21edc-dc12-46ad-925d-47bc5b576172" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG nova.network.neutron [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5a25ca-55e6-4b91-9d7b-776292ecb6a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a90f57b-264b-4cec-b7d2-da5ada8d39e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG nova.objects.instance [req-2361435e-2eae-47c3-a559-8f067210f091 req-e18d7b1e-6e85-4fec-97f7-f9a02f7ff25d service nova] Lazy-loading 'flavor' on Instance uuid 0aa21edc-dc12-46ad-925d-47bc5b576172 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:40:26 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd881f27-378a-4f0b-81d6-f9f7ad7cbd07]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG os_brick.utils [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Updating existing volume attachment record: 43c11464-10ff-43db-a1ef-afa30a38592a {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG nova.objects.base [req-2361435e-2eae-47c3-a559-8f067210f091 req-e18d7b1e-6e85-4fec-97f7-f9a02f7ff25d service nova] Object Instance<0aa21edc-dc12-46ad-925d-47bc5b576172> lazy-loaded attributes: system_metadata,flavor {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [req-2361435e-2eae-47c3-a559-8f067210f091 req-e18d7b1e-6e85-4fec-97f7-f9a02f7ff25d service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-600308768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-600308768',id=6,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7Zi3/OBwBWFZyzirh8mZQ4BgVFx7fj6XXgOw9/PxXUG8dZzej6jh1WqLhuSvXrU5svCvjW/PsldUVgziNo99MiMWj1iBWLdTs8DNBiQq2fEkWCg0hw0gQlP+3PQUsmdg==',key_name='tempest-keypair-1523638191',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:37:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64d1e0442fe540cda81d2a5467664870',ramdisk_id='',reservation_id='r-776ypqd0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1282324561',owner_user_name='tempest-TaggedAttachmentsTest-1282324561-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1261613bc54e7f96c70ed27d8a829e',uuid=0aa21edc-dc12-46ad-925d-47bc5b576172,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "address": "fa:16:3e:c9:c5:b4", "network": {"id": "336622a2-627e-4a05-b204-7ab1ef8595ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1520328787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46397870-ba", "ovs_interfaceid": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG nova.network.os_vif_util [req-2361435e-2eae-47c3-a559-8f067210f091 req-e18d7b1e-6e85-4fec-97f7-f9a02f7ff25d service nova] Converting VIF {"id": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "address": "fa:16:3e:c9:c5:b4", "network": {"id": "336622a2-627e-4a05-b204-7ab1ef8595ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1520328787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46397870-ba", "ovs_interfaceid": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG nova.network.os_vif_util [req-2361435e-2eae-47c3-a559-8f067210f091 req-e18d7b1e-6e85-4fec-97f7-f9a02f7ff25d service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:c5:b4,bridge_name='br-int',has_traffic_filtering=True,id=46397870-ba5d-4bf9-84e7-bb1febeae42e,network=Network(336622a2-627e-4a05-b204-7ab1ef8595ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46397870-ba') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [req-2361435e-2eae-47c3-a559-8f067210f091 req-e18d7b1e-6e85-4fec-97f7-f9a02f7ff25d service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c9:c5:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap46397870-ba"/></interface> {{(pid=75378) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [req-2361435e-2eae-47c3-a559-8f067210f091 req-e18d7b1e-6e85-4fec-97f7-f9a02f7ff25d service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c9:c5:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap46397870-ba"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 09 03:40:26 user nova-compute[75378]:   <name>instance-00000006</name>
Nov 09 03:40:26 user nova-compute[75378]:   <uuid>0aa21edc-dc12-46ad-925d-47bc5b576172</uuid>
Nov 09 03:40:26 user nova-compute[75378]:   <metadata>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:40:26 user nova-compute[75378]:   <nova:package version="0.0.0"/>
Nov 09 03:40:26 user nova-compute[75378]:   <nova:name>tempest-device-tagging-server-600308768</nova:name>
Nov 09 03:40:26 user nova-compute[75378]:   <nova:creationTime>2023-11-09 03:40:25</nova:creationTime>
Nov 09 03:40:26 user nova-compute[75378]:   <nova:flavor name="m1.tiny">
Nov 09 03:40:26 user nova-compute[75378]:     <nova:memory>512</nova:memory>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:disk>1</nova:disk>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:swap>0</nova:swap>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:vcpus>1</nova:vcpus>
Nov 09 03:40:26 user nova-compute[75378]:   </nova:flavor>
Nov 09 03:40:26 user nova-compute[75378]:   <nova:owner>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:user uuid="1b1261613bc54e7f96c70ed27d8a829e">tempest-TaggedAttachmentsTest-1282324561-project-member</nova:user>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:project uuid="64d1e0442fe540cda81d2a5467664870">tempest-TaggedAttachmentsTest-1282324561</nova:project>
Nov 09 03:40:26 user nova-compute[75378]:   </nova:owner>
Nov 09 03:40:26 user nova-compute[75378]:   <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:40:26 user nova-compute[75378]:   <nova:ports>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:port uuid="23694ef3-48c1-4a9b-9b38-3062aed570e5">
Nov 09 03:40:26 user nova-compute[75378]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 03:40:26 user nova-compute[75378]:     </nova:port>
Nov 09 03:40:26 user nova-compute[75378]:   </nova:ports>
Nov 09 03:40:26 user nova-compute[75378]: </nova:instance>
Nov 09 03:40:26 user nova-compute[75378]:   </metadata>
Nov 09 03:40:26 user nova-compute[75378]:   <memory unit='KiB'>524288</memory>
Nov 09 03:40:26 user nova-compute[75378]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 09 03:40:26 user nova-compute[75378]:   <vcpu placement='static'>1</vcpu>
Nov 09 03:40:26 user nova-compute[75378]:   <resource>
Nov 09 03:40:26 user nova-compute[75378]:     <partition>/machine</partition>
Nov 09 03:40:26 user nova-compute[75378]:   </resource>
Nov 09 03:40:26 user nova-compute[75378]:   <sysinfo type='smbios'>
Nov 09 03:40:26 user nova-compute[75378]:     <system>
Nov 09 03:40:26 user nova-compute[75378]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 09 03:40:26 user nova-compute[75378]:       <entry name='product'>OpenStack Nova</entry>
Nov 09 03:40:26 user nova-compute[75378]:       <entry name='version'>0.0.0</entry>
Nov 09 03:40:26 user nova-compute[75378]:       <entry name='serial'>0aa21edc-dc12-46ad-925d-47bc5b576172</entry>
Nov 09 03:40:26 user nova-compute[75378]:       <entry name='uuid'>0aa21edc-dc12-46ad-925d-47bc5b576172</entry>
Nov 09 03:40:26 user nova-compute[75378]:       <entry name='family'>Virtual Machine</entry>
Nov 09 03:40:26 user nova-compute[75378]:     </system>
Nov 09 03:40:26 user nova-compute[75378]:   </sysinfo>
Nov 09 03:40:26 user nova-compute[75378]:   <os>
Nov 09 03:40:26 user nova-compute[75378]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 09 03:40:26 user nova-compute[75378]:     <boot dev='hd'/>
Nov 09 03:40:26 user nova-compute[75378]:     <smbios mode='sysinfo'/>
Nov 09 03:40:26 user nova-compute[75378]:   </os>
Nov 09 03:40:26 user nova-compute[75378]:   <features>
Nov 09 03:40:26 user nova-compute[75378]:     <acpi/>
Nov 09 03:40:26 user nova-compute[75378]:     <apic/>
Nov 09 03:40:26 user nova-compute[75378]:     <vmcoreinfo state='on'/>
Nov 09 03:40:26 user nova-compute[75378]:   </features>
Nov 09 03:40:26 user nova-compute[75378]:   <cpu mode='custom' match='exact' check='full'>
Nov 09 03:40:26 user nova-compute[75378]:     <model fallback='forbid'>Nehalem</model>
Nov 09 03:40:26 user nova-compute[75378]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 09 03:40:26 user nova-compute[75378]:     <feature policy='require' name='vme'/>
Nov 09 03:40:26 user nova-compute[75378]:     <feature policy='require' name='x2apic'/>
Nov 09 03:40:26 user nova-compute[75378]:     <feature policy='require' name='hypervisor'/>
Nov 09 03:40:26 user nova-compute[75378]:   </cpu>
Nov 09 03:40:26 user nova-compute[75378]:   <clock offset='utc'>
Nov 09 03:40:26 user nova-compute[75378]:     <timer name='pit' tickpolicy='delay'/>
Nov 09 03:40:26 user nova-compute[75378]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 09 03:40:26 user nova-compute[75378]:     <timer name='hpet' present='no'/>
Nov 09 03:40:26 user nova-compute[75378]:   </clock>
Nov 09 03:40:26 user nova-compute[75378]:   <on_poweroff>destroy</on_poweroff>
Nov 09 03:40:26 user nova-compute[75378]:   <on_reboot>restart</on_reboot>
Nov 09 03:40:26 user nova-compute[75378]:   <on_crash>destroy</on_crash>
Nov 09 03:40:26 user nova-compute[75378]:   <devices>
Nov 09 03:40:26 user nova-compute[75378]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 09 03:40:26 user nova-compute[75378]:     <disk type='file' device='disk'>
Nov 09 03:40:26 user nova-compute[75378]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 09 03:40:26 user nova-compute[75378]:       <source file='/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk' index='2'/>
Nov 09 03:40:26 user nova-compute[75378]:       <backingStore type='file' index='3'>
Nov 09 03:40:26 user nova-compute[75378]:         <format type='raw'/>
Nov 09 03:40:26 user nova-compute[75378]:         <source file='/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a'/>
Nov 09 03:40:26 user nova-compute[75378]:         <backingStore/>
Nov 09 03:40:26 user nova-compute[75378]:       </backingStore>
Nov 09 03:40:26 user nova-compute[75378]:       <target dev='vda' bus='virtio'/>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='virtio-disk0'/>
Nov 09 03:40:26 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </disk>
Nov 09 03:40:26 user nova-compute[75378]:     <disk type='file' device='cdrom'>
Nov 09 03:40:26 user nova-compute[75378]:       <driver name='qemu' type='raw' cache='none'/>
Nov 09 03:40:26 user nova-compute[75378]:       <source file='/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk.config' index='1'/>
Nov 09 03:40:26 user nova-compute[75378]:       <backingStore/>
Nov 09 03:40:26 user nova-compute[75378]:       <target dev='hda' bus='ide'/>
Nov 09 03:40:26 user nova-compute[75378]:       <readonly/>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='ide0-0-0'/>
Nov 09 03:40:26 user nova-compute[75378]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </disk>
Nov 09 03:40:26 user nova-compute[75378]:     <controller type='usb' index='0' model='none'>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='usb'/>
Nov 09 03:40:26 user nova-compute[75378]:     </controller>
Nov 09 03:40:26 user nova-compute[75378]:     <controller type='pci' index='0' model='pci-root'>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='pci.0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </controller>
Nov 09 03:40:26 user nova-compute[75378]:     <controller type='ide' index='0'>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='ide'/>
Nov 09 03:40:26 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 09 03:40:26 user nova-compute[75378]:     </controller>
Nov 09 03:40:26 user nova-compute[75378]:     <interface type='ethernet'>
Nov 09 03:40:26 user nova-compute[75378]:       <mac address='fa:16:3e:2e:7c:ad'/>
Nov 09 03:40:26 user nova-compute[75378]:       <target dev='tap23694ef3-48'/>
Nov 09 03:40:26 user nova-compute[75378]:       <model type='virtio'/>
Nov 09 03:40:26 user nova-compute[75378]:       <mtu size='1442'/>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='net0'/>
Nov 09 03:40:26 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </interface>
Nov 09 03:40:26 user nova-compute[75378]:     <serial type='pty'>
Nov 09 03:40:26 user nova-compute[75378]:       <source path='/dev/pts/5'/>
Nov 09 03:40:26 user nova-compute[75378]:       <log file='/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/console.log' append='off'/>
Nov 09 03:40:26 user nova-compute[75378]:       <target type='isa-serial' port='0'>
Nov 09 03:40:26 user nova-compute[75378]:         <model name='isa-serial'/>
Nov 09 03:40:26 user nova-compute[75378]:       </target>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='serial0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </serial>
Nov 09 03:40:26 user nova-compute[75378]:     <console type='pty' tty='/dev/pts/5'>
Nov 09 03:40:26 user nova-compute[75378]:       <source path='/dev/pts/5'/>
Nov 09 03:40:26 user nova-compute[75378]:       <log file='/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/console.log' append='off'/>
Nov 09 03:40:26 user nova-compute[75378]:       <target type='serial' port='0'/>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='serial0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </console>
Nov 09 03:40:26 user nova-compute[75378]:     <input type='mouse' bus='ps2'>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='input0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </input>
Nov 09 03:40:26 user nova-compute[75378]:     <input type='keyboard' bus='ps2'>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='input1'/>
Nov 09 03:40:26 user nova-compute[75378]:     </input>
Nov 09 03:40:26 user nova-compute[75378]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 09 03:40:26 user nova-compute[75378]:       <listen type='address' address='0.0.0.0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </graphics>
Nov 09 03:40:26 user nova-compute[75378]:     <audio id='1' type='none'/>
Nov 09 03:40:26 user nova-compute[75378]:     <video>
Nov 09 03:40:26 user nova-compute[75378]:       <model type='virtio' heads='1' primary='yes'/>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='video0'/>
Nov 09 03:40:26 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </video>
Nov 09 03:40:26 user nova-compute[75378]:     <memballoon model='virtio'>
Nov 09 03:40:26 user nova-compute[75378]:       <stats period='10'/>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='balloon0'/>
Nov 09 03:40:26 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </memballoon>
Nov 09 03:40:26 user nova-compute[75378]:     <rng model='virtio'>
Nov 09 03:40:26 user nova-compute[75378]:       <backend model='random'>/dev/urandom</backend>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='rng0'/>
Nov 09 03:40:26 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </rng>
Nov 09 03:40:26 user nova-compute[75378]:   </devices>
Nov 09 03:40:26 user nova-compute[75378]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 09 03:40:26 user nova-compute[75378]:     <label>libvirt-0aa21edc-dc12-46ad-925d-47bc5b576172</label>
Nov 09 03:40:26 user nova-compute[75378]:     <imagelabel>libvirt-0aa21edc-dc12-46ad-925d-47bc5b576172</imagelabel>
Nov 09 03:40:26 user nova-compute[75378]:   </seclabel>
Nov 09 03:40:26 user nova-compute[75378]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 09 03:40:26 user nova-compute[75378]:     <label>+64055:+108</label>
Nov 09 03:40:26 user nova-compute[75378]:     <imagelabel>+64055:+108</imagelabel>
Nov 09 03:40:26 user nova-compute[75378]:   </seclabel>
Nov 09 03:40:26 user nova-compute[75378]: </domain>
Nov 09 03:40:26 user nova-compute[75378]:  {{(pid=75378) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [req-2361435e-2eae-47c3-a559-8f067210f091 req-e18d7b1e-6e85-4fec-97f7-f9a02f7ff25d service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c9:c5:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap46397870-ba"/></interface> {{(pid=75378) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [req-2361435e-2eae-47c3-a559-8f067210f091 req-e18d7b1e-6e85-4fec-97f7-f9a02f7ff25d service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c9:c5:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap46397870-ba"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 09 03:40:26 user nova-compute[75378]:   <name>instance-00000006</name>
Nov 09 03:40:26 user nova-compute[75378]:   <uuid>0aa21edc-dc12-46ad-925d-47bc5b576172</uuid>
Nov 09 03:40:26 user nova-compute[75378]:   <metadata>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:40:26 user nova-compute[75378]:   <nova:package version="0.0.0"/>
Nov 09 03:40:26 user nova-compute[75378]:   <nova:name>tempest-device-tagging-server-600308768</nova:name>
Nov 09 03:40:26 user nova-compute[75378]:   <nova:creationTime>2023-11-09 03:40:25</nova:creationTime>
Nov 09 03:40:26 user nova-compute[75378]:   <nova:flavor name="m1.tiny">
Nov 09 03:40:26 user nova-compute[75378]:     <nova:memory>512</nova:memory>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:disk>1</nova:disk>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:swap>0</nova:swap>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:vcpus>1</nova:vcpus>
Nov 09 03:40:26 user nova-compute[75378]:   </nova:flavor>
Nov 09 03:40:26 user nova-compute[75378]:   <nova:owner>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:user uuid="1b1261613bc54e7f96c70ed27d8a829e">tempest-TaggedAttachmentsTest-1282324561-project-member</nova:user>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:project uuid="64d1e0442fe540cda81d2a5467664870">tempest-TaggedAttachmentsTest-1282324561</nova:project>
Nov 09 03:40:26 user nova-compute[75378]:   </nova:owner>
Nov 09 03:40:26 user nova-compute[75378]:   <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:40:26 user nova-compute[75378]:   <nova:ports>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:port uuid="23694ef3-48c1-4a9b-9b38-3062aed570e5">
Nov 09 03:40:26 user nova-compute[75378]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 03:40:26 user nova-compute[75378]:     </nova:port>
Nov 09 03:40:26 user nova-compute[75378]:   </nova:ports>
Nov 09 03:40:26 user nova-compute[75378]: </nova:instance>
Nov 09 03:40:26 user nova-compute[75378]:   </metadata>
Nov 09 03:40:26 user nova-compute[75378]:   <memory unit='KiB'>524288</memory>
Nov 09 03:40:26 user nova-compute[75378]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 09 03:40:26 user nova-compute[75378]:   <vcpu placement='static'>1</vcpu>
Nov 09 03:40:26 user nova-compute[75378]:   <resource>
Nov 09 03:40:26 user nova-compute[75378]:     <partition>/machine</partition>
Nov 09 03:40:26 user nova-compute[75378]:   </resource>
Nov 09 03:40:26 user nova-compute[75378]:   <sysinfo type='smbios'>
Nov 09 03:40:26 user nova-compute[75378]:     <system>
Nov 09 03:40:26 user nova-compute[75378]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 09 03:40:26 user nova-compute[75378]:       <entry name='product'>OpenStack Nova</entry>
Nov 09 03:40:26 user nova-compute[75378]:       <entry name='version'>0.0.0</entry>
Nov 09 03:40:26 user nova-compute[75378]:       <entry name='serial'>0aa21edc-dc12-46ad-925d-47bc5b576172</entry>
Nov 09 03:40:26 user nova-compute[75378]:       <entry name='uuid'>0aa21edc-dc12-46ad-925d-47bc5b576172</entry>
Nov 09 03:40:26 user nova-compute[75378]:       <entry name='family'>Virtual Machine</entry>
Nov 09 03:40:26 user nova-compute[75378]:     </system>
Nov 09 03:40:26 user nova-compute[75378]:   </sysinfo>
Nov 09 03:40:26 user nova-compute[75378]:   <os>
Nov 09 03:40:26 user nova-compute[75378]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 09 03:40:26 user nova-compute[75378]:     <boot dev='hd'/>
Nov 09 03:40:26 user nova-compute[75378]:     <smbios mode='sysinfo'/>
Nov 09 03:40:26 user nova-compute[75378]:   </os>
Nov 09 03:40:26 user nova-compute[75378]:   <features>
Nov 09 03:40:26 user nova-compute[75378]:     <acpi/>
Nov 09 03:40:26 user nova-compute[75378]:     <apic/>
Nov 09 03:40:26 user nova-compute[75378]:     <vmcoreinfo state='on'/>
Nov 09 03:40:26 user nova-compute[75378]:   </features>
Nov 09 03:40:26 user nova-compute[75378]:   <cpu mode='custom' match='exact' check='full'>
Nov 09 03:40:26 user nova-compute[75378]:     <model fallback='forbid'>Nehalem</model>
Nov 09 03:40:26 user nova-compute[75378]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 09 03:40:26 user nova-compute[75378]:     <feature policy='require' name='vme'/>
Nov 09 03:40:26 user nova-compute[75378]:     <feature policy='require' name='x2apic'/>
Nov 09 03:40:26 user nova-compute[75378]:     <feature policy='require' name='hypervisor'/>
Nov 09 03:40:26 user nova-compute[75378]:   </cpu>
Nov 09 03:40:26 user nova-compute[75378]:   <clock offset='utc'>
Nov 09 03:40:26 user nova-compute[75378]:     <timer name='pit' tickpolicy='delay'/>
Nov 09 03:40:26 user nova-compute[75378]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 09 03:40:26 user nova-compute[75378]:     <timer name='hpet' present='no'/>
Nov 09 03:40:26 user nova-compute[75378]:   </clock>
Nov 09 03:40:26 user nova-compute[75378]:   <on_poweroff>destroy</on_poweroff>
Nov 09 03:40:26 user nova-compute[75378]:   <on_reboot>restart</on_reboot>
Nov 09 03:40:26 user nova-compute[75378]:   <on_crash>destroy</on_crash>
Nov 09 03:40:26 user nova-compute[75378]:   <devices>
Nov 09 03:40:26 user nova-compute[75378]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 09 03:40:26 user nova-compute[75378]:     <disk type='file' device='disk'>
Nov 09 03:40:26 user nova-compute[75378]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 09 03:40:26 user nova-compute[75378]:       <source file='/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk' index='2'/>
Nov 09 03:40:26 user nova-compute[75378]:       <backingStore type='file' index='3'>
Nov 09 03:40:26 user nova-compute[75378]:         <format type='raw'/>
Nov 09 03:40:26 user nova-compute[75378]:         <source file='/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a'/>
Nov 09 03:40:26 user nova-compute[75378]:         <backingStore/>
Nov 09 03:40:26 user nova-compute[75378]:       </backingStore>
Nov 09 03:40:26 user nova-compute[75378]:       <target dev='vda' bus='virtio'/>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='virtio-disk0'/>
Nov 09 03:40:26 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </disk>
Nov 09 03:40:26 user nova-compute[75378]:     <disk type='file' device='cdrom'>
Nov 09 03:40:26 user nova-compute[75378]:       <driver name='qemu' type='raw' cache='none'/>
Nov 09 03:40:26 user nova-compute[75378]:       <source file='/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/disk.config' index='1'/>
Nov 09 03:40:26 user nova-compute[75378]:       <backingStore/>
Nov 09 03:40:26 user nova-compute[75378]:       <target dev='hda' bus='ide'/>
Nov 09 03:40:26 user nova-compute[75378]:       <readonly/>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='ide0-0-0'/>
Nov 09 03:40:26 user nova-compute[75378]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </disk>
Nov 09 03:40:26 user nova-compute[75378]:     <controller type='usb' index='0' model='none'>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='usb'/>
Nov 09 03:40:26 user nova-compute[75378]:     </controller>
Nov 09 03:40:26 user nova-compute[75378]:     <controller type='pci' index='0' model='pci-root'>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='pci.0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </controller>
Nov 09 03:40:26 user nova-compute[75378]:     <controller type='ide' index='0'>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='ide'/>
Nov 09 03:40:26 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 09 03:40:26 user nova-compute[75378]:     </controller>
Nov 09 03:40:26 user nova-compute[75378]:     <interface type='ethernet'>
Nov 09 03:40:26 user nova-compute[75378]:       <mac address='fa:16:3e:2e:7c:ad'/>
Nov 09 03:40:26 user nova-compute[75378]:       <target dev='tap23694ef3-48'/>
Nov 09 03:40:26 user nova-compute[75378]:       <model type='virtio'/>
Nov 09 03:40:26 user nova-compute[75378]:       <mtu size='1442'/>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='net0'/>
Nov 09 03:40:26 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </interface>
Nov 09 03:40:26 user nova-compute[75378]:     <serial type='pty'>
Nov 09 03:40:26 user nova-compute[75378]:       <source path='/dev/pts/5'/>
Nov 09 03:40:26 user nova-compute[75378]:       <log file='/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/console.log' append='off'/>
Nov 09 03:40:26 user nova-compute[75378]:       <target type='isa-serial' port='0'>
Nov 09 03:40:26 user nova-compute[75378]:         <model name='isa-serial'/>
Nov 09 03:40:26 user nova-compute[75378]:       </target>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='serial0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </serial>
Nov 09 03:40:26 user nova-compute[75378]:     <console type='pty' tty='/dev/pts/5'>
Nov 09 03:40:26 user nova-compute[75378]:       <source path='/dev/pts/5'/>
Nov 09 03:40:26 user nova-compute[75378]:       <log file='/opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172/console.log' append='off'/>
Nov 09 03:40:26 user nova-compute[75378]:       <target type='serial' port='0'/>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='serial0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </console>
Nov 09 03:40:26 user nova-compute[75378]:     <input type='mouse' bus='ps2'>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='input0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </input>
Nov 09 03:40:26 user nova-compute[75378]:     <input type='keyboard' bus='ps2'>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='input1'/>
Nov 09 03:40:26 user nova-compute[75378]:     </input>
Nov 09 03:40:26 user nova-compute[75378]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 09 03:40:26 user nova-compute[75378]:       <listen type='address' address='0.0.0.0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </graphics>
Nov 09 03:40:26 user nova-compute[75378]:     <audio id='1' type='none'/>
Nov 09 03:40:26 user nova-compute[75378]:     <video>
Nov 09 03:40:26 user nova-compute[75378]:       <model type='virtio' heads='1' primary='yes'/>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='video0'/>
Nov 09 03:40:26 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </video>
Nov 09 03:40:26 user nova-compute[75378]:     <memballoon model='virtio'>
Nov 09 03:40:26 user nova-compute[75378]:       <stats period='10'/>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='balloon0'/>
Nov 09 03:40:26 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </memballoon>
Nov 09 03:40:26 user nova-compute[75378]:     <rng model='virtio'>
Nov 09 03:40:26 user nova-compute[75378]:       <backend model='random'>/dev/urandom</backend>
Nov 09 03:40:26 user nova-compute[75378]:       <alias name='rng0'/>
Nov 09 03:40:26 user nova-compute[75378]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 09 03:40:26 user nova-compute[75378]:     </rng>
Nov 09 03:40:26 user nova-compute[75378]:   </devices>
Nov 09 03:40:26 user nova-compute[75378]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 09 03:40:26 user nova-compute[75378]:     <label>libvirt-0aa21edc-dc12-46ad-925d-47bc5b576172</label>
Nov 09 03:40:26 user nova-compute[75378]:     <imagelabel>libvirt-0aa21edc-dc12-46ad-925d-47bc5b576172</imagelabel>
Nov 09 03:40:26 user nova-compute[75378]:   </seclabel>
Nov 09 03:40:26 user nova-compute[75378]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 09 03:40:26 user nova-compute[75378]:     <label>+64055:+108</label>
Nov 09 03:40:26 user nova-compute[75378]:     <imagelabel>+64055:+108</imagelabel>
Nov 09 03:40:26 user nova-compute[75378]:   </seclabel>
Nov 09 03:40:26 user nova-compute[75378]: </domain>
Nov 09 03:40:26 user nova-compute[75378]:  {{(pid=75378) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 09 03:40:26 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [req-2361435e-2eae-47c3-a559-8f067210f091 req-e18d7b1e-6e85-4fec-97f7-f9a02f7ff25d service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Detaching interface fa:16:3e:c9:c5:b4 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap46397870-ba' not found.
Nov 09 03:40:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [req-2361435e-2eae-47c3-a559-8f067210f091 req-e18d7b1e-6e85-4fec-97f7-f9a02f7ff25d service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-600308768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-600308768',id=6,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7Zi3/OBwBWFZyzirh8mZQ4BgVFx7fj6XXgOw9/PxXUG8dZzej6jh1WqLhuSvXrU5svCvjW/PsldUVgziNo99MiMWj1iBWLdTs8DNBiQq2fEkWCg0hw0gQlP+3PQUsmdg==',key_name='tempest-keypair-1523638191',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:37:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64d1e0442fe540cda81d2a5467664870',ramdisk_id='',reservation_id='r-776ypqd0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1282324561',owner_user_name='tempest-TaggedAttachmentsTest-1282324561-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1261613bc54e7f96c70ed27d8a829e',uuid=0aa21edc-dc12-46ad-925d-47bc5b576172,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "address": "fa:16:3e:c9:c5:b4", "network": {"id": "336622a2-627e-4a05-b204-7ab1ef8595ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1520328787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46397870-ba", "ovs_interfaceid": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG nova.network.os_vif_util [req-2361435e-2eae-47c3-a559-8f067210f091 req-e18d7b1e-6e85-4fec-97f7-f9a02f7ff25d service nova] Converting VIF {"id": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "address": "fa:16:3e:c9:c5:b4", "network": {"id": "336622a2-627e-4a05-b204-7ab1ef8595ac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1520328787", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46397870-ba", "ovs_interfaceid": "46397870-ba5d-4bf9-84e7-bb1febeae42e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG nova.network.os_vif_util [req-2361435e-2eae-47c3-a559-8f067210f091 req-e18d7b1e-6e85-4fec-97f7-f9a02f7ff25d service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:c5:b4,bridge_name='br-int',has_traffic_filtering=True,id=46397870-ba5d-4bf9-84e7-bb1febeae42e,network=Network(336622a2-627e-4a05-b204-7ab1ef8595ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46397870-ba') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG os_vif [req-2361435e-2eae-47c3-a559-8f067210f091 req-e18d7b1e-6e85-4fec-97f7-f9a02f7ff25d service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:c5:b4,bridge_name='br-int',has_traffic_filtering=True,id=46397870-ba5d-4bf9-84e7-bb1febeae42e,network=Network(336622a2-627e-4a05-b204-7ab1ef8595ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46397870-ba') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46397870-ba, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:40:26 user nova-compute[75378]: INFO os_vif [req-2361435e-2eae-47c3-a559-8f067210f091 req-e18d7b1e-6e85-4fec-97f7-f9a02f7ff25d service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:c5:b4,bridge_name='br-int',has_traffic_filtering=True,id=46397870-ba5d-4bf9-84e7-bb1febeae42e,network=Network(336622a2-627e-4a05-b204-7ab1ef8595ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46397870-ba')
Nov 09 03:40:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [req-2361435e-2eae-47c3-a559-8f067210f091 req-e18d7b1e-6e85-4fec-97f7-f9a02f7ff25d service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:40:26 user nova-compute[75378]:   <nova:package version="0.0.0"/>
Nov 09 03:40:26 user nova-compute[75378]:   <nova:name>tempest-device-tagging-server-600308768</nova:name>
Nov 09 03:40:26 user nova-compute[75378]:   <nova:creationTime>2023-11-09 03:40:26</nova:creationTime>
Nov 09 03:40:26 user nova-compute[75378]:   <nova:flavor name="m1.tiny">
Nov 09 03:40:26 user nova-compute[75378]:     <nova:memory>512</nova:memory>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:disk>1</nova:disk>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:swap>0</nova:swap>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:vcpus>1</nova:vcpus>
Nov 09 03:40:26 user nova-compute[75378]:   </nova:flavor>
Nov 09 03:40:26 user nova-compute[75378]:   <nova:owner>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:user uuid="1b1261613bc54e7f96c70ed27d8a829e">tempest-TaggedAttachmentsTest-1282324561-project-member</nova:user>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:project uuid="64d1e0442fe540cda81d2a5467664870">tempest-TaggedAttachmentsTest-1282324561</nova:project>
Nov 09 03:40:26 user nova-compute[75378]:   </nova:owner>
Nov 09 03:40:26 user nova-compute[75378]:   <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:40:26 user nova-compute[75378]:   <nova:ports>
Nov 09 03:40:26 user nova-compute[75378]:     <nova:port uuid="23694ef3-48c1-4a9b-9b38-3062aed570e5">
Nov 09 03:40:26 user nova-compute[75378]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 03:40:26 user nova-compute[75378]:     </nova:port>
Nov 09 03:40:26 user nova-compute[75378]:   </nova:ports>
Nov 09 03:40:26 user nova-compute[75378]: </nova:instance>
Nov 09 03:40:26 user nova-compute[75378]:  {{(pid=75378) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG nova.network.neutron [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Updating instance_info_cache with network_info: [{"id": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "address": "fa:16:3e:2e:7c:ad", "network": {"id": "dbae8930-1593-4089-9f9e-4d0ee5306608", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-203847065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23694ef3-48", "ovs_interfaceid": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Releasing lock "refresh_cache-0aa21edc-dc12-46ad-925d-47bc5b576172" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f9e6c83-debb-4523-afbb-94b8324ffe7f tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "interface-0aa21edc-dc12-46ad-925d-47bc5b576172-46397870-ba5d-4bf9-84e7-bb1febeae42e" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.023s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:40:27 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:40:27 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:40:27 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7662MB free_disk=25.59166717529297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9691c96a-287e-40f0-a7e2-70bd56d9d2d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2f475dba-59f5-414a-8156-8b438601ecfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 70a7686e-042c-4be8-8182-69c62027c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 0aa21edc-dc12-46ad-925d-47bc5b576172 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance fadeb1f5-4118-4a08-986a-ff08778b229d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance fc692659-f62e-4d29-909d-0509cf3952b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance b44da21c-9c44-48d2-865c-85ea2f103a89 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:40:27 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:40:28 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:40:28 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:40:28 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:40:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:29 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:40:29 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:40:29 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:40:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "28c97c2c-4939-44e6-bbdc-1351faf78898" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "28c97c2c-4939-44e6-bbdc-1351faf78898" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:32 user nova-compute[75378]: DEBUG nova.compute.manager [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:40:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:40:32 user nova-compute[75378]: INFO nova.compute.claims [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Claim successful on node user
Nov 09 03:40:32 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:40:32 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:40:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:32 user nova-compute[75378]: DEBUG nova.compute.manager [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:40:32 user nova-compute[75378]: DEBUG nova.compute.manager [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:40:32 user nova-compute[75378]: DEBUG nova.network.neutron [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:40:32 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:40:32 user nova-compute[75378]: DEBUG nova.compute.manager [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:40:32 user nova-compute[75378]: DEBUG nova.policy [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6811290b00b044f1b1a0430f775d512a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e8a43607594d039f7514185feb8e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:40:32 user nova-compute[75378]: DEBUG nova.compute.manager [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:40:33 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Creating image(s)
Nov 09 03:40:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "/opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "/opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "/opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.196s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.207s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG nova.network.neutron [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Successfully created port: 209ce7dc-3dc4-485f-acb2-89f8306b93fe {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898/disk 1073741824" returned: 0 in 0.066s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.211s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Cannot resize image /opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Ensure instance console log exists: /opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.network.neutron [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Successfully updated port: 209ce7dc-3dc4-485f-acb2-89f8306b93fe {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "refresh_cache-28c97c2c-4939-44e6-bbdc-1351faf78898" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquired lock "refresh_cache-28c97c2c-4939-44e6-bbdc-1351faf78898" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.network.neutron [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.compute.manager [req-49a31e17-c755-40b3-9f46-2ec42b936049 req-121ec6f5-54bc-4818-b39a-9a6192a3cb99 service nova] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Received event network-changed-209ce7dc-3dc4-485f-acb2-89f8306b93fe {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.compute.manager [req-49a31e17-c755-40b3-9f46-2ec42b936049 req-121ec6f5-54bc-4818-b39a-9a6192a3cb99 service nova] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Refreshing instance network info cache due to event network-changed-209ce7dc-3dc4-485f-acb2-89f8306b93fe. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-49a31e17-c755-40b3-9f46-2ec42b936049 req-121ec6f5-54bc-4818-b39a-9a6192a3cb99 service nova] Acquiring lock "refresh_cache-28c97c2c-4939-44e6-bbdc-1351faf78898" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.network.neutron [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.network.neutron [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Updating instance_info_cache with network_info: [{"id": "209ce7dc-3dc4-485f-acb2-89f8306b93fe", "address": "fa:16:3e:a6:4f:62", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ce7dc-3d", "ovs_interfaceid": "209ce7dc-3dc4-485f-acb2-89f8306b93fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Releasing lock "refresh_cache-28c97c2c-4939-44e6-bbdc-1351faf78898" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.compute.manager [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Instance network_info: |[{"id": "209ce7dc-3dc4-485f-acb2-89f8306b93fe", "address": "fa:16:3e:a6:4f:62", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ce7dc-3d", "ovs_interfaceid": "209ce7dc-3dc4-485f-acb2-89f8306b93fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-49a31e17-c755-40b3-9f46-2ec42b936049 req-121ec6f5-54bc-4818-b39a-9a6192a3cb99 service nova] Acquired lock "refresh_cache-28c97c2c-4939-44e6-bbdc-1351faf78898" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.network.neutron [req-49a31e17-c755-40b3-9f46-2ec42b936049 req-121ec6f5-54bc-4818-b39a-9a6192a3cb99 service nova] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Refreshing network info cache for port 209ce7dc-3dc4-485f-acb2-89f8306b93fe {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Start _get_guest_xml network_info=[{"id": "209ce7dc-3dc4-485f-acb2-89f8306b93fe", "address": "fa:16:3e:a6:4f:62", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ce7dc-3d", "ovs_interfaceid": "209ce7dc-3dc4-485f-acb2-89f8306b93fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:40:34 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:40:34 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:40:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1631135602',display_name='tempest-VolumesAdminNegativeTest-server-1631135602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1631135602',id=13,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13e8a43607594d039f7514185feb8e78',ramdisk_id='',reservation_id='r-nl7aknxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-980015254',owner_user_name='tempest-VolumesAdminNegativeTest-980015254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:40:33Z,user_data=None,user_id='6811290b00b044f1b1a0430f775d512a',uuid=28c97c2c-4939-44e6-bbdc-1351faf78898,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "209ce7dc-3dc4-485f-acb2-89f8306b93fe", "address": "fa:16:3e:a6:4f:62", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ce7dc-3d", "ovs_interfaceid": "209ce7dc-3dc4-485f-acb2-89f8306b93fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Converting VIF {"id": "209ce7dc-3dc4-485f-acb2-89f8306b93fe", "address": "fa:16:3e:a6:4f:62", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ce7dc-3d", "ovs_interfaceid": "209ce7dc-3dc4-485f-acb2-89f8306b93fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4f:62,bridge_name='br-int',has_traffic_filtering=True,id=209ce7dc-3dc4-485f-acb2-89f8306b93fe,network=Network(bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap209ce7dc-3d') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.objects.instance [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lazy-loading 'pci_devices' on Instance uuid 28c97c2c-4939-44e6-bbdc-1351faf78898 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:40:34 user nova-compute[75378]:   <uuid>28c97c2c-4939-44e6-bbdc-1351faf78898</uuid>
Nov 09 03:40:34 user nova-compute[75378]:   <name>instance-0000000d</name>
Nov 09 03:40:34 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:40:34 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:40:34 user nova-compute[75378]:   <metadata>
Nov 09 03:40:34 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:40:34 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:40:34 user nova-compute[75378]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1631135602</nova:name>
Nov 09 03:40:34 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:40:34</nova:creationTime>
Nov 09 03:40:34 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:40:34 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:40:34 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:40:34 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:40:34 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:40:34 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:40:34 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:40:34 user nova-compute[75378]:       <nova:owner>
Nov 09 03:40:34 user nova-compute[75378]:         <nova:user uuid="6811290b00b044f1b1a0430f775d512a">tempest-VolumesAdminNegativeTest-980015254-project-member</nova:user>
Nov 09 03:40:34 user nova-compute[75378]:         <nova:project uuid="13e8a43607594d039f7514185feb8e78">tempest-VolumesAdminNegativeTest-980015254</nova:project>
Nov 09 03:40:34 user nova-compute[75378]:       </nova:owner>
Nov 09 03:40:34 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:40:34 user nova-compute[75378]:       <nova:ports>
Nov 09 03:40:34 user nova-compute[75378]:         <nova:port uuid="209ce7dc-3dc4-485f-acb2-89f8306b93fe">
Nov 09 03:40:34 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 03:40:34 user nova-compute[75378]:         </nova:port>
Nov 09 03:40:34 user nova-compute[75378]:       </nova:ports>
Nov 09 03:40:34 user nova-compute[75378]:     </nova:instance>
Nov 09 03:40:34 user nova-compute[75378]:   </metadata>
Nov 09 03:40:34 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:40:34 user nova-compute[75378]:     <system>
Nov 09 03:40:34 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:40:34 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:40:34 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:40:34 user nova-compute[75378]:       <entry name="serial">28c97c2c-4939-44e6-bbdc-1351faf78898</entry>
Nov 09 03:40:34 user nova-compute[75378]:       <entry name="uuid">28c97c2c-4939-44e6-bbdc-1351faf78898</entry>
Nov 09 03:40:34 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:40:34 user nova-compute[75378]:     </system>
Nov 09 03:40:34 user nova-compute[75378]:   </sysinfo>
Nov 09 03:40:34 user nova-compute[75378]:   <os>
Nov 09 03:40:34 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:40:34 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:40:34 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:40:34 user nova-compute[75378]:   </os>
Nov 09 03:40:34 user nova-compute[75378]:   <features>
Nov 09 03:40:34 user nova-compute[75378]:     <acpi/>
Nov 09 03:40:34 user nova-compute[75378]:     <apic/>
Nov 09 03:40:34 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:40:34 user nova-compute[75378]:   </features>
Nov 09 03:40:34 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:40:34 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:40:34 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:40:34 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:40:34 user nova-compute[75378]:   </clock>
Nov 09 03:40:34 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:40:34 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:40:34 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:40:34 user nova-compute[75378]:   </cpu>
Nov 09 03:40:34 user nova-compute[75378]:   <devices>
Nov 09 03:40:34 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:40:34 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:40:34 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898/disk"/>
Nov 09 03:40:34 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:40:34 user nova-compute[75378]:     </disk>
Nov 09 03:40:34 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:40:34 user nova-compute[75378]:       <mac address="fa:16:3e:a6:4f:62"/>
Nov 09 03:40:34 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:40:34 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:40:34 user nova-compute[75378]:       <target dev="tap209ce7dc-3d"/>
Nov 09 03:40:34 user nova-compute[75378]:     </interface>
Nov 09 03:40:34 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:40:34 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898/console.log" append="off"/>
Nov 09 03:40:34 user nova-compute[75378]:     </serial>
Nov 09 03:40:34 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:40:34 user nova-compute[75378]:     <video>
Nov 09 03:40:34 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:40:34 user nova-compute[75378]:     </video>
Nov 09 03:40:34 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:40:34 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:40:34 user nova-compute[75378]:     </rng>
Nov 09 03:40:34 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:40:34 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:40:34 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:40:34 user nova-compute[75378]:     </memballoon>
Nov 09 03:40:34 user nova-compute[75378]:   </devices>
Nov 09 03:40:34 user nova-compute[75378]: </domain>
Nov 09 03:40:34 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:40:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1631135602',display_name='tempest-VolumesAdminNegativeTest-server-1631135602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1631135602',id=13,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13e8a43607594d039f7514185feb8e78',ramdisk_id='',reservation_id='r-nl7aknxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-980015254',owner_user_name='tempest-VolumesAdminNegativeTest-980015254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:40:33Z,user_data=None,user_id='6811290b00b044f1b1a0430f775d512a',uuid=28c97c2c-4939-44e6-bbdc-1351faf78898,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "209ce7dc-3dc4-485f-acb2-89f8306b93fe", "address": "fa:16:3e:a6:4f:62", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ce7dc-3d", "ovs_interfaceid": "209ce7dc-3dc4-485f-acb2-89f8306b93fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Converting VIF {"id": "209ce7dc-3dc4-485f-acb2-89f8306b93fe", "address": "fa:16:3e:a6:4f:62", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ce7dc-3d", "ovs_interfaceid": "209ce7dc-3dc4-485f-acb2-89f8306b93fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4f:62,bridge_name='br-int',has_traffic_filtering=True,id=209ce7dc-3dc4-485f-acb2-89f8306b93fe,network=Network(bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap209ce7dc-3d') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG os_vif [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4f:62,bridge_name='br-int',has_traffic_filtering=True,id=209ce7dc-3dc4-485f-acb2-89f8306b93fe,network=Network(bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap209ce7dc-3d') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cade2c57-54f0-5ddf-98a5-8263129ea1e9', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap209ce7dc-3d, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap209ce7dc-3d, col_values=(('qos', UUID('fa4b96a9-caed-4fd0-82cd-ec42ba5eb722')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap209ce7dc-3d, col_values=(('external_ids', {'iface-id': '209ce7dc-3dc4-485f-acb2-89f8306b93fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:4f:62', 'vm-uuid': '28c97c2c-4939-44e6-bbdc-1351faf78898'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:34 user nova-compute[75378]: INFO os_vif [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4f:62,bridge_name='br-int',has_traffic_filtering=True,id=209ce7dc-3dc4-485f-acb2-89f8306b93fe,network=Network(bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap209ce7dc-3d')
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] No VIF found with MAC fa:16:3e:a6:4f:62, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.network.neutron [req-49a31e17-c755-40b3-9f46-2ec42b936049 req-121ec6f5-54bc-4818-b39a-9a6192a3cb99 service nova] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Updated VIF entry in instance network info cache for port 209ce7dc-3dc4-485f-acb2-89f8306b93fe. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG nova.network.neutron [req-49a31e17-c755-40b3-9f46-2ec42b936049 req-121ec6f5-54bc-4818-b39a-9a6192a3cb99 service nova] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Updating instance_info_cache with network_info: [{"id": "209ce7dc-3dc4-485f-acb2-89f8306b93fe", "address": "fa:16:3e:a6:4f:62", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ce7dc-3d", "ovs_interfaceid": "209ce7dc-3dc4-485f-acb2-89f8306b93fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:40:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-49a31e17-c755-40b3-9f46-2ec42b936049 req-121ec6f5-54bc-4818-b39a-9a6192a3cb99 service nova] Releasing lock "refresh_cache-28c97c2c-4939-44e6-bbdc-1351faf78898" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:40:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:36 user nova-compute[75378]: DEBUG nova.compute.manager [req-66371997-1ce5-40cb-8203-58397f91de50 req-a97a26ce-7e69-4840-b0c2-93725743ae18 service nova] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Received event network-vif-plugged-209ce7dc-3dc4-485f-acb2-89f8306b93fe {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-66371997-1ce5-40cb-8203-58397f91de50 req-a97a26ce-7e69-4840-b0c2-93725743ae18 service nova] Acquiring lock "28c97c2c-4939-44e6-bbdc-1351faf78898-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-66371997-1ce5-40cb-8203-58397f91de50 req-a97a26ce-7e69-4840-b0c2-93725743ae18 service nova] Lock "28c97c2c-4939-44e6-bbdc-1351faf78898-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-66371997-1ce5-40cb-8203-58397f91de50 req-a97a26ce-7e69-4840-b0c2-93725743ae18 service nova] Lock "28c97c2c-4939-44e6-bbdc-1351faf78898-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:36 user nova-compute[75378]: DEBUG nova.compute.manager [req-66371997-1ce5-40cb-8203-58397f91de50 req-a97a26ce-7e69-4840-b0c2-93725743ae18 service nova] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] No waiting events found dispatching network-vif-plugged-209ce7dc-3dc4-485f-acb2-89f8306b93fe {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:36 user nova-compute[75378]: WARNING nova.compute.manager [req-66371997-1ce5-40cb-8203-58397f91de50 req-a97a26ce-7e69-4840-b0c2-93725743ae18 service nova] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Received unexpected event network-vif-plugged-209ce7dc-3dc4-485f-acb2-89f8306b93fe for instance with vm_state building and task_state spawning.
Nov 09 03:40:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:38 user nova-compute[75378]: DEBUG nova.compute.manager [req-26497670-4631-4405-9932-6fd9afe7ad62 req-9fcf0124-dd45-4064-a396-936bce69dc22 service nova] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Received event network-vif-plugged-209ce7dc-3dc4-485f-acb2-89f8306b93fe {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-26497670-4631-4405-9932-6fd9afe7ad62 req-9fcf0124-dd45-4064-a396-936bce69dc22 service nova] Acquiring lock "28c97c2c-4939-44e6-bbdc-1351faf78898-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-26497670-4631-4405-9932-6fd9afe7ad62 req-9fcf0124-dd45-4064-a396-936bce69dc22 service nova] Lock "28c97c2c-4939-44e6-bbdc-1351faf78898-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-26497670-4631-4405-9932-6fd9afe7ad62 req-9fcf0124-dd45-4064-a396-936bce69dc22 service nova] Lock "28c97c2c-4939-44e6-bbdc-1351faf78898-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:38 user nova-compute[75378]: DEBUG nova.compute.manager [req-26497670-4631-4405-9932-6fd9afe7ad62 req-9fcf0124-dd45-4064-a396-936bce69dc22 service nova] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] No waiting events found dispatching network-vif-plugged-209ce7dc-3dc4-485f-acb2-89f8306b93fe {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:38 user nova-compute[75378]: WARNING nova.compute.manager [req-26497670-4631-4405-9932-6fd9afe7ad62 req-9fcf0124-dd45-4064-a396-936bce69dc22 service nova] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Received unexpected event network-vif-plugged-209ce7dc-3dc4-485f-acb2-89f8306b93fe for instance with vm_state building and task_state spawning.
Nov 09 03:40:38 user nova-compute[75378]: DEBUG nova.compute.manager [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:40:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:40:38 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Instance spawned successfully.
Nov 09 03:40:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:40:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:40:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:40:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:40:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:40:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:40:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:40:38 user nova-compute[75378]: INFO nova.compute.manager [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 09 03:40:38 user nova-compute[75378]: DEBUG nova.compute.manager [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:40:38 user nova-compute[75378]: INFO nova.compute.manager [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Took 6.50 seconds to build instance.
Nov 09 03:40:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-48ed075a-d337-4311-8077-2b92fec84108 tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "28c97c2c-4939-44e6-bbdc-1351faf78898" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.600s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Acquiring lock "fc692659-f62e-4d29-909d-0509cf3952b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Lock "fc692659-f62e-4d29-909d-0509cf3952b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Acquiring lock "fc692659-f62e-4d29-909d-0509cf3952b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Lock "fc692659-f62e-4d29-909d-0509cf3952b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Lock "fc692659-f62e-4d29-909d-0509cf3952b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:46 user nova-compute[75378]: INFO nova.compute.manager [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Terminating instance
Nov 09 03:40:46 user nova-compute[75378]: DEBUG nova.compute.manager [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:40:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-0b4510f8-6513-4bba-a1f7-03e42522efd3 req-cff1f05b-ef21-47e3-bbe0-a2fe577400c0 service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Received event network-vif-unplugged-ee5357d8-2dbf-42d7-90eb-01409b3f3a55 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0b4510f8-6513-4bba-a1f7-03e42522efd3 req-cff1f05b-ef21-47e3-bbe0-a2fe577400c0 service nova] Acquiring lock "fc692659-f62e-4d29-909d-0509cf3952b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0b4510f8-6513-4bba-a1f7-03e42522efd3 req-cff1f05b-ef21-47e3-bbe0-a2fe577400c0 service nova] Lock "fc692659-f62e-4d29-909d-0509cf3952b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0b4510f8-6513-4bba-a1f7-03e42522efd3 req-cff1f05b-ef21-47e3-bbe0-a2fe577400c0 service nova] Lock "fc692659-f62e-4d29-909d-0509cf3952b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-0b4510f8-6513-4bba-a1f7-03e42522efd3 req-cff1f05b-ef21-47e3-bbe0-a2fe577400c0 service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] No waiting events found dispatching network-vif-unplugged-ee5357d8-2dbf-42d7-90eb-01409b3f3a55 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-0b4510f8-6513-4bba-a1f7-03e42522efd3 req-cff1f05b-ef21-47e3-bbe0-a2fe577400c0 service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Received event network-vif-unplugged-ee5357d8-2dbf-42d7-90eb-01409b3f3a55 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:40:47 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Instance destroyed successfully.
Nov 09 03:40:47 user nova-compute[75378]: DEBUG nova.objects.instance [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Lazy-loading 'resources' on Instance uuid fc692659-f62e-4d29-909d-0509cf3952b4 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:40:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-181845688',display_name='tempest-VolumesAssistedSnapshotsTest-server-181845688',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-181845688',id=9,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+454xopdGSPXSkR9UIu7XCPexLbHJvWNhAhc/n6jRQZROXGx5mAqA2vugmKKSg/x9dqy3G6sOjRvD/tRJeRcLB8DB5L/5RwBetXsIZ9DagRs1PAxn6xWRvunNeTxgnaQ==',key_name='tempest-keypair-1299847380',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:37:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8bed46ae0b24564a8a9c68eec52f022',ramdisk_id='',reservation_id='r-d8m81srw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1262744615',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1262744615-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:37:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c8c79296ff44e45863e87cadce0cb68',uuid=fc692659-f62e-4d29-909d-0509cf3952b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "address": "fa:16:3e:2d:24:6f", "network": {"id": "fcedd8b7-ea71-40c5-9aaa-012a32d034dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-102964368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8bed46ae0b24564a8a9c68eec52f022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee5357d8-2d", "ovs_interfaceid": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:40:47 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Converting VIF {"id": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "address": "fa:16:3e:2d:24:6f", "network": {"id": "fcedd8b7-ea71-40c5-9aaa-012a32d034dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-102964368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8bed46ae0b24564a8a9c68eec52f022", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee5357d8-2d", "ovs_interfaceid": "ee5357d8-2dbf-42d7-90eb-01409b3f3a55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:47 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:24:6f,bridge_name='br-int',has_traffic_filtering=True,id=ee5357d8-2dbf-42d7-90eb-01409b3f3a55,network=Network(fcedd8b7-ea71-40c5-9aaa-012a32d034dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee5357d8-2d') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:47 user nova-compute[75378]: DEBUG os_vif [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:24:6f,bridge_name='br-int',has_traffic_filtering=True,id=ee5357d8-2dbf-42d7-90eb-01409b3f3a55,network=Network(fcedd8b7-ea71-40c5-9aaa-012a32d034dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee5357d8-2d') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:40:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee5357d8-2d, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a085b2d5-8994-41a2-a6ca-98e48aa7cb65) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:47 user nova-compute[75378]: INFO os_vif [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:24:6f,bridge_name='br-int',has_traffic_filtering=True,id=ee5357d8-2dbf-42d7-90eb-01409b3f3a55,network=Network(fcedd8b7-ea71-40c5-9aaa-012a32d034dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee5357d8-2d')
Nov 09 03:40:47 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Deleting instance files /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4_del
Nov 09 03:40:47 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Deletion of /opt/stack/data/nova/instances/fc692659-f62e-4d29-909d-0509cf3952b4_del complete
Nov 09 03:40:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:47 user nova-compute[75378]: INFO nova.compute.manager [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 09 03:40:47 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:40:47 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:40:47 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:40:48 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:40:48 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Took 0.73 seconds to deallocate network for instance.
Nov 09 03:40:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:48 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:40:48 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:40:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:48 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Deleted allocations for instance fc692659-f62e-4d29-909d-0509cf3952b4
Nov 09 03:40:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-15d4e171-b199-443f-b495-2ec7d1cc39ee tempest-VolumesAssistedSnapshotsTest-1262744615 tempest-VolumesAssistedSnapshotsTest-1262744615-project-member] Lock "fc692659-f62e-4d29-909d-0509cf3952b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.321s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:49 user nova-compute[75378]: DEBUG nova.compute.manager [req-3c7cb27e-d02a-4924-86fe-b7801ef13364 req-ac37f41b-e051-4c03-99b3-9d70a25fd86e service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Received event network-vif-plugged-ee5357d8-2dbf-42d7-90eb-01409b3f3a55 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3c7cb27e-d02a-4924-86fe-b7801ef13364 req-ac37f41b-e051-4c03-99b3-9d70a25fd86e service nova] Acquiring lock "fc692659-f62e-4d29-909d-0509cf3952b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3c7cb27e-d02a-4924-86fe-b7801ef13364 req-ac37f41b-e051-4c03-99b3-9d70a25fd86e service nova] Lock "fc692659-f62e-4d29-909d-0509cf3952b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3c7cb27e-d02a-4924-86fe-b7801ef13364 req-ac37f41b-e051-4c03-99b3-9d70a25fd86e service nova] Lock "fc692659-f62e-4d29-909d-0509cf3952b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:49 user nova-compute[75378]: DEBUG nova.compute.manager [req-3c7cb27e-d02a-4924-86fe-b7801ef13364 req-ac37f41b-e051-4c03-99b3-9d70a25fd86e service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] No waiting events found dispatching network-vif-plugged-ee5357d8-2dbf-42d7-90eb-01409b3f3a55 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:49 user nova-compute[75378]: WARNING nova.compute.manager [req-3c7cb27e-d02a-4924-86fe-b7801ef13364 req-ac37f41b-e051-4c03-99b3-9d70a25fd86e service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Received unexpected event network-vif-plugged-ee5357d8-2dbf-42d7-90eb-01409b3f3a55 for instance with vm_state deleted and task_state None.
Nov 09 03:40:49 user nova-compute[75378]: DEBUG nova.compute.manager [req-3c7cb27e-d02a-4924-86fe-b7801ef13364 req-ac37f41b-e051-4c03-99b3-9d70a25fd86e service nova] [instance: fc692659-f62e-4d29-909d-0509cf3952b4] Received event network-vif-deleted-ee5357d8-2dbf-42d7-90eb-01409b3f3a55 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etYnaShu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:40:54 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:40:54 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:40:54 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d313938-6141-4be2-a47b-35ec1556c8bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:40:54 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f1cf0f-c178-4a4f-a5db-6fa8484977c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be] added
Nov 09 03:40:54 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[511bd31b-59c1-45fa-8682-2c68e08d7281]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bc9ff2-5219-4690-8f1f-eea884fa27e6]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etYnaShu {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etYnaShu" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[545367cf-a76e-41d4-85f1-71f0fe7a6059]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'etYnaShu'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ee1506-3700-454f-9827-f87596d63f6c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cfd741-e9a5-42d6-95dd-761421b6afd2]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:54 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:40:54 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:40:54 user nova-compute[75378]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)
Nov 09 03:40:54 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:54 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:40:54 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:40:54 user nova-compute[75378]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)
Nov 09 03:40:54 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf002fdb-40ff-4b31-baf5-53496ec7f187]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260]
Nov 09 03:40:54 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260] successful.
Nov 09 03:40:54 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a37144-b30c-4125-8f17-11105e9a215e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb800ab1-c792-43ad-8630-280f99562fd2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:40:54 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:54 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:40:54 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:40:54 user nova-compute[75378]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)
Nov 09 03:40:54 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:40:54 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:40:54 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:40:54 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:40:54 user nova-compute[75378]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)
Nov 09 03:40:54 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] HCTL ('37', '-', '-', 0) found on session 10 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7791acb4-cdb9-4fdf-9dfa-5f35719312a2]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:40:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etYnaShu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:40:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:40:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23733653230393733', 'path': '/dev/sdf'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:40:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733653230393733', 'path': '/dev/sdf'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:40:55 user nova-compute[75378]: DEBUG nova.objects.instance [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lazy-loading 'flavor' on Instance uuid 2f475dba-59f5-414a-8156-8b438601ecfd {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:40:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 03:40:55 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:40:55 user nova-compute[75378]:   <source dev="/dev/sdf"/>
Nov 09 03:40:55 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:40:55 user nova-compute[75378]:   <serial>93b2608a-e6b8-4844-820c-71f0cd80f3be</serial>
Nov 09 03:40:55 user nova-compute[75378]: </disk>
Nov 09 03:40:55 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 03:40:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:40:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:40:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] No VIF found with MAC fa:16:3e:07:9f:69, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:40:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e637c23e-1af7-4df9-9d2a-f5cab19e19db tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "2f475dba-59f5-414a-8156-8b438601ecfd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.677s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquiring lock "0aa21edc-dc12-46ad-925d-47bc5b576172" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquiring lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:56 user nova-compute[75378]: INFO nova.compute.manager [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Terminating instance
Nov 09 03:40:56 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:40:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:56 user nova-compute[75378]: DEBUG nova.compute.manager [req-6a784678-e29a-4614-b40f-5b63f07a976e req-5d4f54fd-0551-4807-9ef5-ba13a2db3334 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Received event network-vif-unplugged-23694ef3-48c1-4a9b-9b38-3062aed570e5 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6a784678-e29a-4614-b40f-5b63f07a976e req-5d4f54fd-0551-4807-9ef5-ba13a2db3334 service nova] Acquiring lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6a784678-e29a-4614-b40f-5b63f07a976e req-5d4f54fd-0551-4807-9ef5-ba13a2db3334 service nova] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6a784678-e29a-4614-b40f-5b63f07a976e req-5d4f54fd-0551-4807-9ef5-ba13a2db3334 service nova] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:56 user nova-compute[75378]: DEBUG nova.compute.manager [req-6a784678-e29a-4614-b40f-5b63f07a976e req-5d4f54fd-0551-4807-9ef5-ba13a2db3334 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] No waiting events found dispatching network-vif-unplugged-23694ef3-48c1-4a9b-9b38-3062aed570e5 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:56 user nova-compute[75378]: DEBUG nova.compute.manager [req-6a784678-e29a-4614-b40f-5b63f07a976e req-5d4f54fd-0551-4807-9ef5-ba13a2db3334 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Received event network-vif-unplugged-23694ef3-48c1-4a9b-9b38-3062aed570e5 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:40:57 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Instance destroyed successfully.
Nov 09 03:40:57 user nova-compute[75378]: DEBUG nova.objects.instance [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lazy-loading 'resources' on Instance uuid 0aa21edc-dc12-46ad-925d-47bc5b576172 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:40:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-600308768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-600308768',id=6,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7Zi3/OBwBWFZyzirh8mZQ4BgVFx7fj6XXgOw9/PxXUG8dZzej6jh1WqLhuSvXrU5svCvjW/PsldUVgziNo99MiMWj1iBWLdTs8DNBiQq2fEkWCg0hw0gQlP+3PQUsmdg==',key_name='tempest-keypair-1523638191',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:37:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64d1e0442fe540cda81d2a5467664870',ramdisk_id='',reservation_id='r-776ypqd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1282324561',owner_user_name='tempest-TaggedAttachmentsTest-1282324561-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b1261613bc54e7f96c70ed27d8a829e',uuid=0aa21edc-dc12-46ad-925d-47bc5b576172,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "address": "fa:16:3e:2e:7c:ad", "network": {"id": "dbae8930-1593-4089-9f9e-4d0ee5306608", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-203847065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23694ef3-48", "ovs_interfaceid": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:40:57 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Converting VIF {"id": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "address": "fa:16:3e:2e:7c:ad", "network": {"id": "dbae8930-1593-4089-9f9e-4d0ee5306608", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-203847065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d1e0442fe540cda81d2a5467664870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23694ef3-48", "ovs_interfaceid": "23694ef3-48c1-4a9b-9b38-3062aed570e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:40:57 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:7c:ad,bridge_name='br-int',has_traffic_filtering=True,id=23694ef3-48c1-4a9b-9b38-3062aed570e5,network=Network(dbae8930-1593-4089-9f9e-4d0ee5306608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23694ef3-48') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:40:57 user nova-compute[75378]: DEBUG os_vif [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:7c:ad,bridge_name='br-int',has_traffic_filtering=True,id=23694ef3-48c1-4a9b-9b38-3062aed570e5,network=Network(dbae8930-1593-4089-9f9e-4d0ee5306608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23694ef3-48') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:40:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23694ef3-48, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:40:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bac11648-689f-4484-b367-b2e91fedbdbb) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:40:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:40:57 user nova-compute[75378]: INFO os_vif [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:7c:ad,bridge_name='br-int',has_traffic_filtering=True,id=23694ef3-48c1-4a9b-9b38-3062aed570e5,network=Network(dbae8930-1593-4089-9f9e-4d0ee5306608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23694ef3-48')
Nov 09 03:40:57 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Deleting instance files /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172_del
Nov 09 03:40:57 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Deletion of /opt/stack/data/nova/instances/0aa21edc-dc12-46ad-925d-47bc5b576172_del complete
Nov 09 03:40:57 user nova-compute[75378]: INFO nova.compute.manager [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 09 03:40:57 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:40:57 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:40:57 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:40:58 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:40:58 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Took 1.44 seconds to deallocate network for instance.
Nov 09 03:40:58 user nova-compute[75378]: DEBUG nova.compute.manager [req-3834fcf3-10f4-41da-b341-a398e49a5afd req-a358d124-0c5a-4cf7-8d0b-b12093861353 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Received event network-vif-deleted-23694ef3-48c1-4a9b-9b38-3062aed570e5 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:58 user nova-compute[75378]: DEBUG nova.compute.manager [req-9b8baa38-3ff5-4acf-8f92-d4b9bb624250 req-714915fb-6448-491a-9577-53624a903e28 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Received event network-vif-plugged-23694ef3-48c1-4a9b-9b38-3062aed570e5 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:40:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9b8baa38-3ff5-4acf-8f92-d4b9bb624250 req-714915fb-6448-491a-9577-53624a903e28 service nova] Acquiring lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9b8baa38-3ff5-4acf-8f92-d4b9bb624250 req-714915fb-6448-491a-9577-53624a903e28 service nova] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9b8baa38-3ff5-4acf-8f92-d4b9bb624250 req-714915fb-6448-491a-9577-53624a903e28 service nova] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:58 user nova-compute[75378]: DEBUG nova.compute.manager [req-9b8baa38-3ff5-4acf-8f92-d4b9bb624250 req-714915fb-6448-491a-9577-53624a903e28 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] No waiting events found dispatching network-vif-plugged-23694ef3-48c1-4a9b-9b38-3062aed570e5 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:40:58 user nova-compute[75378]: WARNING nova.compute.manager [req-9b8baa38-3ff5-4acf-8f92-d4b9bb624250 req-714915fb-6448-491a-9577-53624a903e28 service nova] [instance: 0aa21edc-dc12-46ad-925d-47bc5b576172] Received unexpected event network-vif-plugged-23694ef3-48c1-4a9b-9b38-3062aed570e5 for instance with vm_state active and task_state deleting.
Nov 09 03:40:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Stashing vm_state: active {{(pid=75378) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 09 03:40:59 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:40:59 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:40:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:59 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Deleted allocations for instance 0aa21edc-dc12-46ad-925d-47bc5b576172
Nov 09 03:40:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:40:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:40:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:40:59 user nova-compute[75378]: INFO nova.compute.claims [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Claim successful on node user
Nov 09 03:40:59 user nova-compute[75378]: INFO nova.compute.resource_tracker [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Updating resource usage from migration 3130c521-681a-4402-886d-44c0d7257008
Nov 09 03:40:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4b2e657a-140f-4668-8f50-a04be71a3ded tempest-TaggedAttachmentsTest-1282324561 tempest-TaggedAttachmentsTest-1282324561-project-member] Lock "0aa21edc-dc12-46ad-925d-47bc5b576172" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.288s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:59 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:40:59 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:40:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.484s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:40:59 user nova-compute[75378]: INFO nova.compute.manager [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Migrating
Nov 09 03:40:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:40:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:40:59 user nova-compute[75378]: INFO nova.compute.rpcapi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 09 03:40:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:40:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:40:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquired lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:40:59 user nova-compute[75378]: DEBUG nova.network.neutron [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:41:00 user nova-compute[75378]: DEBUG nova.network.neutron [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Updating instance_info_cache with network_info: [{"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:41:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Releasing lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:41:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Starting migrate_disk_and_power_off {{(pid=75378) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 09 03:41:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-9ed9adf9-9352-443d-aca2-211d8cae31e5 req-69e5931d-3efc-42a9-b597-d4b9ef486b65 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received event network-vif-unplugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:41:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9ed9adf9-9352-443d-aca2-211d8cae31e5 req-69e5931d-3efc-42a9-b597-d4b9ef486b65 service nova] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:41:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9ed9adf9-9352-443d-aca2-211d8cae31e5 req-69e5931d-3efc-42a9-b597-d4b9ef486b65 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:41:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9ed9adf9-9352-443d-aca2-211d8cae31e5 req-69e5931d-3efc-42a9-b597-d4b9ef486b65 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:41:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-9ed9adf9-9352-443d-aca2-211d8cae31e5 req-69e5931d-3efc-42a9-b597-d4b9ef486b65 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] No waiting events found dispatching network-vif-unplugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:41:00 user nova-compute[75378]: WARNING nova.compute.manager [req-9ed9adf9-9352-443d-aca2-211d8cae31e5 req-69e5931d-3efc-42a9-b597-d4b9ef486b65 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received unexpected event network-vif-unplugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 for instance with vm_state active and task_state resize_migrating.
Nov 09 03:41:01 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Instance destroyed successfully.
Nov 09 03:41:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1138780210',display_name='tempest-ServerActionsTestOtherB-server-1138780210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1138780210',id=4,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+s7M8RwDJb3loYxaUJGVxjbTQ9aVX7ngKf1RZUNQALVC7bsteyYsWXKwZsj2SvyMQBcJEfxsQ8l4Bn0IQtqoWxZ715fiA5I3KyJRgBFHf7jRe97Ql+ZXV7Ej5ZLqWSCg==',key_name='tempest-keypair-904427918',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cb0bda222cd54a44bd26b140d08d8274',ramdisk_id='',reservation_id='r-u0jhm5ex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1007633314',owner_user_name='tempest-ServerActionsTestOtherB-1007633314-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:40:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7bb5d4c95c341beaa22c1bbeacaf4f7',uuid=2f475dba-59f5-414a-8156-8b438601ecfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-853392482-network", "vif_mac": "fa:16:3e:07:9f:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Converting VIF {"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-853392482-network", "vif_mac": "fa:16:3e:07:9f:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:9f:69,bridge_name='br-int',has_traffic_filtering=True,id=d0fa9225-bc1d-4d57-b259-5a6d1e3638f8,network=Network(2e704dce-6cba-4cf1-bd3e-d05da48d7839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fa9225-bc') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG os_vif [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:9f:69,bridge_name='br-int',has_traffic_filtering=True,id=d0fa9225-bc1d-4d57-b259-5a6d1e3638f8,network=Network(2e704dce-6cba-4cf1-bd3e-d05da48d7839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fa9225-bc') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0fa9225-bc, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2bff65c1-8c05-4dd7-b0c3-54031054506c) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:01 user nova-compute[75378]: INFO os_vif [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:9f:69,bridge_name='br-int',has_traffic_filtering=True,id=d0fa9225-bc1d-4d57-b259-5a6d1e3638f8,network=Network(2e704dce-6cba-4cf1-bd3e-d05da48d7839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fa9225-bc')
Nov 09 03:41:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etYnaShu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:41:01 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:41:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf083d1-fa12-4d77-8f68-f16d8d084a60]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:41:01 user nova-compute[75378]: No targets found.
Nov 09 03:41:01 user nova-compute[75378]: iSNS:
Nov 09 03:41:01 user nova-compute[75378]: No targets found.
Nov 09 03:41:01 user nova-compute[75378]: STATIC:
Nov 09 03:41:01 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e
Nov 09 03:41:01 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:41:01 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:41:01 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc
Nov 09 03:41:01 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:41:01 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:41:01 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac
Nov 09 03:41:01 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:41:01 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:41:01 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be
Nov 09 03:41:01 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:41:01 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:41:01 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66
Nov 09 03:41:01 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:41:01 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:41:01 user nova-compute[75378]: FIRMWARE:
Nov 09 03:41:01 user nova-compute[75378]: No targets found.
Nov 09 03:41:01 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:41:01 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:41:01 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd87b6c1-14d3-48ed-a72d-a5a0cea8a1e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[00efdfa9-7497-4b28-b89d-216f5f6aab33]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:41:01 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:41:01 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:41:01 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:41:01 user nova-compute[75378]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)
Nov 09 03:41:01 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:41:01 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:41:01 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:41:01 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:41:01 user nova-compute[75378]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)
Nov 09 03:41:01 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3b053db40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be'): ({'sdf'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Removing single pathed devices sdf {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7e0ea7-df80-47be-91c1-af86279d9da5]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b989c36f-6766-497c-b8fc-65408e2d2bbf]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Flushing IO for device /dev/sdf {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df6883b-312b-465b-b449-f21ec03d1ae8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.062s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7796586f-e97f-4f83-87f4-e253ead8deab]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] SCSI volumes sdf have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[786c3478-a2ec-4efb-941e-8b3d0639eac5]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5043c5cd-c3ca-45bb-a4d0-fbfaa549b850]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260]
Nov 09 03:41:01 user nova-compute[75378]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260] successful.
Nov 09 03:41:01 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[17185155-8353-43cc-b343-9391392d67aa]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] <== disconnect_volume: return (388ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:41:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:41:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd_resize/disk /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] CMD "cp -r /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd_resize/disk /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk" returned: 0 in 0.356s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd_resize/disk.info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk.info {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] CMD "cp -r /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd_resize/disk.info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk.info" returned: 0 in 0.040s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-2f2cbf61-094e-421a-8c38-a8fa2a774d92 req-910e0cdb-218b-4729-a011-c6e3962244f3 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:41:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2f2cbf61-094e-421a-8c38-a8fa2a774d92 req-910e0cdb-218b-4729-a011-c6e3962244f3 service nova] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:41:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2f2cbf61-094e-421a-8c38-a8fa2a774d92 req-910e0cdb-218b-4729-a011-c6e3962244f3 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:41:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2f2cbf61-094e-421a-8c38-a8fa2a774d92 req-910e0cdb-218b-4729-a011-c6e3962244f3 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:41:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-2f2cbf61-094e-421a-8c38-a8fa2a774d92 req-910e0cdb-218b-4729-a011-c6e3962244f3 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] No waiting events found dispatching network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:41:03 user nova-compute[75378]: WARNING nova.compute.manager [req-2f2cbf61-094e-421a-8c38-a8fa2a774d92 req-910e0cdb-218b-4729-a011-c6e3962244f3 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received unexpected event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 for instance with vm_state active and task_state resize_migrating.
Nov 09 03:41:04 user nova-compute[75378]: DEBUG nova.network.neutron [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Port d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 binding to destination host user is already ACTIVE {{(pid=75378) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 09 03:41:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:41:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:41:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:41:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:41:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquired lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:41:04 user nova-compute[75378]: DEBUG nova.network.neutron [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:41:04 user nova-compute[75378]: DEBUG nova.network.neutron [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Updating instance_info_cache with network_info: [{"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:41:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Releasing lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:41:04 user nova-compute[75378]: DEBUG os_brick.utils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:41:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:04 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6aed75-7839-4638-89da-825e774fd78c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:04 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cb3c63-bb43-4267-9c7e-bcd2919f71ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:04 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[af055426-5fa3-415f-b5ca-1187efa7d9d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:04 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac109fb-3a59-4e9c-ad03-6f41ec74c893]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:41:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:41:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:41:05 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:41:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f64abd-ce02-45ae-a84e-f5c4d7b5e24b]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:41:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:41:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:41:05 user nova-compute[75378]: DEBUG os_brick.utils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:41:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:17 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:41:21 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:41:21 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:41:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:41:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 03:41:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:41:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:41:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:22 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:41:22 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:41:23 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:41:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:41:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-70a7686e-042c-4be8-8182-69c62027c744" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:41:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-70a7686e-042c-4be8-8182-69c62027c744" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:41:23 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 03:41:23 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Updating instance_info_cache with network_info: [{"id": "cf0655e0-c321-449f-840d-89a729a9b6ad", "address": "fa:16:3e:83:d7:60", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0655e0-c3", "ovs_interfaceid": "cf0655e0-c321-449f-840d-89a729a9b6ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:41:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-70a7686e-042c-4be8-8182-69c62027c744" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:41:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 03:41:23 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:41:24 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:41:24 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:41:24 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:41:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:41:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:41:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:41:24 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:41:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:41:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:41:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:41:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:41:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:41:28 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:41:28 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:41:28 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7809MB free_disk=25.626068115234375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:41:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:41:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:41:28 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Applying migration context for instance 2f475dba-59f5-414a-8156-8b438601ecfd as it has an incoming, in-progress migration 3130c521-681a-4402-886d-44c0d7257008. Migration status is post-migrating {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 09 03:41:28 user nova-compute[75378]: INFO nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Updating resource usage from migration 3130c521-681a-4402-886d-44c0d7257008
Nov 09 03:41:28 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9691c96a-287e-40f0-a7e2-70bd56d9d2d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:41:28 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:41:28 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:41:28 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 70a7686e-042c-4be8-8182-69c62027c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:41:28 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance fadeb1f5-4118-4a08-986a-ff08778b229d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:41:28 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance b44da21c-9c44-48d2-865c-85ea2f103a89 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:41:28 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 28c97c2c-4939-44e6-bbdc-1351faf78898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:41:28 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Migration 3130c521-681a-4402-886d-44c0d7257008 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 09 03:41:28 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2f475dba-59f5-414a-8156-8b438601ecfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:41:28 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:41:28 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:41:29 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:41:29 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:41:29 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:41:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:41:29 user nova-compute[75378]: INFO nova.compute.manager [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Rescuing
Nov 09 03:41:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "refresh_cache-c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:41:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquired lock "refresh_cache-c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:41:29 user nova-compute[75378]: DEBUG nova.network.neutron [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:41:30 user nova-compute[75378]: DEBUG nova.network.neutron [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Updating instance_info_cache with network_info: [{"id": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "address": "fa:16:3e:a6:f3:49", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d42515-fd", "ovs_interfaceid": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:41:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Releasing lock "refresh_cache-c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:41:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.compute.manager [req-834f9344-48c8-4235-8f9d-c7eff5072b85 req-a538124a-fb6b-4b5b-946c-ec96771d74b2 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received event network-vif-unplugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-834f9344-48c8-4235-8f9d-c7eff5072b85 req-a538124a-fb6b-4b5b-946c-ec96771d74b2 service nova] Acquiring lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-834f9344-48c8-4235-8f9d-c7eff5072b85 req-a538124a-fb6b-4b5b-946c-ec96771d74b2 service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-834f9344-48c8-4235-8f9d-c7eff5072b85 req-a538124a-fb6b-4b5b-946c-ec96771d74b2 service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.compute.manager [req-834f9344-48c8-4235-8f9d-c7eff5072b85 req-a538124a-fb6b-4b5b-946c-ec96771d74b2 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] No waiting events found dispatching network-vif-unplugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:41:31 user nova-compute[75378]: WARNING nova.compute.manager [req-834f9344-48c8-4235-8f9d-c7eff5072b85 req-a538124a-fb6b-4b5b-946c-ec96771d74b2 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received unexpected event network-vif-unplugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a for instance with vm_state active and task_state rescuing.
Nov 09 03:41:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:31 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Instance destroyed successfully.
Nov 09 03:41:31 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Attempting rescue
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75378) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Instance directory exists: not creating {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 03:41:31 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Creating image(s)
Nov 09 03:41:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "/opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "/opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "/opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.objects.instance [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'trusted_certs' on Instance uuid c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.195s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk.rescue {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk.rescue" returned: 0 in 0.061s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.objects.instance [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'migration_context' on Instance uuid c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.objects.base [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Object Instance<c647ac61-b8d0-4b30-b1cc-86ddc896eaa3> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Start _get_guest_xml network_info=[{"id": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "address": "fa:16:3e:a6:f3:49", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "vif_mac": "fa:16:3e:a6:f3:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d42515-fd", "ovs_interfaceid": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.objects.instance [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'resources' on Instance uuid c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.objects.base [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Object Instance<c647ac61-b8d0-4b30-b1cc-86ddc896eaa3> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.objects.instance [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'numa_topology' on Instance uuid c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.objects.base [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Object Instance<c647ac61-b8d0-4b30-b1cc-86ddc896eaa3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:41:31 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:41:31 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.objects.instance [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'vcpu_model' on Instance uuid c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.objects.base [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Object Instance<c647ac61-b8d0-4b30-b1cc-86ddc896eaa3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1026804955',display_name='tempest-ServerRescueNegativeTestJSON-server-1026804955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1026804955',id=2,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:36:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87cddc7aab3e44cf82391eebc6a167b1',ramdisk_id='',reservation_id='r-lxupg3g9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1449314788',owner_user_name='tempest-ServerRescueNegativeTestJSON-1449314788-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:36:42Z,user_data=None,user_id='ab29d2c2dda547aeb386aa641f4acd24',uuid=c647ac61-b8d0-4b30-b1cc-86ddc896eaa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "address": "fa:16:3e:a6:f3:49", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "vif_mac": "fa:16:3e:a6:f3:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d42515-fd", "ovs_interfaceid": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converting VIF {"id": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "address": "fa:16:3e:a6:f3:49", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "vif_mac": "fa:16:3e:a6:f3:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d42515-fd", "ovs_interfaceid": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:f3:49,bridge_name='br-int',has_traffic_filtering=True,id=27d42515-fd6b-4627-bfb1-06ee1c1dc36a,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d42515-fd') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.objects.instance [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'pci_devices' on Instance uuid c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.objects.base [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Object Instance<c647ac61-b8d0-4b30-b1cc-86ddc896eaa3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:41:31 user nova-compute[75378]:   <uuid>c647ac61-b8d0-4b30-b1cc-86ddc896eaa3</uuid>
Nov 09 03:41:31 user nova-compute[75378]:   <name>instance-00000002</name>
Nov 09 03:41:31 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:41:31 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:41:31 user nova-compute[75378]:   <metadata>
Nov 09 03:41:31 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:41:31 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:41:31 user nova-compute[75378]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1026804955</nova:name>
Nov 09 03:41:31 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:41:31</nova:creationTime>
Nov 09 03:41:31 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:41:31 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:41:31 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:41:31 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:41:31 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:41:31 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:41:31 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:41:31 user nova-compute[75378]:       <nova:owner>
Nov 09 03:41:31 user nova-compute[75378]:         <nova:user uuid="ab29d2c2dda547aeb386aa641f4acd24">tempest-ServerRescueNegativeTestJSON-1449314788-project-member</nova:user>
Nov 09 03:41:31 user nova-compute[75378]:         <nova:project uuid="87cddc7aab3e44cf82391eebc6a167b1">tempest-ServerRescueNegativeTestJSON-1449314788</nova:project>
Nov 09 03:41:31 user nova-compute[75378]:       </nova:owner>
Nov 09 03:41:31 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:41:31 user nova-compute[75378]:       <nova:ports>
Nov 09 03:41:31 user nova-compute[75378]:         <nova:port uuid="27d42515-fd6b-4627-bfb1-06ee1c1dc36a">
Nov 09 03:41:31 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 03:41:31 user nova-compute[75378]:         </nova:port>
Nov 09 03:41:31 user nova-compute[75378]:       </nova:ports>
Nov 09 03:41:31 user nova-compute[75378]:     </nova:instance>
Nov 09 03:41:31 user nova-compute[75378]:   </metadata>
Nov 09 03:41:31 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:41:31 user nova-compute[75378]:     <system>
Nov 09 03:41:31 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:41:31 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:41:31 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:41:31 user nova-compute[75378]:       <entry name="serial">c647ac61-b8d0-4b30-b1cc-86ddc896eaa3</entry>
Nov 09 03:41:31 user nova-compute[75378]:       <entry name="uuid">c647ac61-b8d0-4b30-b1cc-86ddc896eaa3</entry>
Nov 09 03:41:31 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:41:31 user nova-compute[75378]:     </system>
Nov 09 03:41:31 user nova-compute[75378]:   </sysinfo>
Nov 09 03:41:31 user nova-compute[75378]:   <os>
Nov 09 03:41:31 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:41:31 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:41:31 user nova-compute[75378]:   </os>
Nov 09 03:41:31 user nova-compute[75378]:   <features>
Nov 09 03:41:31 user nova-compute[75378]:     <acpi/>
Nov 09 03:41:31 user nova-compute[75378]:     <apic/>
Nov 09 03:41:31 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:41:31 user nova-compute[75378]:   </features>
Nov 09 03:41:31 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:41:31 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:41:31 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:41:31 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:41:31 user nova-compute[75378]:   </clock>
Nov 09 03:41:31 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:41:31 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:41:31 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:41:31 user nova-compute[75378]:   </cpu>
Nov 09 03:41:31 user nova-compute[75378]:   <devices>
Nov 09 03:41:31 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:41:31 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:41:31 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk.rescue"/>
Nov 09 03:41:31 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:41:31 user nova-compute[75378]:     </disk>
Nov 09 03:41:31 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:41:31 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:41:31 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk"/>
Nov 09 03:41:31 user nova-compute[75378]:       <target dev="vdb" bus="virtio"/>
Nov 09 03:41:31 user nova-compute[75378]:     </disk>
Nov 09 03:41:31 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:41:31 user nova-compute[75378]:       <mac address="fa:16:3e:a6:f3:49"/>
Nov 09 03:41:31 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:41:31 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:41:31 user nova-compute[75378]:       <target dev="tap27d42515-fd"/>
Nov 09 03:41:31 user nova-compute[75378]:     </interface>
Nov 09 03:41:31 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:41:31 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/console.log" append="off"/>
Nov 09 03:41:31 user nova-compute[75378]:     </serial>
Nov 09 03:41:31 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:41:31 user nova-compute[75378]:     <video>
Nov 09 03:41:31 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:41:31 user nova-compute[75378]:     </video>
Nov 09 03:41:31 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:41:31 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:41:31 user nova-compute[75378]:     </rng>
Nov 09 03:41:31 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:41:31 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:41:31 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:41:31 user nova-compute[75378]:     </memballoon>
Nov 09 03:41:31 user nova-compute[75378]:   </devices>
Nov 09 03:41:31 user nova-compute[75378]: </domain>
Nov 09 03:41:31 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:41:31 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Instance destroyed successfully.
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:41:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] No VIF found with MAC fa:16:3e:a6:f3:49, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:41:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:33 user nova-compute[75378]: DEBUG nova.compute.manager [req-f5df38d8-c05a-4f26-bcd7-bcb29cf49e93 req-8421d629-fa9a-492a-bda5-16c3ff371346 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received event network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:41:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f5df38d8-c05a-4f26-bcd7-bcb29cf49e93 req-8421d629-fa9a-492a-bda5-16c3ff371346 service nova] Acquiring lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:41:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f5df38d8-c05a-4f26-bcd7-bcb29cf49e93 req-8421d629-fa9a-492a-bda5-16c3ff371346 service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:41:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f5df38d8-c05a-4f26-bcd7-bcb29cf49e93 req-8421d629-fa9a-492a-bda5-16c3ff371346 service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:41:33 user nova-compute[75378]: DEBUG nova.compute.manager [req-f5df38d8-c05a-4f26-bcd7-bcb29cf49e93 req-8421d629-fa9a-492a-bda5-16c3ff371346 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] No waiting events found dispatching network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:41:33 user nova-compute[75378]: WARNING nova.compute.manager [req-f5df38d8-c05a-4f26-bcd7-bcb29cf49e93 req-8421d629-fa9a-492a-bda5-16c3ff371346 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received unexpected event network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a for instance with vm_state active and task_state rescuing.
Nov 09 03:41:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Starting finish_migration {{(pid=75378) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 09 03:41:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Instance directory exists: not creating {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 03:41:33 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Creating image(s)
Nov 09 03:41:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.228s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:33 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk. size=21474836480 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:41:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk 21474836480 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk 21474836480" returned: 0 in 0.056s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Did not create local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 03:41:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Ensure instance console log exists: /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:41:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:41:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:41:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:41:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Start _get_guest_xml network_info=[{"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-853392482-network", "vif_mac": "fa:16:3e:07:9f:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etYnaShu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2f475dba-59f5-414a-8156-8b438601ecfd', 'attached_at': '2023-11-09T03:41:33.000000', 'detached_at': '', 'volume_id': '93b2608a-e6b8-4844-820c-71f0cd80f3be', 'serial': '93b2608a-e6b8-4844-820c-71f0cd80f3be'}, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'attachment_id': '8eced58c-5c8d-430e-b98a-2a7d89c6d672', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:41:33 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:41:33 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:41:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:41:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etYnaShu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:41:34 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:41:34 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:41:34 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[92182e63-98d6-4240-8062-be8046aaa61d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:41:34 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f99675-6792-47a7-a5df-2c9df774f5e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be] added
Nov 09 03:41:34 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed8ffc4-06a5-442e-a9ff-e753b0ae532b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23be657-fbb7-4650-845a-3aae0109e748]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etYnaShu {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etYnaShu" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[58476086-3d2b-46fc-b5de-48b294f148c5]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'etYnaShu'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf97ad82-11c0-49a9-a992-0f3b4a126d55]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a5b8dc-d8a6-49d5-a72c-cff5e84ef663]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed4c243-4f05-494c-8ec2-a840e6b1a4ba (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed4c243-4f05-494c-8ec2-a840e6b1a4ba (non-flash)
Nov 09 03:41:34 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:41:34 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:41:34 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:41:34 user nova-compute[75378]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)
Nov 09 03:41:34 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed4c243-4f05-494c-8ec2-a840e6b1a4ba (non-flash)
Nov 09 03:41:34 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:41:34 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:41:34 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:41:34 user nova-compute[75378]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)
Nov 09 03:41:34 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[105d8617-3b9b-48be-8107-a269c9eced1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260]
Nov 09 03:41:34 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260] successful.
Nov 09 03:41:34 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[be563571-ad92-4031-875f-1edcc911c3f8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d6768b-6522-48e6-b031-c871e3c0890b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed4c243-4f05-494c-8ec2-a840e6b1a4ba (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed4c243-4f05-494c-8ec2-a840e6b1a4ba (non-flash)
Nov 09 03:41:34 user nova-compute[75378]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:41:34 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:41:34 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:41:34 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:41:34 user nova-compute[75378]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)
Nov 09 03:41:34 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed4c243-4f05-494c-8ec2-a840e6b1a4ba (non-flash)
Nov 09 03:41:34 user nova-compute[75378]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:41:34 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:41:34 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:41:34 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:41:34 user nova-compute[75378]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)
Nov 09 03:41:34 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] HCTL ('38', '-', '-', 0) found on session 12 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53f92dc-5524-4413-b889-e345d1d736be]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Searching for a device in session 12 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:41:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etYnaShu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG nova.compute.manager [req-abac0fad-ce19-45fd-8c36-680632f58bed req-bdb82525-eb68-450b-87b8-3c902eb8cd3f service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received event network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-abac0fad-ce19-45fd-8c36-680632f58bed req-bdb82525-eb68-450b-87b8-3c902eb8cd3f service nova] Acquiring lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-abac0fad-ce19-45fd-8c36-680632f58bed req-bdb82525-eb68-450b-87b8-3c902eb8cd3f service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-abac0fad-ce19-45fd-8c36-680632f58bed req-bdb82525-eb68-450b-87b8-3c902eb8cd3f service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG nova.compute.manager [req-abac0fad-ce19-45fd-8c36-680632f58bed req-bdb82525-eb68-450b-87b8-3c902eb8cd3f service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] No waiting events found dispatching network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:41:35 user nova-compute[75378]: WARNING nova.compute.manager [req-abac0fad-ce19-45fd-8c36-680632f58bed req-bdb82525-eb68-450b-87b8-3c902eb8cd3f service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received unexpected event network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a for instance with vm_state active and task_state rescuing.
Nov 09 03:41:35 user nova-compute[75378]: DEBUG nova.compute.manager [req-abac0fad-ce19-45fd-8c36-680632f58bed req-bdb82525-eb68-450b-87b8-3c902eb8cd3f service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received event network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-abac0fad-ce19-45fd-8c36-680632f58bed req-bdb82525-eb68-450b-87b8-3c902eb8cd3f service nova] Acquiring lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-abac0fad-ce19-45fd-8c36-680632f58bed req-bdb82525-eb68-450b-87b8-3c902eb8cd3f service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-abac0fad-ce19-45fd-8c36-680632f58bed req-bdb82525-eb68-450b-87b8-3c902eb8cd3f service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG nova.compute.manager [req-abac0fad-ce19-45fd-8c36-680632f58bed req-bdb82525-eb68-450b-87b8-3c902eb8cd3f service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] No waiting events found dispatching network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:41:35 user nova-compute[75378]: WARNING nova.compute.manager [req-abac0fad-ce19-45fd-8c36-680632f58bed req-bdb82525-eb68-450b-87b8-3c902eb8cd3f service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received unexpected event network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a for instance with vm_state active and task_state rescuing.
Nov 09 03:41:35 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23733653230393733', 'path': '/dev/sdg'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733653230393733', 'path': '/dev/sdg'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1138780210',display_name='tempest-ServerActionsTestOtherB-server-1138780210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1138780210',id=4,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+s7M8RwDJb3loYxaUJGVxjbTQ9aVX7ngKf1RZUNQALVC7bsteyYsWXKwZsj2SvyMQBcJEfxsQ8l4Bn0IQtqoWxZ715fiA5I3KyJRgBFHf7jRe97Ql+ZXV7Ej5ZLqWSCg==',key_name='tempest-keypair-904427918',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cb0bda222cd54a44bd26b140d08d8274',ramdisk_id='',reservation_id='r-u0jhm5ex',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1007633314',owner_user_name='tempest-ServerActionsTestOtherB-1007633314-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7bb5d4c95c341beaa22c1bbeacaf4f7',uuid=2f475dba-59f5-414a-8156-8b438601ecfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-853392482-network", "vif_mac": "fa:16:3e:07:9f:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Converting VIF {"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-853392482-network", "vif_mac": "fa:16:3e:07:9f:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:9f:69,bridge_name='br-int',has_traffic_filtering=True,id=d0fa9225-bc1d-4d57-b259-5a6d1e3638f8,network=Network(2e704dce-6cba-4cf1-bd3e-d05da48d7839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fa9225-bc') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:41:35 user nova-compute[75378]:   <uuid>2f475dba-59f5-414a-8156-8b438601ecfd</uuid>
Nov 09 03:41:35 user nova-compute[75378]:   <name>instance-00000004</name>
Nov 09 03:41:35 user nova-compute[75378]:   <memory>2097152</memory>
Nov 09 03:41:35 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:41:35 user nova-compute[75378]:   <metadata>
Nov 09 03:41:35 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:41:35 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:41:35 user nova-compute[75378]:       <nova:name>tempest-ServerActionsTestOtherB-server-1138780210</nova:name>
Nov 09 03:41:35 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:41:33</nova:creationTime>
Nov 09 03:41:35 user nova-compute[75378]:       <nova:flavor name="m1.small">
Nov 09 03:41:35 user nova-compute[75378]:         <nova:memory>2048</nova:memory>
Nov 09 03:41:35 user nova-compute[75378]:         <nova:disk>20</nova:disk>
Nov 09 03:41:35 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:41:35 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:41:35 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:41:35 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:41:35 user nova-compute[75378]:       <nova:owner>
Nov 09 03:41:35 user nova-compute[75378]:         <nova:user uuid="e7bb5d4c95c341beaa22c1bbeacaf4f7">tempest-ServerActionsTestOtherB-1007633314-project-member</nova:user>
Nov 09 03:41:35 user nova-compute[75378]:         <nova:project uuid="cb0bda222cd54a44bd26b140d08d8274">tempest-ServerActionsTestOtherB-1007633314</nova:project>
Nov 09 03:41:35 user nova-compute[75378]:       </nova:owner>
Nov 09 03:41:35 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:41:35 user nova-compute[75378]:       <nova:ports>
Nov 09 03:41:35 user nova-compute[75378]:         <nova:port uuid="d0fa9225-bc1d-4d57-b259-5a6d1e3638f8">
Nov 09 03:41:35 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 03:41:35 user nova-compute[75378]:         </nova:port>
Nov 09 03:41:35 user nova-compute[75378]:       </nova:ports>
Nov 09 03:41:35 user nova-compute[75378]:     </nova:instance>
Nov 09 03:41:35 user nova-compute[75378]:   </metadata>
Nov 09 03:41:35 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:41:35 user nova-compute[75378]:     <system>
Nov 09 03:41:35 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:41:35 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:41:35 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:41:35 user nova-compute[75378]:       <entry name="serial">2f475dba-59f5-414a-8156-8b438601ecfd</entry>
Nov 09 03:41:35 user nova-compute[75378]:       <entry name="uuid">2f475dba-59f5-414a-8156-8b438601ecfd</entry>
Nov 09 03:41:35 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:41:35 user nova-compute[75378]:     </system>
Nov 09 03:41:35 user nova-compute[75378]:   </sysinfo>
Nov 09 03:41:35 user nova-compute[75378]:   <os>
Nov 09 03:41:35 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:41:35 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:41:35 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:41:35 user nova-compute[75378]:   </os>
Nov 09 03:41:35 user nova-compute[75378]:   <features>
Nov 09 03:41:35 user nova-compute[75378]:     <acpi/>
Nov 09 03:41:35 user nova-compute[75378]:     <apic/>
Nov 09 03:41:35 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:41:35 user nova-compute[75378]:   </features>
Nov 09 03:41:35 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:41:35 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:41:35 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:41:35 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:41:35 user nova-compute[75378]:   </clock>
Nov 09 03:41:35 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:41:35 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:41:35 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:41:35 user nova-compute[75378]:   </cpu>
Nov 09 03:41:35 user nova-compute[75378]:   <devices>
Nov 09 03:41:35 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:41:35 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:41:35 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk"/>
Nov 09 03:41:35 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:41:35 user nova-compute[75378]:     </disk>
Nov 09 03:41:35 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 03:41:35 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:41:35 user nova-compute[75378]:       <source dev="/dev/sdg"/>
Nov 09 03:41:35 user nova-compute[75378]:       <target dev="vdb" bus="virtio"/>
Nov 09 03:41:35 user nova-compute[75378]:       <serial>93b2608a-e6b8-4844-820c-71f0cd80f3be</serial>
Nov 09 03:41:35 user nova-compute[75378]:     </disk>
Nov 09 03:41:35 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:41:35 user nova-compute[75378]:       <mac address="fa:16:3e:07:9f:69"/>
Nov 09 03:41:35 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:41:35 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:41:35 user nova-compute[75378]:       <target dev="tapd0fa9225-bc"/>
Nov 09 03:41:35 user nova-compute[75378]:     </interface>
Nov 09 03:41:35 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:41:35 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/console.log" append="off"/>
Nov 09 03:41:35 user nova-compute[75378]:     </serial>
Nov 09 03:41:35 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:41:35 user nova-compute[75378]:     <video>
Nov 09 03:41:35 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:41:35 user nova-compute[75378]:     </video>
Nov 09 03:41:35 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:41:35 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:41:35 user nova-compute[75378]:     </rng>
Nov 09 03:41:35 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:41:35 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:41:35 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:41:35 user nova-compute[75378]:     </memballoon>
Nov 09 03:41:35 user nova-compute[75378]:   </devices>
Nov 09 03:41:35 user nova-compute[75378]: </domain>
Nov 09 03:41:35 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1138780210',display_name='tempest-ServerActionsTestOtherB-server-1138780210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1138780210',id=4,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+s7M8RwDJb3loYxaUJGVxjbTQ9aVX7ngKf1RZUNQALVC7bsteyYsWXKwZsj2SvyMQBcJEfxsQ8l4Bn0IQtqoWxZ715fiA5I3KyJRgBFHf7jRe97Ql+ZXV7Ej5ZLqWSCg==',key_name='tempest-keypair-904427918',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cb0bda222cd54a44bd26b140d08d8274',ramdisk_id='',reservation_id='r-u0jhm5ex',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1007633314',owner_user_name='tempest-ServerActionsTestOtherB-1007633314-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7bb5d4c95c341beaa22c1bbeacaf4f7',uuid=2f475dba-59f5-414a-8156-8b438601ecfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-853392482-network", "vif_mac": "fa:16:3e:07:9f:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Converting VIF {"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-853392482-network", "vif_mac": "fa:16:3e:07:9f:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:9f:69,bridge_name='br-int',has_traffic_filtering=True,id=d0fa9225-bc1d-4d57-b259-5a6d1e3638f8,network=Network(2e704dce-6cba-4cf1-bd3e-d05da48d7839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fa9225-bc') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG os_vif [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:9f:69,bridge_name='br-int',has_traffic_filtering=True,id=d0fa9225-bc1d-4d57-b259-5a6d1e3638f8,network=Network(2e704dce-6cba-4cf1-bd3e-d05da48d7839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fa9225-bc') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8cc8b611-6ed6-5dff-86ef-69553918d72c', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0fa9225-bc, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0fa9225-bc, col_values=(('qos', UUID('d24e195a-707b-4698-9194-b21caaae4076')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0fa9225-bc, col_values=(('external_ids', {'iface-id': 'd0fa9225-bc1d-4d57-b259-5a6d1e3638f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:9f:69', 'vm-uuid': '2f475dba-59f5-414a-8156-8b438601ecfd'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:35 user nova-compute[75378]: INFO os_vif [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:9f:69,bridge_name='br-int',has_traffic_filtering=True,id=d0fa9225-bc1d-4d57-b259-5a6d1e3638f8,network=Network(2e704dce-6cba-4cf1-bd3e-d05da48d7839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fa9225-bc')
Nov 09 03:41:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] No VIF found with MAC fa:16:3e:07:9f:69, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:41:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:36 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4a470bc4-42c4-48d5-a3fe-6c4367093a21 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:41:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:37 user nova-compute[75378]: DEBUG nova.compute.manager [req-afaf2f23-d8ab-4c89-b26f-9ae24d9fcf47 req-d405b508-a298-45bd-9327-ce2af44011b0 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:41:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-afaf2f23-d8ab-4c89-b26f-9ae24d9fcf47 req-d405b508-a298-45bd-9327-ce2af44011b0 service nova] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:41:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-afaf2f23-d8ab-4c89-b26f-9ae24d9fcf47 req-d405b508-a298-45bd-9327-ce2af44011b0 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:41:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-afaf2f23-d8ab-4c89-b26f-9ae24d9fcf47 req-d405b508-a298-45bd-9327-ce2af44011b0 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:41:37 user nova-compute[75378]: DEBUG nova.compute.manager [req-afaf2f23-d8ab-4c89-b26f-9ae24d9fcf47 req-d405b508-a298-45bd-9327-ce2af44011b0 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] No waiting events found dispatching network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:41:37 user nova-compute[75378]: WARNING nova.compute.manager [req-afaf2f23-d8ab-4c89-b26f-9ae24d9fcf47 req-d405b508-a298-45bd-9327-ce2af44011b0 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received unexpected event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 for instance with vm_state active and task_state resize_finish.
Nov 09 03:41:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:39 user nova-compute[75378]: DEBUG nova.compute.manager [req-4ea1c5ff-2f85-42f6-a22d-792bc99a9317 req-996815f4-21d7-49cf-b917-7139ae273495 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:41:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4ea1c5ff-2f85-42f6-a22d-792bc99a9317 req-996815f4-21d7-49cf-b917-7139ae273495 service nova] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:41:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4ea1c5ff-2f85-42f6-a22d-792bc99a9317 req-996815f4-21d7-49cf-b917-7139ae273495 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:41:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4ea1c5ff-2f85-42f6-a22d-792bc99a9317 req-996815f4-21d7-49cf-b917-7139ae273495 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:41:39 user nova-compute[75378]: DEBUG nova.compute.manager [req-4ea1c5ff-2f85-42f6-a22d-792bc99a9317 req-996815f4-21d7-49cf-b917-7139ae273495 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] No waiting events found dispatching network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:41:39 user nova-compute[75378]: WARNING nova.compute.manager [req-4ea1c5ff-2f85-42f6-a22d-792bc99a9317 req-996815f4-21d7-49cf-b917-7139ae273495 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received unexpected event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 for instance with vm_state active and task_state resize_finish.
Nov 09 03:41:39 user nova-compute[75378]: DEBUG nova.compute.manager [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:41:39 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Instance running successfully.
Nov 09 03:41:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Failed to set time: agent not configured {{(pid=75378) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 09 03:41:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-063092ea-8ce2-4333-b81d-dc7c744db4ed tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] finish_migration finished successfully. {{(pid=75378) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 09 03:41:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Acquiring lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:41:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:41:46 user nova-compute[75378]: DEBUG nova.compute.manager [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:41:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:41:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:41:47 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:41:47 user nova-compute[75378]: INFO nova.compute.claims [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Claim successful on node user
Nov 09 03:41:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:47 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:41:47 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:41:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:41:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:41:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:41:47 user nova-compute[75378]: DEBUG nova.network.neutron [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:41:47 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:41:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:41:47 user nova-compute[75378]: DEBUG nova.policy [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eebf755b949142df87418824c373513a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd9111e384d84382b3aa615c3a10562c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:41:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:41:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:41:47 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Creating image(s)
Nov 09 03:41:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Acquiring lock "/opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:41:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "/opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:41:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "/opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:41:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.220s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:41:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:41:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.220s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920/disk 1073741824" returned: 0 in 0.059s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:41:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.261s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:48 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Checking if we can resize image /opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:41:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:41:48 user nova-compute[75378]: DEBUG nova.network.neutron [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Successfully created port: 0f303310-c619-4e3d-9fb7-6ab3ce78b215 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:41:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:41:49 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Cannot resize image /opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:41:49 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:41:49 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Ensure instance console log exists: /opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:41:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:41:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:41:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:41:49 user nova-compute[75378]: DEBUG nova.network.neutron [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Successfully updated port: 0f303310-c619-4e3d-9fb7-6ab3ce78b215 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:41:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Acquiring lock "refresh_cache-657ae9e7-1a0b-4a29-acd9-5441c75f5920" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:41:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Acquired lock "refresh_cache-657ae9e7-1a0b-4a29-acd9-5441c75f5920" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:41:49 user nova-compute[75378]: DEBUG nova.network.neutron [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-3bf5125a-2cbf-4308-82b0-b6b64a668480 req-fdfe2144-7873-4e63-a667-c88a40777389 service nova] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Received event network-changed-0f303310-c619-4e3d-9fb7-6ab3ce78b215 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-3bf5125a-2cbf-4308-82b0-b6b64a668480 req-fdfe2144-7873-4e63-a667-c88a40777389 service nova] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Refreshing instance network info cache due to event network-changed-0f303310-c619-4e3d-9fb7-6ab3ce78b215. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3bf5125a-2cbf-4308-82b0-b6b64a668480 req-fdfe2144-7873-4e63-a667-c88a40777389 service nova] Acquiring lock "refresh_cache-657ae9e7-1a0b-4a29-acd9-5441c75f5920" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.network.neutron [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.network.neutron [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Updating instance_info_cache with network_info: [{"id": "0f303310-c619-4e3d-9fb7-6ab3ce78b215", "address": "fa:16:3e:64:c7:1e", "network": {"id": "3c26edbc-bd92-4d35-9064-e5efbf5523da", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1203812759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9111e384d84382b3aa615c3a10562c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f303310-c6", "ovs_interfaceid": "0f303310-c619-4e3d-9fb7-6ab3ce78b215", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Releasing lock "refresh_cache-657ae9e7-1a0b-4a29-acd9-5441c75f5920" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.compute.manager [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Instance network_info: |[{"id": "0f303310-c619-4e3d-9fb7-6ab3ce78b215", "address": "fa:16:3e:64:c7:1e", "network": {"id": "3c26edbc-bd92-4d35-9064-e5efbf5523da", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1203812759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9111e384d84382b3aa615c3a10562c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f303310-c6", "ovs_interfaceid": "0f303310-c619-4e3d-9fb7-6ab3ce78b215", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3bf5125a-2cbf-4308-82b0-b6b64a668480 req-fdfe2144-7873-4e63-a667-c88a40777389 service nova] Acquired lock "refresh_cache-657ae9e7-1a0b-4a29-acd9-5441c75f5920" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.network.neutron [req-3bf5125a-2cbf-4308-82b0-b6b64a668480 req-fdfe2144-7873-4e63-a667-c88a40777389 service nova] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Refreshing network info cache for port 0f303310-c619-4e3d-9fb7-6ab3ce78b215 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Start _get_guest_xml network_info=[{"id": "0f303310-c619-4e3d-9fb7-6ab3ce78b215", "address": "fa:16:3e:64:c7:1e", "network": {"id": "3c26edbc-bd92-4d35-9064-e5efbf5523da", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1203812759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9111e384d84382b3aa615c3a10562c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f303310-c6", "ovs_interfaceid": "0f303310-c619-4e3d-9fb7-6ab3ce78b215", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:41:50 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:41:50 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:41:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-737747011',display_name='tempest-DeleteServersTestJSON-server-737747011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-737747011',id=14,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd9111e384d84382b3aa615c3a10562c',ramdisk_id='',reservation_id='r-msmdw27s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-655269266',owner_user_name='tempest-DeleteServersTestJSON-655269266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:41:48Z,user_data=None,user_id='eebf755b949142df87418824c373513a',uuid=657ae9e7-1a0b-4a29-acd9-5441c75f5920,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f303310-c619-4e3d-9fb7-6ab3ce78b215", "address": "fa:16:3e:64:c7:1e", "network": {"id": "3c26edbc-bd92-4d35-9064-e5efbf5523da", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1203812759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9111e384d84382b3aa615c3a10562c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f303310-c6", "ovs_interfaceid": "0f303310-c619-4e3d-9fb7-6ab3ce78b215", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Converting VIF {"id": "0f303310-c619-4e3d-9fb7-6ab3ce78b215", "address": "fa:16:3e:64:c7:1e", "network": {"id": "3c26edbc-bd92-4d35-9064-e5efbf5523da", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1203812759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9111e384d84382b3aa615c3a10562c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f303310-c6", "ovs_interfaceid": "0f303310-c619-4e3d-9fb7-6ab3ce78b215", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:c7:1e,bridge_name='br-int',has_traffic_filtering=True,id=0f303310-c619-4e3d-9fb7-6ab3ce78b215,network=Network(3c26edbc-bd92-4d35-9064-e5efbf5523da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f303310-c6') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.objects.instance [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lazy-loading 'pci_devices' on Instance uuid 657ae9e7-1a0b-4a29-acd9-5441c75f5920 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:41:50 user nova-compute[75378]:   <uuid>657ae9e7-1a0b-4a29-acd9-5441c75f5920</uuid>
Nov 09 03:41:50 user nova-compute[75378]:   <name>instance-0000000e</name>
Nov 09 03:41:50 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:41:50 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:41:50 user nova-compute[75378]:   <metadata>
Nov 09 03:41:50 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:41:50 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:41:50 user nova-compute[75378]:       <nova:name>tempest-DeleteServersTestJSON-server-737747011</nova:name>
Nov 09 03:41:50 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:41:50</nova:creationTime>
Nov 09 03:41:50 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:41:50 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:41:50 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:41:50 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:41:50 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:41:50 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:41:50 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:41:50 user nova-compute[75378]:       <nova:owner>
Nov 09 03:41:50 user nova-compute[75378]:         <nova:user uuid="eebf755b949142df87418824c373513a">tempest-DeleteServersTestJSON-655269266-project-member</nova:user>
Nov 09 03:41:50 user nova-compute[75378]:         <nova:project uuid="cd9111e384d84382b3aa615c3a10562c">tempest-DeleteServersTestJSON-655269266</nova:project>
Nov 09 03:41:50 user nova-compute[75378]:       </nova:owner>
Nov 09 03:41:50 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:41:50 user nova-compute[75378]:       <nova:ports>
Nov 09 03:41:50 user nova-compute[75378]:         <nova:port uuid="0f303310-c619-4e3d-9fb7-6ab3ce78b215">
Nov 09 03:41:50 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 09 03:41:50 user nova-compute[75378]:         </nova:port>
Nov 09 03:41:50 user nova-compute[75378]:       </nova:ports>
Nov 09 03:41:50 user nova-compute[75378]:     </nova:instance>
Nov 09 03:41:50 user nova-compute[75378]:   </metadata>
Nov 09 03:41:50 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:41:50 user nova-compute[75378]:     <system>
Nov 09 03:41:50 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:41:50 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:41:50 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:41:50 user nova-compute[75378]:       <entry name="serial">657ae9e7-1a0b-4a29-acd9-5441c75f5920</entry>
Nov 09 03:41:50 user nova-compute[75378]:       <entry name="uuid">657ae9e7-1a0b-4a29-acd9-5441c75f5920</entry>
Nov 09 03:41:50 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:41:50 user nova-compute[75378]:     </system>
Nov 09 03:41:50 user nova-compute[75378]:   </sysinfo>
Nov 09 03:41:50 user nova-compute[75378]:   <os>
Nov 09 03:41:50 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:41:50 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:41:50 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:41:50 user nova-compute[75378]:   </os>
Nov 09 03:41:50 user nova-compute[75378]:   <features>
Nov 09 03:41:50 user nova-compute[75378]:     <acpi/>
Nov 09 03:41:50 user nova-compute[75378]:     <apic/>
Nov 09 03:41:50 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:41:50 user nova-compute[75378]:   </features>
Nov 09 03:41:50 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:41:50 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:41:50 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:41:50 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:41:50 user nova-compute[75378]:   </clock>
Nov 09 03:41:50 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:41:50 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:41:50 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:41:50 user nova-compute[75378]:   </cpu>
Nov 09 03:41:50 user nova-compute[75378]:   <devices>
Nov 09 03:41:50 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:41:50 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:41:50 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920/disk"/>
Nov 09 03:41:50 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:41:50 user nova-compute[75378]:     </disk>
Nov 09 03:41:50 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:41:50 user nova-compute[75378]:       <mac address="fa:16:3e:64:c7:1e"/>
Nov 09 03:41:50 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:41:50 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:41:50 user nova-compute[75378]:       <target dev="tap0f303310-c6"/>
Nov 09 03:41:50 user nova-compute[75378]:     </interface>
Nov 09 03:41:50 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:41:50 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920/console.log" append="off"/>
Nov 09 03:41:50 user nova-compute[75378]:     </serial>
Nov 09 03:41:50 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:41:50 user nova-compute[75378]:     <video>
Nov 09 03:41:50 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:41:50 user nova-compute[75378]:     </video>
Nov 09 03:41:50 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:41:50 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:41:50 user nova-compute[75378]:     </rng>
Nov 09 03:41:50 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:41:50 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:41:50 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:41:50 user nova-compute[75378]:     </memballoon>
Nov 09 03:41:50 user nova-compute[75378]:   </devices>
Nov 09 03:41:50 user nova-compute[75378]: </domain>
Nov 09 03:41:50 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:41:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-737747011',display_name='tempest-DeleteServersTestJSON-server-737747011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-737747011',id=14,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd9111e384d84382b3aa615c3a10562c',ramdisk_id='',reservation_id='r-msmdw27s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-655269266',owner_user_name='tempest-DeleteServersTestJSON-655269266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:41:48Z,user_data=None,user_id='eebf755b949142df87418824c373513a',uuid=657ae9e7-1a0b-4a29-acd9-5441c75f5920,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f303310-c619-4e3d-9fb7-6ab3ce78b215", "address": "fa:16:3e:64:c7:1e", "network": {"id": "3c26edbc-bd92-4d35-9064-e5efbf5523da", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1203812759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9111e384d84382b3aa615c3a10562c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f303310-c6", "ovs_interfaceid": "0f303310-c619-4e3d-9fb7-6ab3ce78b215", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Converting VIF {"id": "0f303310-c619-4e3d-9fb7-6ab3ce78b215", "address": "fa:16:3e:64:c7:1e", "network": {"id": "3c26edbc-bd92-4d35-9064-e5efbf5523da", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1203812759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9111e384d84382b3aa615c3a10562c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f303310-c6", "ovs_interfaceid": "0f303310-c619-4e3d-9fb7-6ab3ce78b215", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:c7:1e,bridge_name='br-int',has_traffic_filtering=True,id=0f303310-c619-4e3d-9fb7-6ab3ce78b215,network=Network(3c26edbc-bd92-4d35-9064-e5efbf5523da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f303310-c6') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG os_vif [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:c7:1e,bridge_name='br-int',has_traffic_filtering=True,id=0f303310-c619-4e3d-9fb7-6ab3ce78b215,network=Network(3c26edbc-bd92-4d35-9064-e5efbf5523da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f303310-c6') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38f15865-ae89-5568-8cc7-adf41cbb903d', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f303310-c6, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f303310-c6, col_values=(('qos', UUID('a7a1896b-467f-4323-b4a0-87bc2901d3ca')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f303310-c6, col_values=(('external_ids', {'iface-id': '0f303310-c619-4e3d-9fb7-6ab3ce78b215', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:c7:1e', 'vm-uuid': '657ae9e7-1a0b-4a29-acd9-5441c75f5920'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:50 user nova-compute[75378]: INFO os_vif [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:c7:1e,bridge_name='br-int',has_traffic_filtering=True,id=0f303310-c619-4e3d-9fb7-6ab3ce78b215,network=Network(3c26edbc-bd92-4d35-9064-e5efbf5523da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f303310-c6')
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:41:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] No VIF found with MAC fa:16:3e:64:c7:1e, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:41:51 user nova-compute[75378]: DEBUG nova.network.neutron [req-3bf5125a-2cbf-4308-82b0-b6b64a668480 req-fdfe2144-7873-4e63-a667-c88a40777389 service nova] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Updated VIF entry in instance network info cache for port 0f303310-c619-4e3d-9fb7-6ab3ce78b215. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:41:51 user nova-compute[75378]: DEBUG nova.network.neutron [req-3bf5125a-2cbf-4308-82b0-b6b64a668480 req-fdfe2144-7873-4e63-a667-c88a40777389 service nova] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Updating instance_info_cache with network_info: [{"id": "0f303310-c619-4e3d-9fb7-6ab3ce78b215", "address": "fa:16:3e:64:c7:1e", "network": {"id": "3c26edbc-bd92-4d35-9064-e5efbf5523da", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1203812759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9111e384d84382b3aa615c3a10562c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f303310-c6", "ovs_interfaceid": "0f303310-c619-4e3d-9fb7-6ab3ce78b215", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:41:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3bf5125a-2cbf-4308-82b0-b6b64a668480 req-fdfe2144-7873-4e63-a667-c88a40777389 service nova] Releasing lock "refresh_cache-657ae9e7-1a0b-4a29-acd9-5441c75f5920" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:41:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-881d4924-52a6-4c63-9d2c-8b6e5341ea72 req-597729c5-f80f-4c4f-ba1f-10cde3f28af6 service nova] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Received event network-vif-plugged-0f303310-c619-4e3d-9fb7-6ab3ce78b215 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:41:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-881d4924-52a6-4c63-9d2c-8b6e5341ea72 req-597729c5-f80f-4c4f-ba1f-10cde3f28af6 service nova] Acquiring lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:41:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-881d4924-52a6-4c63-9d2c-8b6e5341ea72 req-597729c5-f80f-4c4f-ba1f-10cde3f28af6 service nova] Lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:41:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-881d4924-52a6-4c63-9d2c-8b6e5341ea72 req-597729c5-f80f-4c4f-ba1f-10cde3f28af6 service nova] Lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:41:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-881d4924-52a6-4c63-9d2c-8b6e5341ea72 req-597729c5-f80f-4c4f-ba1f-10cde3f28af6 service nova] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] No waiting events found dispatching network-vif-plugged-0f303310-c619-4e3d-9fb7-6ab3ce78b215 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:41:53 user nova-compute[75378]: WARNING nova.compute.manager [req-881d4924-52a6-4c63-9d2c-8b6e5341ea72 req-597729c5-f80f-4c4f-ba1f-10cde3f28af6 service nova] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Received unexpected event network-vif-plugged-0f303310-c619-4e3d-9fb7-6ab3ce78b215 for instance with vm_state building and task_state spawning.
Nov 09 03:41:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:55 user nova-compute[75378]: DEBUG nova.compute.manager [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:41:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:41:55 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Instance spawned successfully.
Nov 09 03:41:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:41:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:41:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:41:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:41:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:41:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:41:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:41:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-92a13d42-c39d-4b6c-ad23-5b112456328c req-f694744f-30a2-4c10-9018-1caeb3790499 service nova] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Received event network-vif-plugged-0f303310-c619-4e3d-9fb7-6ab3ce78b215 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:41:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-92a13d42-c39d-4b6c-ad23-5b112456328c req-f694744f-30a2-4c10-9018-1caeb3790499 service nova] Acquiring lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:41:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-92a13d42-c39d-4b6c-ad23-5b112456328c req-f694744f-30a2-4c10-9018-1caeb3790499 service nova] Lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:41:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-92a13d42-c39d-4b6c-ad23-5b112456328c req-f694744f-30a2-4c10-9018-1caeb3790499 service nova] Lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:41:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-92a13d42-c39d-4b6c-ad23-5b112456328c req-f694744f-30a2-4c10-9018-1caeb3790499 service nova] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] No waiting events found dispatching network-vif-plugged-0f303310-c619-4e3d-9fb7-6ab3ce78b215 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:41:55 user nova-compute[75378]: WARNING nova.compute.manager [req-92a13d42-c39d-4b6c-ad23-5b112456328c req-f694744f-30a2-4c10-9018-1caeb3790499 service nova] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Received unexpected event network-vif-plugged-0f303310-c619-4e3d-9fb7-6ab3ce78b215 for instance with vm_state building and task_state spawning.
Nov 09 03:41:55 user nova-compute[75378]: INFO nova.compute.manager [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Took 7.35 seconds to spawn the instance on the hypervisor.
Nov 09 03:41:55 user nova-compute[75378]: DEBUG nova.compute.manager [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:41:55 user nova-compute[75378]: INFO nova.compute.manager [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Took 8.39 seconds to build instance.
Nov 09 03:41:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6cbabcdd-8e27-4f62-aa75-c32b2007c6fa tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.562s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:41:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:41:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-1f1fe340-f9c2-4060-9349-c4a3be4a726e req-9d47897a-0293-4330-8bb1-4417d13a0d17 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-changed-81e8875f-2f35-4bc9-ba66-a6140aedeafc {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-1f1fe340-f9c2-4060-9349-c4a3be4a726e req-9d47897a-0293-4330-8bb1-4417d13a0d17 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Refreshing instance network info cache due to event network-changed-81e8875f-2f35-4bc9-ba66-a6140aedeafc. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:42:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1f1fe340-f9c2-4060-9349-c4a3be4a726e req-9d47897a-0293-4330-8bb1-4417d13a0d17 service nova] Acquiring lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:42:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1f1fe340-f9c2-4060-9349-c4a3be4a726e req-9d47897a-0293-4330-8bb1-4417d13a0d17 service nova] Acquired lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:42:00 user nova-compute[75378]: DEBUG nova.network.neutron [req-1f1fe340-f9c2-4060-9349-c4a3be4a726e req-9d47897a-0293-4330-8bb1-4417d13a0d17 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Refreshing network info cache for port 81e8875f-2f35-4bc9-ba66-a6140aedeafc {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:42:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:01 user nova-compute[75378]: DEBUG nova.network.neutron [req-1f1fe340-f9c2-4060-9349-c4a3be4a726e req-9d47897a-0293-4330-8bb1-4417d13a0d17 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Updated VIF entry in instance network info cache for port 81e8875f-2f35-4bc9-ba66-a6140aedeafc. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:42:01 user nova-compute[75378]: DEBUG nova.network.neutron [req-1f1fe340-f9c2-4060-9349-c4a3be4a726e req-9d47897a-0293-4330-8bb1-4417d13a0d17 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Updating instance_info_cache with network_info: [{"id": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "address": "fa:16:3e:c8:1b:52", "network": {"id": "62aa759a-558d-42aa-8910-9709e02e9e1a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1100617011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e8875f-2f", "ovs_interfaceid": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b362041e-0313-42e1-be36-6ad021228d16", "address": "fa:16:3e:2e:52:a1", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362041e-03", "ovs_interfaceid": "b362041e-0313-42e1-be36-6ad021228d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14de84ce-7772-461d-9b7a-168604176bd3", "address": "fa:16:3e:e4:3c:b4", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14de84ce-77", "ovs_interfaceid": "14de84ce-7772-461d-9b7a-168604176bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "address": "fa:16:3e:bc:00:45", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a068d92-dd", "ovs_interfaceid": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "address": "fa:16:3e:88:5d:5c", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf9fd7-4e", "ovs_interfaceid": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "address": "fa:16:3e:c5:79:79", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d6cece-2c", "ovs_interfaceid": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27b8914c-2639-4117-86c1-62615361ab73", "address": "fa:16:3e:10:53:c2", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8914c-26", "ovs_interfaceid": "27b8914c-2639-4117-86c1-62615361ab73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:42:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1f1fe340-f9c2-4060-9349-c4a3be4a726e req-9d47897a-0293-4330-8bb1-4417d13a0d17 service nova] Releasing lock "refresh_cache-b44da21c-9c44-48d2-865c-85ea2f103a89" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:42:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:03 user nova-compute[75378]: INFO nova.compute.manager [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Terminating instance
Nov 09 03:42:03 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:42:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-8fff4560-f5ca-4ea4-b0aa-d96983433a22 req-0509de3d-d494-422f-8093-64b13e37515b service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-unplugged-81e8875f-2f35-4bc9-ba66-a6140aedeafc {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8fff4560-f5ca-4ea4-b0aa-d96983433a22 req-0509de3d-d494-422f-8093-64b13e37515b service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8fff4560-f5ca-4ea4-b0aa-d96983433a22 req-0509de3d-d494-422f-8093-64b13e37515b service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8fff4560-f5ca-4ea4-b0aa-d96983433a22 req-0509de3d-d494-422f-8093-64b13e37515b service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-8fff4560-f5ca-4ea4-b0aa-d96983433a22 req-0509de3d-d494-422f-8093-64b13e37515b service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-unplugged-81e8875f-2f35-4bc9-ba66-a6140aedeafc {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-8fff4560-f5ca-4ea4-b0aa-d96983433a22 req-0509de3d-d494-422f-8093-64b13e37515b service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-unplugged-81e8875f-2f35-4bc9-ba66-a6140aedeafc for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:42:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-fc9bc152-c6ce-46da-b70e-757225686e0d req-7e999c5a-bdef-4ba8-89da-ea65bcda4334 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-unplugged-14de84ce-7772-461d-9b7a-168604176bd3 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-fc9bc152-c6ce-46da-b70e-757225686e0d req-7e999c5a-bdef-4ba8-89da-ea65bcda4334 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-fc9bc152-c6ce-46da-b70e-757225686e0d req-7e999c5a-bdef-4ba8-89da-ea65bcda4334 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-fc9bc152-c6ce-46da-b70e-757225686e0d req-7e999c5a-bdef-4ba8-89da-ea65bcda4334 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-fc9bc152-c6ce-46da-b70e-757225686e0d req-7e999c5a-bdef-4ba8-89da-ea65bcda4334 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-unplugged-14de84ce-7772-461d-9b7a-168604176bd3 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-fc9bc152-c6ce-46da-b70e-757225686e0d req-7e999c5a-bdef-4ba8-89da-ea65bcda4334 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-unplugged-14de84ce-7772-461d-9b7a-168604176bd3 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-3d1cf769-96b9-4e83-b171-339cd028fd58 req-07973550-0bff-4ed5-aceb-3b63408daf50 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-unplugged-b362041e-0313-42e1-be36-6ad021228d16 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3d1cf769-96b9-4e83-b171-339cd028fd58 req-07973550-0bff-4ed5-aceb-3b63408daf50 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3d1cf769-96b9-4e83-b171-339cd028fd58 req-07973550-0bff-4ed5-aceb-3b63408daf50 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3d1cf769-96b9-4e83-b171-339cd028fd58 req-07973550-0bff-4ed5-aceb-3b63408daf50 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-3d1cf769-96b9-4e83-b171-339cd028fd58 req-07973550-0bff-4ed5-aceb-3b63408daf50 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-unplugged-b362041e-0313-42e1-be36-6ad021228d16 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-3d1cf769-96b9-4e83-b171-339cd028fd58 req-07973550-0bff-4ed5-aceb-3b63408daf50 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-unplugged-b362041e-0313-42e1-be36-6ad021228d16 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:05 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Instance destroyed successfully.
Nov 09 03:42:05 user nova-compute[75378]: DEBUG nova.objects.instance [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lazy-loading 'resources' on Instance uuid b44da21c-9c44-48d2-865c-85ea2f103a89 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759562300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759562300',id=12,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLpVVwyl8BqRutcz1Z1rjRkn5KYFVJGHdPuc/qH9BU1+uH8f+QbP8mAj4IQUSMX73qfwGcYvSUGn85uoPNOzXrZVzj/mGJaW0ZnAems0r1+Fr7AoCSWIaeXco1QzQ96A==',key_name='tempest-keypair-2137942302',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:40:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0bff904ec1645bcaa1c5b699b104047',ramdisk_id='',reservation_id='r-0zanfhh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-715356366',owner_user_name='tempest-TaggedBootDevicesTest-715356366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66fbe37ed9304cecaca00527cff2fcac',uuid=b44da21c-9c44-48d2-865c-85ea2f103a89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "address": "fa:16:3e:c8:1b:52", "network": {"id": "62aa759a-558d-42aa-8910-9709e02e9e1a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1100617011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e8875f-2f", "ovs_interfaceid": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converting VIF {"id": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "address": "fa:16:3e:c8:1b:52", "network": {"id": "62aa759a-558d-42aa-8910-9709e02e9e1a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1100617011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e8875f-2f", "ovs_interfaceid": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:1b:52,bridge_name='br-int',has_traffic_filtering=True,id=81e8875f-2f35-4bc9-ba66-a6140aedeafc,network=Network(62aa759a-558d-42aa-8910-9709e02e9e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e8875f-2f') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG os_vif [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:1b:52,bridge_name='br-int',has_traffic_filtering=True,id=81e8875f-2f35-4bc9-ba66-a6140aedeafc,network=Network(62aa759a-558d-42aa-8910-9709e02e9e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e8875f-2f') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81e8875f-2f, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbbebc15-ee9a-4020-930b-dcef9449b203) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:05 user nova-compute[75378]: INFO os_vif [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:1b:52,bridge_name='br-int',has_traffic_filtering=True,id=81e8875f-2f35-4bc9-ba66-a6140aedeafc,network=Network(62aa759a-558d-42aa-8910-9709e02e9e1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e8875f-2f')
Nov 09 03:42:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759562300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759562300',id=12,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLpVVwyl8BqRutcz1Z1rjRkn5KYFVJGHdPuc/qH9BU1+uH8f+QbP8mAj4IQUSMX73qfwGcYvSUGn85uoPNOzXrZVzj/mGJaW0ZnAems0r1+Fr7AoCSWIaeXco1QzQ96A==',key_name='tempest-keypair-2137942302',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:40:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0bff904ec1645bcaa1c5b699b104047',ramdisk_id='',reservation_id='r-0zanfhh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-715356366',owner_user_name='tempest-TaggedBootDevicesTest-715356366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66fbe37ed9304cecaca00527cff2fcac',uuid=b44da21c-9c44-48d2-865c-85ea2f103a89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b362041e-0313-42e1-be36-6ad021228d16", "address": "fa:16:3e:2e:52:a1", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362041e-03", "ovs_interfaceid": "b362041e-0313-42e1-be36-6ad021228d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converting VIF {"id": "b362041e-0313-42e1-be36-6ad021228d16", "address": "fa:16:3e:2e:52:a1", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362041e-03", "ovs_interfaceid": "b362041e-0313-42e1-be36-6ad021228d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:52:a1,bridge_name='br-int',has_traffic_filtering=True,id=b362041e-0313-42e1-be36-6ad021228d16,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb362041e-03') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG os_vif [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:52:a1,bridge_name='br-int',has_traffic_filtering=True,id=b362041e-0313-42e1-be36-6ad021228d16,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb362041e-03') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb362041e-03, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d55d31cc-14f1-4dd9-8c43-93df8e32d777) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:05 user nova-compute[75378]: INFO os_vif [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:52:a1,bridge_name='br-int',has_traffic_filtering=True,id=b362041e-0313-42e1-be36-6ad021228d16,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb362041e-03')
Nov 09 03:42:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759562300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759562300',id=12,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLpVVwyl8BqRutcz1Z1rjRkn5KYFVJGHdPuc/qH9BU1+uH8f+QbP8mAj4IQUSMX73qfwGcYvSUGn85uoPNOzXrZVzj/mGJaW0ZnAems0r1+Fr7AoCSWIaeXco1QzQ96A==',key_name='tempest-keypair-2137942302',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:40:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0bff904ec1645bcaa1c5b699b104047',ramdisk_id='',reservation_id='r-0zanfhh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-715356366',owner_user_name='tempest-TaggedBootDevicesTest-715356366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66fbe37ed9304cecaca00527cff2fcac',uuid=b44da21c-9c44-48d2-865c-85ea2f103a89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14de84ce-7772-461d-9b7a-168604176bd3", "address": "fa:16:3e:e4:3c:b4", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14de84ce-77", "ovs_interfaceid": "14de84ce-7772-461d-9b7a-168604176bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converting VIF {"id": "14de84ce-7772-461d-9b7a-168604176bd3", "address": "fa:16:3e:e4:3c:b4", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14de84ce-77", "ovs_interfaceid": "14de84ce-7772-461d-9b7a-168604176bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:3c:b4,bridge_name='br-int',has_traffic_filtering=True,id=14de84ce-7772-461d-9b7a-168604176bd3,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap14de84ce-77') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG os_vif [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:3c:b4,bridge_name='br-int',has_traffic_filtering=True,id=14de84ce-7772-461d-9b7a-168604176bd3,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap14de84ce-77') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14de84ce-77, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-plugged-81e8875f-2f35-4bc9-ba66-a6140aedeafc {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-plugged-81e8875f-2f35-4bc9-ba66-a6140aedeafc {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:06 user nova-compute[75378]: WARNING nova.compute.manager [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received unexpected event network-vif-plugged-81e8875f-2f35-4bc9-ba66-a6140aedeafc for instance with vm_state active and task_state deleting.
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-unplugged-6a068d92-ddf4-406a-be66-1d4c2bd2b11d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-unplugged-6a068d92-ddf4-406a-be66-1d4c2bd2b11d {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-unplugged-6a068d92-ddf4-406a-be66-1d4c2bd2b11d for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-plugged-6a068d92-ddf4-406a-be66-1d4c2bd2b11d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-plugged-6a068d92-ddf4-406a-be66-1d4c2bd2b11d {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:06 user nova-compute[75378]: WARNING nova.compute.manager [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received unexpected event network-vif-plugged-6a068d92-ddf4-406a-be66-1d4c2bd2b11d for instance with vm_state active and task_state deleting.
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-unplugged-8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-unplugged-8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-unplugged-8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-plugged-8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-plugged-8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:06 user nova-compute[75378]: WARNING nova.compute.manager [req-cfaaf7f2-9bf3-42f3-9730-96bc11c38f78 req-1ac5b45d-baa5-4251-a236-1530663bd358 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received unexpected event network-vif-plugged-8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a for instance with vm_state active and task_state deleting.
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c71270c-abd6-4e23-872e-48503c78e677) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:06 user nova-compute[75378]: INFO os_vif [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:3c:b4,bridge_name='br-int',has_traffic_filtering=True,id=14de84ce-7772-461d-9b7a-168604176bd3,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap14de84ce-77')
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759562300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759562300',id=12,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLpVVwyl8BqRutcz1Z1rjRkn5KYFVJGHdPuc/qH9BU1+uH8f+QbP8mAj4IQUSMX73qfwGcYvSUGn85uoPNOzXrZVzj/mGJaW0ZnAems0r1+Fr7AoCSWIaeXco1QzQ96A==',key_name='tempest-keypair-2137942302',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:40:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0bff904ec1645bcaa1c5b699b104047',ramdisk_id='',reservation_id='r-0zanfhh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-715356366',owner_user_name='tempest-TaggedBootDevicesTest-715356366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66fbe37ed9304cecaca00527cff2fcac',uuid=b44da21c-9c44-48d2-865c-85ea2f103a89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "address": "fa:16:3e:bc:00:45", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a068d92-dd", "ovs_interfaceid": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converting VIF {"id": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "address": "fa:16:3e:bc:00:45", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a068d92-dd", "ovs_interfaceid": "6a068d92-ddf4-406a-be66-1d4c2bd2b11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:00:45,bridge_name='br-int',has_traffic_filtering=True,id=6a068d92-ddf4-406a-be66-1d4c2bd2b11d,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a068d92-dd') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_vif [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:00:45,bridge_name='br-int',has_traffic_filtering=True,id=6a068d92-ddf4-406a-be66-1d4c2bd2b11d,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a068d92-dd') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a068d92-dd, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f974eb76-d0f1-4129-b06c-d517eee46226) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:06 user nova-compute[75378]: INFO os_vif [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:00:45,bridge_name='br-int',has_traffic_filtering=True,id=6a068d92-ddf4-406a-be66-1d4c2bd2b11d,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a068d92-dd')
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759562300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759562300',id=12,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLpVVwyl8BqRutcz1Z1rjRkn5KYFVJGHdPuc/qH9BU1+uH8f+QbP8mAj4IQUSMX73qfwGcYvSUGn85uoPNOzXrZVzj/mGJaW0ZnAems0r1+Fr7AoCSWIaeXco1QzQ96A==',key_name='tempest-keypair-2137942302',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:40:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0bff904ec1645bcaa1c5b699b104047',ramdisk_id='',reservation_id='r-0zanfhh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-715356366',owner_user_name='tempest-TaggedBootDevicesTest-715356366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66fbe37ed9304cecaca00527cff2fcac',uuid=b44da21c-9c44-48d2-865c-85ea2f103a89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "address": "fa:16:3e:88:5d:5c", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf9fd7-4e", "ovs_interfaceid": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converting VIF {"id": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "address": "fa:16:3e:88:5d:5c", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf9fd7-4e", "ovs_interfaceid": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:5d:5c,bridge_name='br-int',has_traffic_filtering=True,id=8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccf9fd7-4e') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_vif [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:5d:5c,bridge_name='br-int',has_traffic_filtering=True,id=8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccf9fd7-4e') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ccf9fd7-4e, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a975d50-7623-49d7-9221-9f0fef557100) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:06 user nova-compute[75378]: INFO os_vif [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:5d:5c,bridge_name='br-int',has_traffic_filtering=True,id=8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a,network=Network(387ee4c2-4640-4995-a142-edfd6ca74ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccf9fd7-4e')
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759562300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759562300',id=12,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLpVVwyl8BqRutcz1Z1rjRkn5KYFVJGHdPuc/qH9BU1+uH8f+QbP8mAj4IQUSMX73qfwGcYvSUGn85uoPNOzXrZVzj/mGJaW0ZnAems0r1+Fr7AoCSWIaeXco1QzQ96A==',key_name='tempest-keypair-2137942302',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:40:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0bff904ec1645bcaa1c5b699b104047',ramdisk_id='',reservation_id='r-0zanfhh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-715356366',owner_user_name='tempest-TaggedBootDevicesTest-715356366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66fbe37ed9304cecaca00527cff2fcac',uuid=b44da21c-9c44-48d2-865c-85ea2f103a89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "address": "fa:16:3e:c5:79:79", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d6cece-2c", "ovs_interfaceid": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converting VIF {"id": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "address": "fa:16:3e:c5:79:79", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d6cece-2c", "ovs_interfaceid": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:79:79,bridge_name='br-int',has_traffic_filtering=True,id=68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983,network=Network(891f687a-6a37-4713-a0f0-40baac281590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d6cece-2c') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_vif [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:79:79,bridge_name='br-int',has_traffic_filtering=True,id=68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983,network=Network(891f687a-6a37-4713-a0f0-40baac281590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d6cece-2c') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68d6cece-2c, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-95a2b319-a646-4a58-b928-69e577250658 req-8547c765-edc4-45ca-b0bc-207a9ba8a267 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-plugged-14de84ce-7772-461d-9b7a-168604176bd3 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-95a2b319-a646-4a58-b928-69e577250658 req-8547c765-edc4-45ca-b0bc-207a9ba8a267 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-95a2b319-a646-4a58-b928-69e577250658 req-8547c765-edc4-45ca-b0bc-207a9ba8a267 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-95a2b319-a646-4a58-b928-69e577250658 req-8547c765-edc4-45ca-b0bc-207a9ba8a267 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-95a2b319-a646-4a58-b928-69e577250658 req-8547c765-edc4-45ca-b0bc-207a9ba8a267 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-plugged-14de84ce-7772-461d-9b7a-168604176bd3 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:06 user nova-compute[75378]: WARNING nova.compute.manager [req-95a2b319-a646-4a58-b928-69e577250658 req-8547c765-edc4-45ca-b0bc-207a9ba8a267 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received unexpected event network-vif-plugged-14de84ce-7772-461d-9b7a-168604176bd3 for instance with vm_state active and task_state deleting.
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-95a2b319-a646-4a58-b928-69e577250658 req-8547c765-edc4-45ca-b0bc-207a9ba8a267 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-unplugged-68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-95a2b319-a646-4a58-b928-69e577250658 req-8547c765-edc4-45ca-b0bc-207a9ba8a267 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-95a2b319-a646-4a58-b928-69e577250658 req-8547c765-edc4-45ca-b0bc-207a9ba8a267 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-95a2b319-a646-4a58-b928-69e577250658 req-8547c765-edc4-45ca-b0bc-207a9ba8a267 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-95a2b319-a646-4a58-b928-69e577250658 req-8547c765-edc4-45ca-b0bc-207a9ba8a267 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-unplugged-68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-95a2b319-a646-4a58-b928-69e577250658 req-8547c765-edc4-45ca-b0bc-207a9ba8a267 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-unplugged-68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-95a2b319-a646-4a58-b928-69e577250658 req-8547c765-edc4-45ca-b0bc-207a9ba8a267 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-plugged-68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-95a2b319-a646-4a58-b928-69e577250658 req-8547c765-edc4-45ca-b0bc-207a9ba8a267 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-95a2b319-a646-4a58-b928-69e577250658 req-8547c765-edc4-45ca-b0bc-207a9ba8a267 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-95a2b319-a646-4a58-b928-69e577250658 req-8547c765-edc4-45ca-b0bc-207a9ba8a267 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-95a2b319-a646-4a58-b928-69e577250658 req-8547c765-edc4-45ca-b0bc-207a9ba8a267 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-plugged-68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:06 user nova-compute[75378]: WARNING nova.compute.manager [req-95a2b319-a646-4a58-b928-69e577250658 req-8547c765-edc4-45ca-b0bc-207a9ba8a267 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received unexpected event network-vif-plugged-68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983 for instance with vm_state active and task_state deleting.
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-7af516a3-d747-4449-bf2b-3e99744bf36e req-50580536-5709-4c86-b592-b9633d5dfae1 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-plugged-b362041e-0313-42e1-be36-6ad021228d16 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7af516a3-d747-4449-bf2b-3e99744bf36e req-50580536-5709-4c86-b592-b9633d5dfae1 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7af516a3-d747-4449-bf2b-3e99744bf36e req-50580536-5709-4c86-b592-b9633d5dfae1 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7af516a3-d747-4449-bf2b-3e99744bf36e req-50580536-5709-4c86-b592-b9633d5dfae1 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-7af516a3-d747-4449-bf2b-3e99744bf36e req-50580536-5709-4c86-b592-b9633d5dfae1 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-plugged-b362041e-0313-42e1-be36-6ad021228d16 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:06 user nova-compute[75378]: WARNING nova.compute.manager [req-7af516a3-d747-4449-bf2b-3e99744bf36e req-50580536-5709-4c86-b592-b9633d5dfae1 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received unexpected event network-vif-plugged-b362041e-0313-42e1-be36-6ad021228d16 for instance with vm_state active and task_state deleting.
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-7af516a3-d747-4449-bf2b-3e99744bf36e req-50580536-5709-4c86-b592-b9633d5dfae1 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-unplugged-27b8914c-2639-4117-86c1-62615361ab73 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7af516a3-d747-4449-bf2b-3e99744bf36e req-50580536-5709-4c86-b592-b9633d5dfae1 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7af516a3-d747-4449-bf2b-3e99744bf36e req-50580536-5709-4c86-b592-b9633d5dfae1 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7af516a3-d747-4449-bf2b-3e99744bf36e req-50580536-5709-4c86-b592-b9633d5dfae1 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-7af516a3-d747-4449-bf2b-3e99744bf36e req-50580536-5709-4c86-b592-b9633d5dfae1 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-unplugged-27b8914c-2639-4117-86c1-62615361ab73 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-7af516a3-d747-4449-bf2b-3e99744bf36e req-50580536-5709-4c86-b592-b9633d5dfae1 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-unplugged-27b8914c-2639-4117-86c1-62615361ab73 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-7af516a3-d747-4449-bf2b-3e99744bf36e req-50580536-5709-4c86-b592-b9633d5dfae1 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-plugged-27b8914c-2639-4117-86c1-62615361ab73 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7af516a3-d747-4449-bf2b-3e99744bf36e req-50580536-5709-4c86-b592-b9633d5dfae1 service nova] Acquiring lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7af516a3-d747-4449-bf2b-3e99744bf36e req-50580536-5709-4c86-b592-b9633d5dfae1 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7af516a3-d747-4449-bf2b-3e99744bf36e req-50580536-5709-4c86-b592-b9633d5dfae1 service nova] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-7af516a3-d747-4449-bf2b-3e99744bf36e req-50580536-5709-4c86-b592-b9633d5dfae1 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] No waiting events found dispatching network-vif-plugged-27b8914c-2639-4117-86c1-62615361ab73 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:06 user nova-compute[75378]: WARNING nova.compute.manager [req-7af516a3-d747-4449-bf2b-3e99744bf36e req-50580536-5709-4c86-b592-b9633d5dfae1 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received unexpected event network-vif-plugged-27b8914c-2639-4117-86c1-62615361ab73 for instance with vm_state active and task_state deleting.
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71b3b1ce-6f72-47cc-b894-24daeb08254b) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:06 user nova-compute[75378]: INFO os_vif [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:79:79,bridge_name='br-int',has_traffic_filtering=True,id=68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983,network=Network(891f687a-6a37-4713-a0f0-40baac281590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d6cece-2c')
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-759562300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-759562300',id=12,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLpVVwyl8BqRutcz1Z1rjRkn5KYFVJGHdPuc/qH9BU1+uH8f+QbP8mAj4IQUSMX73qfwGcYvSUGn85uoPNOzXrZVzj/mGJaW0ZnAems0r1+Fr7AoCSWIaeXco1QzQ96A==',key_name='tempest-keypair-2137942302',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:40:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0bff904ec1645bcaa1c5b699b104047',ramdisk_id='',reservation_id='r-0zanfhh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-715356366',owner_user_name='tempest-TaggedBootDevicesTest-715356366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66fbe37ed9304cecaca00527cff2fcac',uuid=b44da21c-9c44-48d2-865c-85ea2f103a89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27b8914c-2639-4117-86c1-62615361ab73", "address": "fa:16:3e:10:53:c2", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8914c-26", "ovs_interfaceid": "27b8914c-2639-4117-86c1-62615361ab73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converting VIF {"id": "27b8914c-2639-4117-86c1-62615361ab73", "address": "fa:16:3e:10:53:c2", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8914c-26", "ovs_interfaceid": "27b8914c-2639-4117-86c1-62615361ab73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:53:c2,bridge_name='br-int',has_traffic_filtering=True,id=27b8914c-2639-4117-86c1-62615361ab73,network=Network(891f687a-6a37-4713-a0f0-40baac281590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8914c-26') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_vif [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:53:c2,bridge_name='br-int',has_traffic_filtering=True,id=27b8914c-2639-4117-86c1-62615361ab73,network=Network(891f687a-6a37-4713-a0f0-40baac281590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8914c-26') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27b8914c-26, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41aa7a62-7fcf-47f3-8567-5bf1d59eabae) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:42:06 user nova-compute[75378]: INFO os_vif [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:53:c2,bridge_name='br-int',has_traffic_filtering=True,id=27b8914c-2639-4117-86c1-62615361ab73,network=Network(891f687a-6a37-4713-a0f0-40baac281590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27b8914c-26')
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xCamerOc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:42:06 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[12775f27-c8e4-4dbc-8cbc-5d31122c9286]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:42:06 user nova-compute[75378]: No targets found.
Nov 09 03:42:06 user nova-compute[75378]: iSNS:
Nov 09 03:42:06 user nova-compute[75378]: No targets found.
Nov 09 03:42:06 user nova-compute[75378]: STATIC:
Nov 09 03:42:06 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e
Nov 09 03:42:06 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:42:06 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:42:06 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc
Nov 09 03:42:06 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:42:06 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:42:06 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac
Nov 09 03:42:06 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:42:06 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:42:06 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be
Nov 09 03:42:06 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:42:06 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:42:06 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66
Nov 09 03:42:06 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:42:06 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:42:06 user nova-compute[75378]: FIRMWARE:
Nov 09 03:42:06 user nova-compute[75378]: No targets found.
Nov 09 03:42:06 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:42:06 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:42:06 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2db445-74fb-4277-aa0f-cc5a09650804]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b4883e-51f1-401f-88ba-d4672d7d1f5d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:42:06 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:42:06 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:42:06 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:42:06 user nova-compute[75378]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)
Nov 09 03:42:06 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:42:06 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:42:06 user nova-compute[75378]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc (non-flash)
Nov 09 03:42:06 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:42:06 user nova-compute[75378]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)
Nov 09 03:42:06 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c7f4ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc'): ({'sdb'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Removing single pathed devices sdb {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8dc5f52-7566-4de0-bb02-dcb4ecdc0f0e]: (4, ('path checker states:\nup                  3\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[754869a6-c0fb-483a-97a4-c96adbae4123]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Flushing IO for device /dev/sdb {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[573bff4e-c4cd-4f06-a69d-8fe899fc76c5]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[991a359f-9050-45e3-937c-842d26608249]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec0435e-e1ad-4c32-a0ac-f25d7e44a93c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0202d0d1-bb6c-4a47-91d7-2f89632a2fc5]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc, portal: 172.16.0.220,3260]
Nov 09 03:42:06 user nova-compute[75378]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc, portal: 172.16.0.220,3260] successful.
Nov 09 03:42:06 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a07c2dc-15f0-463e-9fae-97d5ee7626bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee11dcb-c406-42e1-8574-c6d442502f0b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] <== disconnect_volume: return (380ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUuneXVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:42:06 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1959c6f6-ae2e-466e-ae33-c07770a810f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:42:06 user nova-compute[75378]: No targets found.
Nov 09 03:42:06 user nova-compute[75378]: iSNS:
Nov 09 03:42:06 user nova-compute[75378]: No targets found.
Nov 09 03:42:06 user nova-compute[75378]: STATIC:
Nov 09 03:42:06 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e
Nov 09 03:42:06 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:42:06 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:42:06 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac
Nov 09 03:42:06 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:42:06 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:42:06 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be
Nov 09 03:42:06 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:42:06 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:42:06 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66
Nov 09 03:42:06 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:42:06 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:42:06 user nova-compute[75378]: FIRMWARE:
Nov 09 03:42:06 user nova-compute[75378]: No targets found.
Nov 09 03:42:06 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:42:06 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:42:06 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a3b9ae-b960-4af9-9330-97481fe7bce1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6036926f-097a-4647-b3a3-30c0c20e2944]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:42:06 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:42:06 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:42:06 user nova-compute[75378]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)
Nov 09 03:42:06 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:42:06 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:42:06 user nova-compute[75378]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 (non-flash)
Nov 09 03:42:06 user nova-compute[75378]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)
Nov 09 03:42:06 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c716a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66'): ({'sdc'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Removing single pathed devices sdc {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47cf763-d03f-4528-a29b-26f20e487c90]: (4, ('path checker states:\nup                  2\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b858f4-ca5b-4c93-92ee-3961d4720b48]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Flushing IO for device /dev/sdc {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ce92a3-a6fd-47e9-b00e-6075b3d0026b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[333f8d1f-bbfd-4882-9f2e-6c942c8734b1]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] SCSI volumes sdc have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a05412b-58f4-4c39-bb4f-fe3fa311ace4]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a175dc-7e06-47c7-b02a-4d34d20f7279]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66, portal: 172.16.0.220,3260]
Nov 09 03:42:07 user nova-compute[75378]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66, portal: 172.16.0.220,3260] successful.
Nov 09 03:42:07 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7a0d227-c269-4b71-bd46-114d7c236b66 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6392b406-4295-446f-b62b-ea10d4608806]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] <== disconnect_volume: return (386ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BetjfVCk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:42:07 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0829a08d-7118-4dc0-a5d6-642cb888c3e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:42:07 user nova-compute[75378]: No targets found.
Nov 09 03:42:07 user nova-compute[75378]: iSNS:
Nov 09 03:42:07 user nova-compute[75378]: No targets found.
Nov 09 03:42:07 user nova-compute[75378]: STATIC:
Nov 09 03:42:07 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e
Nov 09 03:42:07 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:42:07 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:42:07 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac
Nov 09 03:42:07 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:42:07 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:42:07 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be
Nov 09 03:42:07 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:42:07 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:42:07 user nova-compute[75378]: FIRMWARE:
Nov 09 03:42:07 user nova-compute[75378]: No targets found.
Nov 09 03:42:07 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:42:07 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:42:07 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[de13ec06-7b02-42b8-9732-5e0a4a0f49e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3f910a-61c4-4579-be9c-9eadf0cb6222]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:42:07 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:42:07 user nova-compute[75378]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)
Nov 09 03:42:07 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:42:07 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:42:07 user nova-compute[75378]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e (non-flash)
Nov 09 03:42:07 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c7177f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e'): ({'sdd'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Removing single pathed devices sdd {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f45999-2a00-4dea-9281-43a227f38e79]: (4, ('path checker states:\nup                  1\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d0fd48-3e76-469e-833b-6acc7d5ed807]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Flushing IO for device /dev/sdd {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d38db82-47ef-4297-bc4e-50f111f268b3]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[26308566-34d6-4338-b678-affeb9c0d85a]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] SCSI volumes sdd have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[777ed0b0-43d3-4c8f-8fdf-9f4e51c606b9]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5adeac-2672-4dc5-9615-b50b3effcb34]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e, portal: 172.16.0.220,3260]
Nov 09 03:42:07 user nova-compute[75378]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e, portal: 172.16.0.220,3260] successful.
Nov 09 03:42:07 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6a7fe63-54f7-459f-b608-89a2cc39300e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[44975afd-c2b9-492c-871a-312996a2b8c2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] <== disconnect_volume: return (381ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:42:07 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Deleting instance files /opt/stack/data/nova/instances/b44da21c-9c44-48d2-865c-85ea2f103a89_del
Nov 09 03:42:07 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Deletion of /opt/stack/data/nova/instances/b44da21c-9c44-48d2-865c-85ea2f103a89_del complete
Nov 09 03:42:07 user nova-compute[75378]: INFO nova.compute.manager [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Took 4.32 seconds to destroy the instance on the hypervisor.
Nov 09 03:42:07 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:42:07 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:42:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-5eb99089-01b0-45ad-a38c-1e5e942b4531 req-8ce414ec-d282-454f-bc69-6344fb672058 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-deleted-6a068d92-ddf4-406a-be66-1d4c2bd2b11d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:09 user nova-compute[75378]: INFO nova.compute.manager [req-5eb99089-01b0-45ad-a38c-1e5e942b4531 req-8ce414ec-d282-454f-bc69-6344fb672058 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Neutron deleted interface 6a068d92-ddf4-406a-be66-1d4c2bd2b11d; detaching it from the instance and deleting it from the info cache
Nov 09 03:42:09 user nova-compute[75378]: DEBUG nova.network.neutron [req-5eb99089-01b0-45ad-a38c-1e5e942b4531 req-8ce414ec-d282-454f-bc69-6344fb672058 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Updating instance_info_cache with network_info: [{"id": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "address": "fa:16:3e:c8:1b:52", "network": {"id": "62aa759a-558d-42aa-8910-9709e02e9e1a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1100617011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e8875f-2f", "ovs_interfaceid": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b362041e-0313-42e1-be36-6ad021228d16", "address": "fa:16:3e:2e:52:a1", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362041e-03", "ovs_interfaceid": "b362041e-0313-42e1-be36-6ad021228d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14de84ce-7772-461d-9b7a-168604176bd3", "address": "fa:16:3e:e4:3c:b4", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14de84ce-77", "ovs_interfaceid": "14de84ce-7772-461d-9b7a-168604176bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "address": "fa:16:3e:88:5d:5c", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccf9fd7-4e", "ovs_interfaceid": "8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "address": "fa:16:3e:c5:79:79", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d6cece-2c", "ovs_interfaceid": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27b8914c-2639-4117-86c1-62615361ab73", "address": "fa:16:3e:10:53:c2", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8914c-26", "ovs_interfaceid": "27b8914c-2639-4117-86c1-62615361ab73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:42:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-5eb99089-01b0-45ad-a38c-1e5e942b4531 req-8ce414ec-d282-454f-bc69-6344fb672058 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Detach interface failed, port_id=6a068d92-ddf4-406a-be66-1d4c2bd2b11d, reason: Instance b44da21c-9c44-48d2-865c-85ea2f103a89 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 03:42:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-ba9837f3-fe85-459a-95b7-d628415dffb5 req-d2129fdb-4ff0-46f1-992c-e42c48f1c1c0 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-deleted-8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:12 user nova-compute[75378]: INFO nova.compute.manager [req-ba9837f3-fe85-459a-95b7-d628415dffb5 req-d2129fdb-4ff0-46f1-992c-e42c48f1c1c0 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Neutron deleted interface 8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a; detaching it from the instance and deleting it from the info cache
Nov 09 03:42:12 user nova-compute[75378]: DEBUG nova.network.neutron [req-ba9837f3-fe85-459a-95b7-d628415dffb5 req-d2129fdb-4ff0-46f1-992c-e42c48f1c1c0 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Updating instance_info_cache with network_info: [{"id": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "address": "fa:16:3e:c8:1b:52", "network": {"id": "62aa759a-558d-42aa-8910-9709e02e9e1a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1100617011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e8875f-2f", "ovs_interfaceid": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b362041e-0313-42e1-be36-6ad021228d16", "address": "fa:16:3e:2e:52:a1", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362041e-03", "ovs_interfaceid": "b362041e-0313-42e1-be36-6ad021228d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14de84ce-7772-461d-9b7a-168604176bd3", "address": "fa:16:3e:e4:3c:b4", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14de84ce-77", "ovs_interfaceid": "14de84ce-7772-461d-9b7a-168604176bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "address": "fa:16:3e:c5:79:79", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d6cece-2c", "ovs_interfaceid": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27b8914c-2639-4117-86c1-62615361ab73", "address": "fa:16:3e:10:53:c2", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27b8914c-26", "ovs_interfaceid": "27b8914c-2639-4117-86c1-62615361ab73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:42:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-ba9837f3-fe85-459a-95b7-d628415dffb5 req-d2129fdb-4ff0-46f1-992c-e42c48f1c1c0 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Detach interface failed, port_id=8ccf9fd7-4e8d-4d7f-b70a-8b6d12252e3a, reason: Instance b44da21c-9c44-48d2-865c-85ea2f103a89 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 03:42:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-ba9837f3-fe85-459a-95b7-d628415dffb5 req-d2129fdb-4ff0-46f1-992c-e42c48f1c1c0 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-deleted-27b8914c-2639-4117-86c1-62615361ab73 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:12 user nova-compute[75378]: INFO nova.compute.manager [req-ba9837f3-fe85-459a-95b7-d628415dffb5 req-d2129fdb-4ff0-46f1-992c-e42c48f1c1c0 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Neutron deleted interface 27b8914c-2639-4117-86c1-62615361ab73; detaching it from the instance and deleting it from the info cache
Nov 09 03:42:12 user nova-compute[75378]: DEBUG nova.network.neutron [req-ba9837f3-fe85-459a-95b7-d628415dffb5 req-d2129fdb-4ff0-46f1-992c-e42c48f1c1c0 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Updating instance_info_cache with network_info: [{"id": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "address": "fa:16:3e:c8:1b:52", "network": {"id": "62aa759a-558d-42aa-8910-9709e02e9e1a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1100617011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e8875f-2f", "ovs_interfaceid": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b362041e-0313-42e1-be36-6ad021228d16", "address": "fa:16:3e:2e:52:a1", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362041e-03", "ovs_interfaceid": "b362041e-0313-42e1-be36-6ad021228d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14de84ce-7772-461d-9b7a-168604176bd3", "address": "fa:16:3e:e4:3c:b4", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14de84ce-77", "ovs_interfaceid": "14de84ce-7772-461d-9b7a-168604176bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "address": "fa:16:3e:c5:79:79", "network": {"id": "891f687a-6a37-4713-a0f0-40baac281590", "bridge": "br-int", "label": "tempest-device-tagging-net2-179587158", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d6cece-2c", "ovs_interfaceid": "68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:42:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-ba9837f3-fe85-459a-95b7-d628415dffb5 req-d2129fdb-4ff0-46f1-992c-e42c48f1c1c0 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Detach interface failed, port_id=27b8914c-2639-4117-86c1-62615361ab73, reason: Instance b44da21c-9c44-48d2-865c-85ea2f103a89 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 03:42:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-ba9837f3-fe85-459a-95b7-d628415dffb5 req-d2129fdb-4ff0-46f1-992c-e42c48f1c1c0 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-deleted-68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:12 user nova-compute[75378]: INFO nova.compute.manager [req-ba9837f3-fe85-459a-95b7-d628415dffb5 req-d2129fdb-4ff0-46f1-992c-e42c48f1c1c0 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Neutron deleted interface 68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983; detaching it from the instance and deleting it from the info cache
Nov 09 03:42:12 user nova-compute[75378]: DEBUG nova.network.neutron [req-ba9837f3-fe85-459a-95b7-d628415dffb5 req-d2129fdb-4ff0-46f1-992c-e42c48f1c1c0 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Updating instance_info_cache with network_info: [{"id": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "address": "fa:16:3e:c8:1b:52", "network": {"id": "62aa759a-558d-42aa-8910-9709e02e9e1a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1100617011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e8875f-2f", "ovs_interfaceid": "81e8875f-2f35-4bc9-ba66-a6140aedeafc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b362041e-0313-42e1-be36-6ad021228d16", "address": "fa:16:3e:2e:52:a1", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb362041e-03", "ovs_interfaceid": "b362041e-0313-42e1-be36-6ad021228d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14de84ce-7772-461d-9b7a-168604176bd3", "address": "fa:16:3e:e4:3c:b4", "network": {"id": "387ee4c2-4640-4995-a142-edfd6ca74ebe", "bridge": "br-int", "label": "tempest-device-tagging-net1-486289569", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f0bff904ec1645bcaa1c5b699b104047", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14de84ce-77", "ovs_interfaceid": "14de84ce-7772-461d-9b7a-168604176bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:42:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-ba9837f3-fe85-459a-95b7-d628415dffb5 req-d2129fdb-4ff0-46f1-992c-e42c48f1c1c0 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Detach interface failed, port_id=68d6cece-2c63-4e3e-a7f1-5a9f0b5c0983, reason: Instance b44da21c-9c44-48d2-865c-85ea2f103a89 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 03:42:12 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:42:12 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Took 4.63 seconds to deallocate network for instance.
Nov 09 03:42:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-ca174c7c-97f2-4f94-9955-56effe306ed3 req-a89802cf-aaa7-4961-bfb0-0cf221feb5b9 service nova] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Received event network-vif-deleted-81e8875f-2f35-4bc9-ba66-a6140aedeafc {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:16 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:42:16 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Cleaning up deleted instances {{(pid=75378) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 03:42:16 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] There are 0 instances to clean {{(pid=75378) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 03:42:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:19 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:42:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:20 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:42:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:21 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:42:21 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:42:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:22 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:42:22 user nova-compute[75378]: INFO nova.compute.manager [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] [instance: b44da21c-9c44-48d2-865c-85ea2f103a89] Took 10.38 seconds to detach 3 volumes for instance.
Nov 09 03:42:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "7d051405-6b57-4db2-9533-c2f4e87134d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "7d051405-6b57-4db2-9533-c2f4e87134d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.033s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:42:23 user nova-compute[75378]: INFO nova.compute.claims [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Claim successful on node user
Nov 09 03:42:23 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Deleted allocations for instance b44da21c-9c44-48d2-865c-85ea2f103a89
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-fadeb1f5-4118-4a08-986a-ff08778b229d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-fadeb1f5-4118-4a08-986a-ff08778b229d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d00e3d97-fc14-4b4d-ad19-ceed477c764a tempest-TaggedBootDevicesTest-715356366 tempest-TaggedBootDevicesTest-715356366-project-member] Lock "b44da21c-9c44-48d2-865c-85ea2f103a89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 20.085s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Updating instance_info_cache with network_info: [{"id": "c831c172-1cc7-428a-b240-f6ced441ef2a", "address": "fa:16:3e:3a:19:8c", "network": {"id": "7cae065f-736a-43fe-a505-62054a7c5af3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-265578846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5d1f59e34b145bab300bb75cc1b7e2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831c172-1c", "ovs_interfaceid": "c831c172-1cc7-428a-b240-f6ced441ef2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-fadeb1f5-4118-4a08-986a-ff08778b229d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:42:23 user nova-compute[75378]: WARNING nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 9691c96a-287e-40f0-a7e2-70bd56d9d2d3 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 2f475dba-59f5-414a-8156-8b438601ecfd {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 70a7686e-042c-4be8-8182-69c62027c744 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid fadeb1f5-4118-4a08-986a-ff08778b229d {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 28c97c2c-4939-44e6-bbdc-1351faf78898 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 657ae9e7-1a0b-4a29-acd9-5441c75f5920 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 7d051405-6b57-4db2-9533-c2f4e87134d8 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "2f475dba-59f5-414a-8156-8b438601ecfd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "70a7686e-042c-4be8-8182-69c62027c744" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "70a7686e-042c-4be8-8182-69c62027c744" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "fadeb1f5-4118-4a08-986a-ff08778b229d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "28c97c2c-4939-44e6-bbdc-1351faf78898" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "28c97c2c-4939-44e6-bbdc-1351faf78898" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "7d051405-6b57-4db2-9533-c2f4e87134d8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75378) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:42:23 user nova-compute[75378]: DEBUG nova.network.neutron [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:42:24 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:42:24 user nova-compute[75378]: DEBUG nova.compute.manager [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "2f475dba-59f5-414a-8156-8b438601ecfd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "70a7686e-042c-4be8-8182-69c62027c744" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG nova.policy [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57efcfeacd7f4daf916e7dd04e11d8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2176531ffa4cf7bec818309e39ab8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "28c97c2c-4939-44e6-bbdc-1351faf78898" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.141s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG nova.compute.manager [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:42:24 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Creating image(s)
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "/opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "/opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.217s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG nova.network.neutron [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Successfully created port: 90598abb-8896-4b67-9871-b78f46b1fdfe {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk 1073741824" returned: 0 in 0.048s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.195s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:42:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Cannot resize image /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Ensure instance console log exists: /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG nova.network.neutron [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Successfully updated port: 90598abb-8896-4b67-9871-b78f46b1fdfe {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "refresh_cache-7d051405-6b57-4db2-9533-c2f4e87134d8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquired lock "refresh_cache-7d051405-6b57-4db2-9533-c2f4e87134d8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG nova.network.neutron [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-75967bfd-b577-4fe3-a21e-fd74b9329358 req-bcdc1bcb-54f9-487f-89a1-79a2c31f9674 service nova] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Received event network-changed-90598abb-8896-4b67-9871-b78f46b1fdfe {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-75967bfd-b577-4fe3-a21e-fd74b9329358 req-bcdc1bcb-54f9-487f-89a1-79a2c31f9674 service nova] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Refreshing instance network info cache due to event network-changed-90598abb-8896-4b67-9871-b78f46b1fdfe. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-75967bfd-b577-4fe3-a21e-fd74b9329358 req-bcdc1bcb-54f9-487f-89a1-79a2c31f9674 service nova] Acquiring lock "refresh_cache-7d051405-6b57-4db2-9533-c2f4e87134d8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG nova.network.neutron [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG nova.network.neutron [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Updating instance_info_cache with network_info: [{"id": "90598abb-8896-4b67-9871-b78f46b1fdfe", "address": "fa:16:3e:ed:1b:d3", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90598abb-88", "ovs_interfaceid": "90598abb-8896-4b67-9871-b78f46b1fdfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Releasing lock "refresh_cache-7d051405-6b57-4db2-9533-c2f4e87134d8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG nova.compute.manager [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Instance network_info: |[{"id": "90598abb-8896-4b67-9871-b78f46b1fdfe", "address": "fa:16:3e:ed:1b:d3", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90598abb-88", "ovs_interfaceid": "90598abb-8896-4b67-9871-b78f46b1fdfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-75967bfd-b577-4fe3-a21e-fd74b9329358 req-bcdc1bcb-54f9-487f-89a1-79a2c31f9674 service nova] Acquired lock "refresh_cache-7d051405-6b57-4db2-9533-c2f4e87134d8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG nova.network.neutron [req-75967bfd-b577-4fe3-a21e-fd74b9329358 req-bcdc1bcb-54f9-487f-89a1-79a2c31f9674 service nova] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Refreshing network info cache for port 90598abb-8896-4b67-9871-b78f46b1fdfe {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:42:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Start _get_guest_xml network_info=[{"id": "90598abb-8896-4b67-9871-b78f46b1fdfe", "address": "fa:16:3e:ed:1b:d3", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90598abb-88", "ovs_interfaceid": "90598abb-8896-4b67-9871-b78f46b1fdfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:42:26 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:42:26 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1360967074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1360967074',id=15,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c2176531ffa4cf7bec818309e39ab8d',ramdisk_id='',reservation_id='r-2d0lhvyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:42:24Z,user_data=None,user_id='57efcfeacd7f4daf916e7dd04e11d8f2',uuid=7d051405-6b57-4db2-9533-c2f4e87134d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90598abb-8896-4b67-9871-b78f46b1fdfe", "address": "fa:16:3e:ed:1b:d3", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90598abb-88", "ovs_interfaceid": "90598abb-8896-4b67-9871-b78f46b1fdfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converting VIF {"id": "90598abb-8896-4b67-9871-b78f46b1fdfe", "address": "fa:16:3e:ed:1b:d3", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90598abb-88", "ovs_interfaceid": "90598abb-8896-4b67-9871-b78f46b1fdfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:1b:d3,bridge_name='br-int',has_traffic_filtering=True,id=90598abb-8896-4b67-9871-b78f46b1fdfe,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90598abb-88') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.objects.instance [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d051405-6b57-4db2-9533-c2f4e87134d8 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:42:26 user nova-compute[75378]:   <uuid>7d051405-6b57-4db2-9533-c2f4e87134d8</uuid>
Nov 09 03:42:26 user nova-compute[75378]:   <name>instance-0000000f</name>
Nov 09 03:42:26 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:42:26 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:42:26 user nova-compute[75378]:   <metadata>
Nov 09 03:42:26 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:42:26 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:42:26 user nova-compute[75378]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1360967074</nova:name>
Nov 09 03:42:26 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:42:26</nova:creationTime>
Nov 09 03:42:26 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:42:26 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:42:26 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:42:26 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:42:26 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:42:26 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:42:26 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:42:26 user nova-compute[75378]:       <nova:owner>
Nov 09 03:42:26 user nova-compute[75378]:         <nova:user uuid="57efcfeacd7f4daf916e7dd04e11d8f2">tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member</nova:user>
Nov 09 03:42:26 user nova-compute[75378]:         <nova:project uuid="4c2176531ffa4cf7bec818309e39ab8d">tempest-ServerBootFromVolumeStableRescueTest-1679422577</nova:project>
Nov 09 03:42:26 user nova-compute[75378]:       </nova:owner>
Nov 09 03:42:26 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:42:26 user nova-compute[75378]:       <nova:ports>
Nov 09 03:42:26 user nova-compute[75378]:         <nova:port uuid="90598abb-8896-4b67-9871-b78f46b1fdfe">
Nov 09 03:42:26 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 03:42:26 user nova-compute[75378]:         </nova:port>
Nov 09 03:42:26 user nova-compute[75378]:       </nova:ports>
Nov 09 03:42:26 user nova-compute[75378]:     </nova:instance>
Nov 09 03:42:26 user nova-compute[75378]:   </metadata>
Nov 09 03:42:26 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:42:26 user nova-compute[75378]:     <system>
Nov 09 03:42:26 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:42:26 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:42:26 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:42:26 user nova-compute[75378]:       <entry name="serial">7d051405-6b57-4db2-9533-c2f4e87134d8</entry>
Nov 09 03:42:26 user nova-compute[75378]:       <entry name="uuid">7d051405-6b57-4db2-9533-c2f4e87134d8</entry>
Nov 09 03:42:26 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:42:26 user nova-compute[75378]:     </system>
Nov 09 03:42:26 user nova-compute[75378]:   </sysinfo>
Nov 09 03:42:26 user nova-compute[75378]:   <os>
Nov 09 03:42:26 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:42:26 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:42:26 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:42:26 user nova-compute[75378]:   </os>
Nov 09 03:42:26 user nova-compute[75378]:   <features>
Nov 09 03:42:26 user nova-compute[75378]:     <acpi/>
Nov 09 03:42:26 user nova-compute[75378]:     <apic/>
Nov 09 03:42:26 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:42:26 user nova-compute[75378]:   </features>
Nov 09 03:42:26 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:42:26 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:42:26 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:42:26 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:42:26 user nova-compute[75378]:   </clock>
Nov 09 03:42:26 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:42:26 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:42:26 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:42:26 user nova-compute[75378]:   </cpu>
Nov 09 03:42:26 user nova-compute[75378]:   <devices>
Nov 09 03:42:26 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:42:26 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:42:26 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk"/>
Nov 09 03:42:26 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:42:26 user nova-compute[75378]:     </disk>
Nov 09 03:42:26 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:42:26 user nova-compute[75378]:       <mac address="fa:16:3e:ed:1b:d3"/>
Nov 09 03:42:26 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:42:26 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:42:26 user nova-compute[75378]:       <target dev="tap90598abb-88"/>
Nov 09 03:42:26 user nova-compute[75378]:     </interface>
Nov 09 03:42:26 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:42:26 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/console.log" append="off"/>
Nov 09 03:42:26 user nova-compute[75378]:     </serial>
Nov 09 03:42:26 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:42:26 user nova-compute[75378]:     <video>
Nov 09 03:42:26 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:42:26 user nova-compute[75378]:     </video>
Nov 09 03:42:26 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:42:26 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:42:26 user nova-compute[75378]:     </rng>
Nov 09 03:42:26 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:42:26 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:42:26 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:42:26 user nova-compute[75378]:     </memballoon>
Nov 09 03:42:26 user nova-compute[75378]:   </devices>
Nov 09 03:42:26 user nova-compute[75378]: </domain>
Nov 09 03:42:26 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1360967074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1360967074',id=15,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c2176531ffa4cf7bec818309e39ab8d',ramdisk_id='',reservation_id='r-2d0lhvyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:42:24Z,user_data=None,user_id='57efcfeacd7f4daf916e7dd04e11d8f2',uuid=7d051405-6b57-4db2-9533-c2f4e87134d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90598abb-8896-4b67-9871-b78f46b1fdfe", "address": "fa:16:3e:ed:1b:d3", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90598abb-88", "ovs_interfaceid": "90598abb-8896-4b67-9871-b78f46b1fdfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converting VIF {"id": "90598abb-8896-4b67-9871-b78f46b1fdfe", "address": "fa:16:3e:ed:1b:d3", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90598abb-88", "ovs_interfaceid": "90598abb-8896-4b67-9871-b78f46b1fdfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:1b:d3,bridge_name='br-int',has_traffic_filtering=True,id=90598abb-8896-4b67-9871-b78f46b1fdfe,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90598abb-88') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG os_vif [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:1b:d3,bridge_name='br-int',has_traffic_filtering=True,id=90598abb-8896-4b67-9871-b78f46b1fdfe,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90598abb-88') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b46eba5e-d5b1-577d-bb59-85cac86fa63c', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90598abb-88, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90598abb-88, col_values=(('qos', UUID('82bd3082-d1dd-4e08-b6dd-01b4f8d6fde7')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90598abb-88, col_values=(('external_ids', {'iface-id': '90598abb-8896-4b67-9871-b78f46b1fdfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:1b:d3', 'vm-uuid': '7d051405-6b57-4db2-9533-c2f4e87134d8'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:26 user nova-compute[75378]: INFO os_vif [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:1b:d3,bridge_name='br-int',has_traffic_filtering=True,id=90598abb-8896-4b67-9871-b78f46b1fdfe,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90598abb-88')
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] No VIF found with MAC fa:16:3e:ed:1b:d3, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.network.neutron [req-75967bfd-b577-4fe3-a21e-fd74b9329358 req-bcdc1bcb-54f9-487f-89a1-79a2c31f9674 service nova] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Updated VIF entry in instance network info cache for port 90598abb-8896-4b67-9871-b78f46b1fdfe. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG nova.network.neutron [req-75967bfd-b577-4fe3-a21e-fd74b9329358 req-bcdc1bcb-54f9-487f-89a1-79a2c31f9674 service nova] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Updating instance_info_cache with network_info: [{"id": "90598abb-8896-4b67-9871-b78f46b1fdfe", "address": "fa:16:3e:ed:1b:d3", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90598abb-88", "ovs_interfaceid": "90598abb-8896-4b67-9871-b78f46b1fdfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:42:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-75967bfd-b577-4fe3-a21e-fd74b9329358 req-bcdc1bcb-54f9-487f-89a1-79a2c31f9674 service nova] Releasing lock "refresh_cache-7d051405-6b57-4db2-9533-c2f4e87134d8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:42:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-47c0ec53-6d09-4333-a904-127f315bb946 req-7b821e66-6e5b-4d9d-bf39-04dc873836c1 service nova] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Received event network-vif-plugged-90598abb-8896-4b67-9871-b78f46b1fdfe {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-47c0ec53-6d09-4333-a904-127f315bb946 req-7b821e66-6e5b-4d9d-bf39-04dc873836c1 service nova] Acquiring lock "7d051405-6b57-4db2-9533-c2f4e87134d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-47c0ec53-6d09-4333-a904-127f315bb946 req-7b821e66-6e5b-4d9d-bf39-04dc873836c1 service nova] Lock "7d051405-6b57-4db2-9533-c2f4e87134d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-47c0ec53-6d09-4333-a904-127f315bb946 req-7b821e66-6e5b-4d9d-bf39-04dc873836c1 service nova] Lock "7d051405-6b57-4db2-9533-c2f4e87134d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-47c0ec53-6d09-4333-a904-127f315bb946 req-7b821e66-6e5b-4d9d-bf39-04dc873836c1 service nova] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] No waiting events found dispatching network-vif-plugged-90598abb-8896-4b67-9871-b78f46b1fdfe {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:27 user nova-compute[75378]: WARNING nova.compute.manager [req-47c0ec53-6d09-4333-a904-127f315bb946 req-7b821e66-6e5b-4d9d-bf39-04dc873836c1 service nova] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Received unexpected event network-vif-plugged-90598abb-8896-4b67-9871-b78f46b1fdfe for instance with vm_state building and task_state spawning.
Nov 09 03:42:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-c72b976e-d28d-4051-9a20-a743e1a5b320 req-acc1c5bd-3b7f-4b59-acb0-83a0b5201bfa service nova] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Received event network-vif-plugged-90598abb-8896-4b67-9871-b78f46b1fdfe {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c72b976e-d28d-4051-9a20-a743e1a5b320 req-acc1c5bd-3b7f-4b59-acb0-83a0b5201bfa service nova] Acquiring lock "7d051405-6b57-4db2-9533-c2f4e87134d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c72b976e-d28d-4051-9a20-a743e1a5b320 req-acc1c5bd-3b7f-4b59-acb0-83a0b5201bfa service nova] Lock "7d051405-6b57-4db2-9533-c2f4e87134d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c72b976e-d28d-4051-9a20-a743e1a5b320 req-acc1c5bd-3b7f-4b59-acb0-83a0b5201bfa service nova] Lock "7d051405-6b57-4db2-9533-c2f4e87134d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-c72b976e-d28d-4051-9a20-a743e1a5b320 req-acc1c5bd-3b7f-4b59-acb0-83a0b5201bfa service nova] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] No waiting events found dispatching network-vif-plugged-90598abb-8896-4b67-9871-b78f46b1fdfe {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:29 user nova-compute[75378]: WARNING nova.compute.manager [req-c72b976e-d28d-4051-9a20-a743e1a5b320 req-acc1c5bd-3b7f-4b59-acb0-83a0b5201bfa service nova] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Received unexpected event network-vif-plugged-90598abb-8896-4b67-9871-b78f46b1fdfe for instance with vm_state building and task_state spawning.
Nov 09 03:42:30 user nova-compute[75378]: DEBUG nova.compute.manager [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:42:30 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Instance spawned successfully.
Nov 09 03:42:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:42:30 user nova-compute[75378]: INFO nova.compute.manager [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Took 6.06 seconds to spawn the instance on the hypervisor.
Nov 09 03:42:30 user nova-compute[75378]: DEBUG nova.compute.manager [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:30 user nova-compute[75378]: INFO nova.compute.manager [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Took 7.16 seconds to build instance.
Nov 09 03:42:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-44100f44-524e-4027-8c84-cee214d29132 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "7d051405-6b57-4db2-9533-c2f4e87134d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.302s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "7d051405-6b57-4db2-9533-c2f4e87134d8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.469s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "7d051405-6b57-4db2-9533-c2f4e87134d8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:33 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:42:33 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:42:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7556MB free_disk=25.571273803710938GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:42:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Applying migration context for instance 2f475dba-59f5-414a-8156-8b438601ecfd as it has an incoming, in-progress migration 3130c521-681a-4402-886d-44c0d7257008. Migration status is finished {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 09 03:42:33 user nova-compute[75378]: INFO nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Updating resource usage from migration 3130c521-681a-4402-886d-44c0d7257008
Nov 09 03:42:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9691c96a-287e-40f0-a7e2-70bd56d9d2d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:42:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:42:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:42:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 70a7686e-042c-4be8-8182-69c62027c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:42:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance fadeb1f5-4118-4a08-986a-ff08778b229d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:42:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 28c97c2c-4939-44e6-bbdc-1351faf78898 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:42:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Migration 3130c521-681a-4402-886d-44c0d7257008 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 09 03:42:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2f475dba-59f5-414a-8156-8b438601ecfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:42:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 657ae9e7-1a0b-4a29-acd9-5441c75f5920 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:42:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7d051405-6b57-4db2-9533-c2f4e87134d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:42:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:42:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:42:33 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing inventories for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 03:42:33 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Updating ProviderTree inventory for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 03:42:33 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Updating inventory in ProviderTree for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 03:42:33 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing aggregate associations for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8, aggregates: None {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 03:42:33 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing trait associations for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8, traits: HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 03:42:34 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:42:34 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:42:34 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:42:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.913s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:38 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:42:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:42:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 03:42:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:42:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:42:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:49 user nova-compute[75378]: DEBUG nova.network.neutron [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Port d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 binding to destination host user is already ACTIVE {{(pid=75378) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 09 03:42:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:42:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquired lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:42:49 user nova-compute[75378]: DEBUG nova.network.neutron [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:42:49 user nova-compute[75378]: DEBUG nova.network.neutron [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Updating instance_info_cache with network_info: [{"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:42:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Releasing lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:42:49 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Creating tmpfile /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/tmp7v7fxzwj to verify with other compute node that the instance is on the same shared storage. {{(pid=75378) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 09 03:42:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-c32e71af-01ee-4f3c-81aa-d9566172506a req-814cd626-0c8d-4d28-ad6b-cb320980ee63 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received event network-vif-unplugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c32e71af-01ee-4f3c-81aa-d9566172506a req-814cd626-0c8d-4d28-ad6b-cb320980ee63 service nova] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c32e71af-01ee-4f3c-81aa-d9566172506a req-814cd626-0c8d-4d28-ad6b-cb320980ee63 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c32e71af-01ee-4f3c-81aa-d9566172506a req-814cd626-0c8d-4d28-ad6b-cb320980ee63 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-c32e71af-01ee-4f3c-81aa-d9566172506a req-814cd626-0c8d-4d28-ad6b-cb320980ee63 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] No waiting events found dispatching network-vif-unplugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:50 user nova-compute[75378]: WARNING nova.compute.manager [req-c32e71af-01ee-4f3c-81aa-d9566172506a req-814cd626-0c8d-4d28-ad6b-cb320980ee63 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received unexpected event network-vif-unplugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 for instance with vm_state resized and task_state resize_reverting.
Nov 09 03:42:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:50 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Instance destroyed successfully.
Nov 09 03:42:50 user nova-compute[75378]: DEBUG nova.objects.instance [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lazy-loading 'resources' on Instance uuid 2f475dba-59f5-414a-8156-8b438601ecfd {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1138780210',display_name='tempest-ServerActionsTestOtherB-server-1138780210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1138780210',id=4,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+s7M8RwDJb3loYxaUJGVxjbTQ9aVX7ngKf1RZUNQALVC7bsteyYsWXKwZsj2SvyMQBcJEfxsQ8l4Bn0IQtqoWxZ715fiA5I3KyJRgBFHf7jRe97Ql+ZXV7Ej5ZLqWSCg==',key_name='tempest-keypair-904427918',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:41:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb0bda222cd54a44bd26b140d08d8274',ramdisk_id='',reservation_id='r-u0jhm5ex',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1007633314',owner_user_name='tempest-ServerActionsTestOtherB-1007633314-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:41:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7bb5d4c95c341beaa22c1bbeacaf4f7',uuid=2f475dba-59f5-414a-8156-8b438601ecfd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Converting VIF {"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:9f:69,bridge_name='br-int',has_traffic_filtering=True,id=d0fa9225-bc1d-4d57-b259-5a6d1e3638f8,network=Network(2e704dce-6cba-4cf1-bd3e-d05da48d7839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fa9225-bc') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG os_vif [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:9f:69,bridge_name='br-int',has_traffic_filtering=True,id=d0fa9225-bc1d-4d57-b259-5a6d1e3638f8,network=Network(2e704dce-6cba-4cf1-bd3e-d05da48d7839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fa9225-bc') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0fa9225-bc, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d24e195a-707b-4698-9194-b21caaae4076) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:50 user nova-compute[75378]: INFO os_vif [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:9f:69,bridge_name='br-int',has_traffic_filtering=True,id=d0fa9225-bc1d-4d57-b259-5a6d1e3638f8,network=Network(2e704dce-6cba-4cf1-bd3e-d05da48d7839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fa9225-bc')
Nov 09 03:42:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etYnaShu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:42:50 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:42:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[064e9b14-6993-4e36-a492-6258de24ea8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:42:50 user nova-compute[75378]: No targets found.
Nov 09 03:42:50 user nova-compute[75378]: iSNS:
Nov 09 03:42:50 user nova-compute[75378]: No targets found.
Nov 09 03:42:50 user nova-compute[75378]: STATIC:
Nov 09 03:42:50 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac
Nov 09 03:42:50 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:42:50 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:42:50 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be
Nov 09 03:42:50 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:42:50 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:42:50 user nova-compute[75378]: FIRMWARE:
Nov 09 03:42:50 user nova-compute[75378]: No targets found.
Nov 09 03:42:50 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:42:50 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:42:50 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b2d9d2-b195-4ee0-8cef-2dafd33165bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dcafe1-4495-4e31-8147-839b07f6e51d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:42:50 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:42:50 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:42:50 user nova-compute[75378]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:42:50 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c7b5120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be'): ({'sdg'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Removing single pathed devices sdg {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2782dc0-db13-42f6-8f0d-0630fbbdd6bf]: (4, ('path checker states:\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b217a40-de58-4e9f-aa18-0a82bd4ba817]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Flushing IO for device /dev/sdg {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3c9e21-1aa1-41ad-ae0f-ffb7fe577024]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[383b9e82-212c-4090-9d0f-387c6ea3c9a9]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] SCSI volumes sdg have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[727e58d3-27bb-4255-b951-dc58521ea9ff]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:42:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:51 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f14eb4-8ba5-4b0c-b82e-bb6587f3a68f]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:51 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260]
Nov 09 03:42:51 user nova-compute[75378]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260] successful.
Nov 09 03:42:51 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:42:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:51 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc37081c-fab2-4add-b048-1a385506e66d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:51 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:42:51 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:42:51 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] <== disconnect_volume: return (413ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:42:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:42:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG nova.compute.manager [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG nova.compute.manager [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] No waiting events found dispatching network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:52 user nova-compute[75378]: WARNING nova.compute.manager [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received unexpected event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 for instance with vm_state resized and task_state resize_reverting.
Nov 09 03:42:52 user nova-compute[75378]: DEBUG nova.compute.manager [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG nova.compute.manager [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] No waiting events found dispatching network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:52 user nova-compute[75378]: WARNING nova.compute.manager [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received unexpected event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 for instance with vm_state resized and task_state resize_reverting.
Nov 09 03:42:52 user nova-compute[75378]: DEBUG nova.compute.manager [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG nova.compute.manager [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] No waiting events found dispatching network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:52 user nova-compute[75378]: WARNING nova.compute.manager [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received unexpected event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 for instance with vm_state resized and task_state resize_reverting.
Nov 09 03:42:52 user nova-compute[75378]: DEBUG nova.compute.manager [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received event network-vif-unplugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG nova.compute.manager [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] No waiting events found dispatching network-vif-unplugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:52 user nova-compute[75378]: WARNING nova.compute.manager [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received unexpected event network-vif-unplugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 for instance with vm_state resized and task_state resize_reverting.
Nov 09 03:42:52 user nova-compute[75378]: DEBUG nova.compute.manager [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG nova.compute.manager [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] No waiting events found dispatching network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:42:52 user nova-compute[75378]: WARNING nova.compute.manager [req-61b2f280-341d-4acc-8e4c-04c38b6b6265 req-25b3e2cb-f9b6-43c3-9f45-5ef46eec0da0 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received unexpected event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 for instance with vm_state resized and task_state resize_reverting.
Nov 09 03:42:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG nova.objects.instance [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lazy-loading 'migration_context' on Instance uuid 2f475dba-59f5-414a-8156-8b438601ecfd {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG nova.objects.base [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Object Instance<2f475dba-59f5-414a-8156-8b438601ecfd> lazy-loaded attributes: resources,migration_context {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:42:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.621s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:42:53 user nova-compute[75378]: INFO nova.compute.manager [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Swapping old allocation on dict_keys(['47051f37-c496-4978-8e02-d2f1a5bbf8b8']) held by migration 3130c521-681a-4402-886d-44c0d7257008 for instance
Nov 09 03:42:53 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Overwriting current allocation {'allocations': {'47051f37-c496-4978-8e02-d2f1a5bbf8b8': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 19}}, 'project_id': 'cb0bda222cd54a44bd26b140d08d8274', 'user_id': 'e7bb5d4c95c341beaa22c1bbeacaf4f7', 'consumer_generation': 1} on consumer 2f475dba-59f5-414a-8156-8b438601ecfd {{(pid=75378) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 09 03:42:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:42:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquired lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:42:53 user nova-compute[75378]: DEBUG nova.network.neutron [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG nova.network.neutron [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Updating instance_info_cache with network_info: [{"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Releasing lock "refresh_cache-2f475dba-59f5-414a-8156-8b438601ecfd" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG os_brick.utils [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[884ae698-1f92-4b8b-abc7-367b8c6c834c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd911d2-899b-4932-b6cc-111186652dab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[271e5f53-a91a-4cc4-aad1-43b2451757ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[62af0840-6569-4e01-87b5-38dd4bbbba2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:42:54 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:42:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc692f7c-7b76-4d8d-88ec-34b1eb4fdf94]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:42:54 user nova-compute[75378]: DEBUG os_brick.utils [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:42:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:42:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Acquiring lock "fadeb1f5-4118-4a08-986a-ff08778b229d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:00 user nova-compute[75378]: INFO nova.compute.manager [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Detaching volume cf663092-5cd7-48cd-9ecd-06653f9ff5ac
Nov 09 03:43:00 user nova-compute[75378]: INFO nova.virt.block_device [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Attempting to driver detach volume cf663092-5cd7-48cd-9ecd-06653f9ff5ac from mountpoint /dev/vdb
Nov 09 03:43:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Attempting to detach device vdb from instance fadeb1f5-4118-4a08-986a-ff08778b229d from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 03:43:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:43:00 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:43:00 user nova-compute[75378]:   <source dev="/dev/sde"/>
Nov 09 03:43:00 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:43:00 user nova-compute[75378]:   <serial>cf663092-5cd7-48cd-9ecd-06653f9ff5ac</serial>
Nov 09 03:43:00 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 03:43:00 user nova-compute[75378]: </disk>
Nov 09 03:43:00 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:43:00 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Successfully detached device vdb from instance fadeb1f5-4118-4a08-986a-ff08778b229d from the persistent domain config.
Nov 09 03:43:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fadeb1f5-4118-4a08-986a-ff08778b229d from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 03:43:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:43:00 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:43:00 user nova-compute[75378]:   <source dev="/dev/sde"/>
Nov 09 03:43:00 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:43:00 user nova-compute[75378]:   <serial>cf663092-5cd7-48cd-9ecd-06653f9ff5ac</serial>
Nov 09 03:43:00 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 03:43:00 user nova-compute[75378]: </disk>
Nov 09 03:43:00 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:43:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fadeb1f5-4118-4a08-986a-ff08778b229d {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "28c97c2c-4939-44e6-bbdc-1351faf78898" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "28c97c2c-4939-44e6-bbdc-1351faf78898" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "28c97c2c-4939-44e6-bbdc-1351faf78898-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "28c97c2c-4939-44e6-bbdc-1351faf78898-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "28c97c2c-4939-44e6-bbdc-1351faf78898-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:01 user nova-compute[75378]: INFO nova.compute.manager [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Terminating instance
Nov 09 03:43:01 user nova-compute[75378]: DEBUG nova.compute.manager [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG nova.compute.manager [req-2f47db7d-9169-43bd-9a21-b35377a250e4 req-52813a84-c6de-45a2-99dd-b67e98cee32f service nova] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Received event network-vif-unplugged-209ce7dc-3dc4-485f-acb2-89f8306b93fe {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2f47db7d-9169-43bd-9a21-b35377a250e4 req-52813a84-c6de-45a2-99dd-b67e98cee32f service nova] Acquiring lock "28c97c2c-4939-44e6-bbdc-1351faf78898-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2f47db7d-9169-43bd-9a21-b35377a250e4 req-52813a84-c6de-45a2-99dd-b67e98cee32f service nova] Lock "28c97c2c-4939-44e6-bbdc-1351faf78898-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2f47db7d-9169-43bd-9a21-b35377a250e4 req-52813a84-c6de-45a2-99dd-b67e98cee32f service nova] Lock "28c97c2c-4939-44e6-bbdc-1351faf78898-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG nova.compute.manager [req-2f47db7d-9169-43bd-9a21-b35377a250e4 req-52813a84-c6de-45a2-99dd-b67e98cee32f service nova] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] No waiting events found dispatching network-vif-unplugged-209ce7dc-3dc4-485f-acb2-89f8306b93fe {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG nova.compute.manager [req-2f47db7d-9169-43bd-9a21-b35377a250e4 req-52813a84-c6de-45a2-99dd-b67e98cee32f service nova] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Received event network-vif-unplugged-209ce7dc-3dc4-485f-acb2-89f8306b93fe for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:01 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Instance destroyed successfully.
Nov 09 03:43:01 user nova-compute[75378]: DEBUG nova.objects.instance [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lazy-loading 'resources' on Instance uuid 28c97c2c-4939-44e6-bbdc-1351faf78898 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:40:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1631135602',display_name='tempest-VolumesAdminNegativeTest-server-1631135602',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1631135602',id=13,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:40:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13e8a43607594d039f7514185feb8e78',ramdisk_id='',reservation_id='r-nl7aknxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-980015254',owner_user_name='tempest-VolumesAdminNegativeTest-980015254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:40:39Z,user_data=None,user_id='6811290b00b044f1b1a0430f775d512a',uuid=28c97c2c-4939-44e6-bbdc-1351faf78898,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "209ce7dc-3dc4-485f-acb2-89f8306b93fe", "address": "fa:16:3e:a6:4f:62", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ce7dc-3d", "ovs_interfaceid": "209ce7dc-3dc4-485f-acb2-89f8306b93fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Converting VIF {"id": "209ce7dc-3dc4-485f-acb2-89f8306b93fe", "address": "fa:16:3e:a6:4f:62", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ce7dc-3d", "ovs_interfaceid": "209ce7dc-3dc4-485f-acb2-89f8306b93fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4f:62,bridge_name='br-int',has_traffic_filtering=True,id=209ce7dc-3dc4-485f-acb2-89f8306b93fe,network=Network(bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap209ce7dc-3d') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG os_vif [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4f:62,bridge_name='br-int',has_traffic_filtering=True,id=209ce7dc-3dc4-485f-acb2-89f8306b93fe,network=Network(bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap209ce7dc-3d') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap209ce7dc-3d, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa4b96a9-caed-4fd0-82cd-ec42ba5eb722) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:43:01 user nova-compute[75378]: INFO os_vif [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4f:62,bridge_name='br-int',has_traffic_filtering=True,id=209ce7dc-3dc4-485f-acb2-89f8306b93fe,network=Network(bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap209ce7dc-3d')
Nov 09 03:43:01 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Deleting instance files /opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898_del
Nov 09 03:43:01 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Deletion of /opt/stack/data/nova/instances/28c97c2c-4939-44e6-bbdc-1351faf78898_del complete
Nov 09 03:43:02 user nova-compute[75378]: INFO nova.compute.manager [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 09 03:43:02 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:43:02 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:43:02 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:43:02 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:43:02 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Took 0.80 seconds to deallocate network for instance.
Nov 09 03:43:02 user nova-compute[75378]: DEBUG nova.compute.manager [req-75d6b083-6ca0-4aa8-8a8e-258f09f03331 req-a57cfa7c-b9bc-425f-a0e0-37f250922687 service nova] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Received event network-vif-deleted-209ce7dc-3dc4-485f-acb2-89f8306b93fe {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:43:02 user nova-compute[75378]: INFO nova.compute.manager [req-75d6b083-6ca0-4aa8-8a8e-258f09f03331 req-a57cfa7c-b9bc-425f-a0e0-37f250922687 service nova] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Neutron deleted interface 209ce7dc-3dc4-485f-acb2-89f8306b93fe; detaching it from the instance and deleting it from the info cache
Nov 09 03:43:02 user nova-compute[75378]: DEBUG nova.network.neutron [req-75d6b083-6ca0-4aa8-8a8e-258f09f03331 req-a57cfa7c-b9bc-425f-a0e0-37f250922687 service nova] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:43:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-75d6b083-6ca0-4aa8-8a8e-258f09f03331 req-a57cfa7c-b9bc-425f-a0e0-37f250922687 service nova] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Detach interface failed, port_id=209ce7dc-3dc4-485f-acb2-89f8306b93fe, reason: Instance 28c97c2c-4939-44e6-bbdc-1351faf78898 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 03:43:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-ce807eb7-02db-469c-b804-814a69b24148 req-dc8070f5-c8b2-4aed-86b1-fe050b4c7db8 service nova] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Received event network-vif-plugged-209ce7dc-3dc4-485f-acb2-89f8306b93fe {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:43:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ce807eb7-02db-469c-b804-814a69b24148 req-dc8070f5-c8b2-4aed-86b1-fe050b4c7db8 service nova] Acquiring lock "28c97c2c-4939-44e6-bbdc-1351faf78898-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ce807eb7-02db-469c-b804-814a69b24148 req-dc8070f5-c8b2-4aed-86b1-fe050b4c7db8 service nova] Lock "28c97c2c-4939-44e6-bbdc-1351faf78898-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ce807eb7-02db-469c-b804-814a69b24148 req-dc8070f5-c8b2-4aed-86b1-fe050b4c7db8 service nova] Lock "28c97c2c-4939-44e6-bbdc-1351faf78898-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-ce807eb7-02db-469c-b804-814a69b24148 req-dc8070f5-c8b2-4aed-86b1-fe050b4c7db8 service nova] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] No waiting events found dispatching network-vif-plugged-209ce7dc-3dc4-485f-acb2-89f8306b93fe {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:43:03 user nova-compute[75378]: WARNING nova.compute.manager [req-ce807eb7-02db-469c-b804-814a69b24148 req-dc8070f5-c8b2-4aed-86b1-fe050b4c7db8 service nova] [instance: 28c97c2c-4939-44e6-bbdc-1351faf78898] Received unexpected event network-vif-plugged-209ce7dc-3dc4-485f-acb2-89f8306b93fe for instance with vm_state deleted and task_state None.
Nov 09 03:43:03 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:43:03 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:43:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:03 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Deleted allocations for instance 28c97c2c-4939-44e6-bbdc-1351faf78898
Nov 09 03:43:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cde098d3-98f4-4575-8c24-1da8e45fd7dc tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "28c97c2c-4939-44e6-bbdc-1351faf78898" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.677s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Acquiring lock "f32d5f5d-fbf0-40f5-b078-4e46e70a10f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Lock "f32d5f5d-fbf0-40f5-b078-4e46e70a10f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:08 user nova-compute[75378]: DEBUG nova.compute.manager [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:43:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:08 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:43:08 user nova-compute[75378]: INFO nova.compute.claims [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Claim successful on node user
Nov 09 03:43:08 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:43:08 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:43:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:08 user nova-compute[75378]: DEBUG nova.compute.manager [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:43:08 user nova-compute[75378]: DEBUG nova.compute.manager [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:43:08 user nova-compute[75378]: DEBUG nova.network.neutron [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:43:08 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:43:08 user nova-compute[75378]: DEBUG nova.compute.manager [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:43:09 user nova-compute[75378]: DEBUG nova.policy [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f39ae7bb55f24fc8a0cf78cc3dd9c7b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de69173c2a9468eb75d26d0b8ac3e0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:43:09 user nova-compute[75378]: DEBUG nova.compute.manager [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:43:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:43:09 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Creating image(s)
Nov 09 03:43:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Acquiring lock "/opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Lock "/opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Lock "/opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:09 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:09 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.188s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:09 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:09 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.213s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:09 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:09 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3/disk 1073741824" returned: 0 in 0.064s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:09 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:09 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.180s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:09 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:43:09 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:10 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Cannot resize image /opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:43:10 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:43:10 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Ensure instance console log exists: /opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:43:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:10 user nova-compute[75378]: DEBUG nova.network.neutron [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Successfully created port: 97735033-b177-4d66-88eb-30423baf3a2f {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.network.neutron [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Successfully updated port: 97735033-b177-4d66-88eb-30423baf3a2f {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Acquiring lock "refresh_cache-f32d5f5d-fbf0-40f5-b078-4e46e70a10f3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Acquired lock "refresh_cache-f32d5f5d-fbf0-40f5-b078-4e46e70a10f3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.network.neutron [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.compute.manager [req-26577f96-97a2-46e4-a122-b00fd86cc5e5 req-a1a6aee3-a1e5-44f9-97a4-16a216fa1a91 service nova] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Received event network-changed-97735033-b177-4d66-88eb-30423baf3a2f {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.compute.manager [req-26577f96-97a2-46e4-a122-b00fd86cc5e5 req-a1a6aee3-a1e5-44f9-97a4-16a216fa1a91 service nova] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Refreshing instance network info cache due to event network-changed-97735033-b177-4d66-88eb-30423baf3a2f. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-26577f96-97a2-46e4-a122-b00fd86cc5e5 req-a1a6aee3-a1e5-44f9-97a4-16a216fa1a91 service nova] Acquiring lock "refresh_cache-f32d5f5d-fbf0-40f5-b078-4e46e70a10f3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.network.neutron [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.network.neutron [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Updating instance_info_cache with network_info: [{"id": "97735033-b177-4d66-88eb-30423baf3a2f", "address": "fa:16:3e:ff:35:30", "network": {"id": "e65a7789-3d5c-4bd7-8d6a-21a0ea7bf146", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "03f5a524b2184dac84ddb8b7c3710417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97735033-b1", "ovs_interfaceid": "97735033-b177-4d66-88eb-30423baf3a2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Releasing lock "refresh_cache-f32d5f5d-fbf0-40f5-b078-4e46e70a10f3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.compute.manager [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Instance network_info: |[{"id": "97735033-b177-4d66-88eb-30423baf3a2f", "address": "fa:16:3e:ff:35:30", "network": {"id": "e65a7789-3d5c-4bd7-8d6a-21a0ea7bf146", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "03f5a524b2184dac84ddb8b7c3710417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97735033-b1", "ovs_interfaceid": "97735033-b177-4d66-88eb-30423baf3a2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-26577f96-97a2-46e4-a122-b00fd86cc5e5 req-a1a6aee3-a1e5-44f9-97a4-16a216fa1a91 service nova] Acquired lock "refresh_cache-f32d5f5d-fbf0-40f5-b078-4e46e70a10f3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.network.neutron [req-26577f96-97a2-46e4-a122-b00fd86cc5e5 req-a1a6aee3-a1e5-44f9-97a4-16a216fa1a91 service nova] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Refreshing network info cache for port 97735033-b177-4d66-88eb-30423baf3a2f {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Start _get_guest_xml network_info=[{"id": "97735033-b177-4d66-88eb-30423baf3a2f", "address": "fa:16:3e:ff:35:30", "network": {"id": "e65a7789-3d5c-4bd7-8d6a-21a0ea7bf146", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "03f5a524b2184dac84ddb8b7c3710417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97735033-b1", "ovs_interfaceid": "97735033-b177-4d66-88eb-30423baf3a2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:43:11 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:43:11 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:43:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1710114101',display_name='tempest-VolumesNegativeTest-instance-1710114101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1710114101',id=16,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1de69173c2a9468eb75d26d0b8ac3e0f',ramdisk_id='',reservation_id='r-tgrx50lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1061283593',owner_user_name='tempest-VolumesNegativeTest-1061283593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:43:09Z,user_data=None,user_id='f39ae7bb55f24fc8a0cf78cc3dd9c7b8',uuid=f32d5f5d-fbf0-40f5-b078-4e46e70a10f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97735033-b177-4d66-88eb-30423baf3a2f", "address": "fa:16:3e:ff:35:30", "network": {"id": "e65a7789-3d5c-4bd7-8d6a-21a0ea7bf146", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "03f5a524b2184dac84ddb8b7c3710417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97735033-b1", "ovs_interfaceid": "97735033-b177-4d66-88eb-30423baf3a2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Converting VIF {"id": "97735033-b177-4d66-88eb-30423baf3a2f", "address": "fa:16:3e:ff:35:30", "network": {"id": "e65a7789-3d5c-4bd7-8d6a-21a0ea7bf146", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "03f5a524b2184dac84ddb8b7c3710417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97735033-b1", "ovs_interfaceid": "97735033-b177-4d66-88eb-30423baf3a2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:35:30,bridge_name='br-int',has_traffic_filtering=True,id=97735033-b177-4d66-88eb-30423baf3a2f,network=Network(e65a7789-3d5c-4bd7-8d6a-21a0ea7bf146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97735033-b1') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.objects.instance [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Lazy-loading 'pci_devices' on Instance uuid f32d5f5d-fbf0-40f5-b078-4e46e70a10f3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:43:11 user nova-compute[75378]:   <uuid>f32d5f5d-fbf0-40f5-b078-4e46e70a10f3</uuid>
Nov 09 03:43:11 user nova-compute[75378]:   <name>instance-00000010</name>
Nov 09 03:43:11 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:43:11 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:43:11 user nova-compute[75378]:   <metadata>
Nov 09 03:43:11 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:43:11 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:43:11 user nova-compute[75378]:       <nova:name>tempest-VolumesNegativeTest-instance-1710114101</nova:name>
Nov 09 03:43:11 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:43:11</nova:creationTime>
Nov 09 03:43:11 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:43:11 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:43:11 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:43:11 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:43:11 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:43:11 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:43:11 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:43:11 user nova-compute[75378]:       <nova:owner>
Nov 09 03:43:11 user nova-compute[75378]:         <nova:user uuid="f39ae7bb55f24fc8a0cf78cc3dd9c7b8">tempest-VolumesNegativeTest-1061283593-project-member</nova:user>
Nov 09 03:43:11 user nova-compute[75378]:         <nova:project uuid="1de69173c2a9468eb75d26d0b8ac3e0f">tempest-VolumesNegativeTest-1061283593</nova:project>
Nov 09 03:43:11 user nova-compute[75378]:       </nova:owner>
Nov 09 03:43:11 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:43:11 user nova-compute[75378]:       <nova:ports>
Nov 09 03:43:11 user nova-compute[75378]:         <nova:port uuid="97735033-b177-4d66-88eb-30423baf3a2f">
Nov 09 03:43:11 user nova-compute[75378]:           <nova:ip type="fixed" address="192.168.233.186" ipVersion="4"/>
Nov 09 03:43:11 user nova-compute[75378]:         </nova:port>
Nov 09 03:43:11 user nova-compute[75378]:       </nova:ports>
Nov 09 03:43:11 user nova-compute[75378]:     </nova:instance>
Nov 09 03:43:11 user nova-compute[75378]:   </metadata>
Nov 09 03:43:11 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:43:11 user nova-compute[75378]:     <system>
Nov 09 03:43:11 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:43:11 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:43:11 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:43:11 user nova-compute[75378]:       <entry name="serial">f32d5f5d-fbf0-40f5-b078-4e46e70a10f3</entry>
Nov 09 03:43:11 user nova-compute[75378]:       <entry name="uuid">f32d5f5d-fbf0-40f5-b078-4e46e70a10f3</entry>
Nov 09 03:43:11 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:43:11 user nova-compute[75378]:     </system>
Nov 09 03:43:11 user nova-compute[75378]:   </sysinfo>
Nov 09 03:43:11 user nova-compute[75378]:   <os>
Nov 09 03:43:11 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:43:11 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:43:11 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:43:11 user nova-compute[75378]:   </os>
Nov 09 03:43:11 user nova-compute[75378]:   <features>
Nov 09 03:43:11 user nova-compute[75378]:     <acpi/>
Nov 09 03:43:11 user nova-compute[75378]:     <apic/>
Nov 09 03:43:11 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:43:11 user nova-compute[75378]:   </features>
Nov 09 03:43:11 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:43:11 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:43:11 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:43:11 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:43:11 user nova-compute[75378]:   </clock>
Nov 09 03:43:11 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:43:11 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:43:11 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:43:11 user nova-compute[75378]:   </cpu>
Nov 09 03:43:11 user nova-compute[75378]:   <devices>
Nov 09 03:43:11 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:43:11 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:43:11 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3/disk"/>
Nov 09 03:43:11 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:43:11 user nova-compute[75378]:     </disk>
Nov 09 03:43:11 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:43:11 user nova-compute[75378]:       <mac address="fa:16:3e:ff:35:30"/>
Nov 09 03:43:11 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:43:11 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:43:11 user nova-compute[75378]:       <target dev="tap97735033-b1"/>
Nov 09 03:43:11 user nova-compute[75378]:     </interface>
Nov 09 03:43:11 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:43:11 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3/console.log" append="off"/>
Nov 09 03:43:11 user nova-compute[75378]:     </serial>
Nov 09 03:43:11 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:43:11 user nova-compute[75378]:     <video>
Nov 09 03:43:11 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:43:11 user nova-compute[75378]:     </video>
Nov 09 03:43:11 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:43:11 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:43:11 user nova-compute[75378]:     </rng>
Nov 09 03:43:11 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:43:11 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:43:11 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:43:11 user nova-compute[75378]:     </memballoon>
Nov 09 03:43:11 user nova-compute[75378]:   </devices>
Nov 09 03:43:11 user nova-compute[75378]: </domain>
Nov 09 03:43:11 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:43:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1710114101',display_name='tempest-VolumesNegativeTest-instance-1710114101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1710114101',id=16,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1de69173c2a9468eb75d26d0b8ac3e0f',ramdisk_id='',reservation_id='r-tgrx50lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1061283593',owner_user_name='tempest-VolumesNegativeTest-1061283593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:43:09Z,user_data=None,user_id='f39ae7bb55f24fc8a0cf78cc3dd9c7b8',uuid=f32d5f5d-fbf0-40f5-b078-4e46e70a10f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97735033-b177-4d66-88eb-30423baf3a2f", "address": "fa:16:3e:ff:35:30", "network": {"id": "e65a7789-3d5c-4bd7-8d6a-21a0ea7bf146", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "03f5a524b2184dac84ddb8b7c3710417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97735033-b1", "ovs_interfaceid": "97735033-b177-4d66-88eb-30423baf3a2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Converting VIF {"id": "97735033-b177-4d66-88eb-30423baf3a2f", "address": "fa:16:3e:ff:35:30", "network": {"id": "e65a7789-3d5c-4bd7-8d6a-21a0ea7bf146", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "03f5a524b2184dac84ddb8b7c3710417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97735033-b1", "ovs_interfaceid": "97735033-b177-4d66-88eb-30423baf3a2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:35:30,bridge_name='br-int',has_traffic_filtering=True,id=97735033-b177-4d66-88eb-30423baf3a2f,network=Network(e65a7789-3d5c-4bd7-8d6a-21a0ea7bf146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97735033-b1') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG os_vif [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:35:30,bridge_name='br-int',has_traffic_filtering=True,id=97735033-b177-4d66-88eb-30423baf3a2f,network=Network(e65a7789-3d5c-4bd7-8d6a-21a0ea7bf146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97735033-b1') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96b46dc7-3f8d-5c43-860f-f413b4b54fd1', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97735033-b1, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97735033-b1, col_values=(('qos', UUID('b1862ec3-681b-4456-bfbd-273185464edf')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97735033-b1, col_values=(('external_ids', {'iface-id': '97735033-b177-4d66-88eb-30423baf3a2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:35:30', 'vm-uuid': 'f32d5f5d-fbf0-40f5-b078-4e46e70a10f3'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:43:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:12 user nova-compute[75378]: INFO os_vif [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:35:30,bridge_name='br-int',has_traffic_filtering=True,id=97735033-b177-4d66-88eb-30423baf3a2f,network=Network(e65a7789-3d5c-4bd7-8d6a-21a0ea7bf146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97735033-b1')
Nov 09 03:43:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:43:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] No VIF found with MAC fa:16:3e:ff:35:30, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:43:12 user nova-compute[75378]: DEBUG nova.network.neutron [req-26577f96-97a2-46e4-a122-b00fd86cc5e5 req-a1a6aee3-a1e5-44f9-97a4-16a216fa1a91 service nova] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Updated VIF entry in instance network info cache for port 97735033-b177-4d66-88eb-30423baf3a2f. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:43:12 user nova-compute[75378]: DEBUG nova.network.neutron [req-26577f96-97a2-46e4-a122-b00fd86cc5e5 req-a1a6aee3-a1e5-44f9-97a4-16a216fa1a91 service nova] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Updating instance_info_cache with network_info: [{"id": "97735033-b177-4d66-88eb-30423baf3a2f", "address": "fa:16:3e:ff:35:30", "network": {"id": "e65a7789-3d5c-4bd7-8d6a-21a0ea7bf146", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "03f5a524b2184dac84ddb8b7c3710417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97735033-b1", "ovs_interfaceid": "97735033-b177-4d66-88eb-30423baf3a2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:43:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-26577f96-97a2-46e4-a122-b00fd86cc5e5 req-a1a6aee3-a1e5-44f9-97a4-16a216fa1a91 service nova] Releasing lock "refresh_cache-f32d5f5d-fbf0-40f5-b078-4e46e70a10f3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:43:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-7221c163-318c-4e4f-9d42-ecadbc167a0d req-ec730c58-be09-4acb-ad85-2a6b61d0efe6 service nova] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Received event network-vif-plugged-97735033-b177-4d66-88eb-30423baf3a2f {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:43:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7221c163-318c-4e4f-9d42-ecadbc167a0d req-ec730c58-be09-4acb-ad85-2a6b61d0efe6 service nova] Acquiring lock "f32d5f5d-fbf0-40f5-b078-4e46e70a10f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7221c163-318c-4e4f-9d42-ecadbc167a0d req-ec730c58-be09-4acb-ad85-2a6b61d0efe6 service nova] Lock "f32d5f5d-fbf0-40f5-b078-4e46e70a10f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7221c163-318c-4e4f-9d42-ecadbc167a0d req-ec730c58-be09-4acb-ad85-2a6b61d0efe6 service nova] Lock "f32d5f5d-fbf0-40f5-b078-4e46e70a10f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-7221c163-318c-4e4f-9d42-ecadbc167a0d req-ec730c58-be09-4acb-ad85-2a6b61d0efe6 service nova] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] No waiting events found dispatching network-vif-plugged-97735033-b177-4d66-88eb-30423baf3a2f {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:43:14 user nova-compute[75378]: WARNING nova.compute.manager [req-7221c163-318c-4e4f-9d42-ecadbc167a0d req-ec730c58-be09-4acb-ad85-2a6b61d0efe6 service nova] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Received unexpected event network-vif-plugged-97735033-b177-4d66-88eb-30423baf3a2f for instance with vm_state building and task_state spawning.
Nov 09 03:43:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:16 user nova-compute[75378]: DEBUG nova.compute.manager [req-48ea1471-aa14-4a4c-b286-96642f65a9b9 req-18e6cb5e-513b-4d6b-84be-fa663c82257f service nova] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Received event network-vif-plugged-97735033-b177-4d66-88eb-30423baf3a2f {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:43:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-48ea1471-aa14-4a4c-b286-96642f65a9b9 req-18e6cb5e-513b-4d6b-84be-fa663c82257f service nova] Acquiring lock "f32d5f5d-fbf0-40f5-b078-4e46e70a10f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-48ea1471-aa14-4a4c-b286-96642f65a9b9 req-18e6cb5e-513b-4d6b-84be-fa663c82257f service nova] Lock "f32d5f5d-fbf0-40f5-b078-4e46e70a10f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-48ea1471-aa14-4a4c-b286-96642f65a9b9 req-18e6cb5e-513b-4d6b-84be-fa663c82257f service nova] Lock "f32d5f5d-fbf0-40f5-b078-4e46e70a10f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:16 user nova-compute[75378]: DEBUG nova.compute.manager [req-48ea1471-aa14-4a4c-b286-96642f65a9b9 req-18e6cb5e-513b-4d6b-84be-fa663c82257f service nova] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] No waiting events found dispatching network-vif-plugged-97735033-b177-4d66-88eb-30423baf3a2f {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:43:16 user nova-compute[75378]: WARNING nova.compute.manager [req-48ea1471-aa14-4a4c-b286-96642f65a9b9 req-18e6cb5e-513b-4d6b-84be-fa663c82257f service nova] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Received unexpected event network-vif-plugged-97735033-b177-4d66-88eb-30423baf3a2f for instance with vm_state building and task_state spawning.
Nov 09 03:43:16 user nova-compute[75378]: DEBUG nova.compute.manager [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:43:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:43:16 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Instance spawned successfully.
Nov 09 03:43:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:43:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:43:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:43:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:43:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:43:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:43:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:43:16 user nova-compute[75378]: INFO nova.compute.manager [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Took 7.11 seconds to spawn the instance on the hypervisor.
Nov 09 03:43:16 user nova-compute[75378]: DEBUG nova.compute.manager [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:43:16 user nova-compute[75378]: INFO nova.compute.manager [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Took 8.20 seconds to build instance.
Nov 09 03:43:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-54f11a83-b509-4a55-ae39-b94b5b6e3759 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Lock "f32d5f5d-fbf0-40f5-b078-4e46e70a10f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.333s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:20 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:43:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:21 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fadeb1f5-4118-4a08-986a-ff08778b229d is timed out.
Nov 09 03:43:21 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Successfully detached device vdb from instance fadeb1f5-4118-4a08-986a-ff08778b229d from the live domain config.
Nov 09 03:43:21 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgJPXVKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:43:21 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:43:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[054b33e9-52f6-4804-9bb5-ffde101ec465]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:43:21 user nova-compute[75378]: No targets found.
Nov 09 03:43:21 user nova-compute[75378]: iSNS:
Nov 09 03:43:21 user nova-compute[75378]: No targets found.
Nov 09 03:43:21 user nova-compute[75378]: STATIC:
Nov 09 03:43:21 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac
Nov 09 03:43:21 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:43:21 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:43:21 user nova-compute[75378]: FIRMWARE:
Nov 09 03:43:21 user nova-compute[75378]: No targets found.
Nov 09 03:43:21 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:43:21 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:43:21 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2dc61b-acbc-44df-8e6b-aa3915c6e430]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[294e9001-02ce-4a9f-aa45-ff5512017ebd]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:43:21 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac (non-flash)
Nov 09 03:43:21 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c7b7130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac'): ({'sde'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Removing single pathed devices sde {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e31b9f-1788-4e13-9d0d-3e9d0cfa358a]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cbb6f0-031b-4958-a14b-918de4db9f91]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Flushing IO for device /dev/sde {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02d56ec-d88e-488b-bff6-f596560fd791]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0863ca-9262-4620-ae71-cf5aea35e666]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] SCSI volumes sde have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a7a2d5-5360-4ecc-befe-1e14de8753a5]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:21 user nova-compute[75378]: INFO nova.compute.manager [None req-b14adb21-e658-4d6c-9dcd-22cb6c7b2698 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Unrescuing
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b14adb21-e658-4d6c-9dcd-22cb6c7b2698 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "refresh_cache-c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b14adb21-e658-4d6c-9dcd-22cb6c7b2698 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquired lock "refresh_cache-c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG nova.network.neutron [None req-b14adb21-e658-4d6c-9dcd-22cb6c7b2698 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4811f845-0d31-4b20-b914-610ea15aa546]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac, portal: 172.16.0.220,3260]
Nov 09 03:43:21 user nova-compute[75378]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac, portal: 172.16.0.220,3260] successful.
Nov 09 03:43:21 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf663092-5cd7-48cd-9ecd-06653f9ff5ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73a2adf-2de4-41d2-b150-50431093f86a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] <== disconnect_volume: return (312ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG nova.network.neutron [None req-b14adb21-e658-4d6c-9dcd-22cb6c7b2698 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Updating instance_info_cache with network_info: [{"id": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "address": "fa:16:3e:a6:f3:49", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d42515-fd", "ovs_interfaceid": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b14adb21-e658-4d6c-9dcd-22cb6c7b2698 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Releasing lock "refresh_cache-c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG nova.objects.instance [None req-b14adb21-e658-4d6c-9dcd-22cb6c7b2698 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'flavor' on Instance uuid c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Starting finish_revert_migration {{(pid=75378) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.compute.manager [req-31a97aa0-b004-447f-bcc1-92fc003e8050 req-4fd5abeb-3c88-4ea6-97dc-f18036aedc34 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received event network-vif-unplugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-31a97aa0-b004-447f-bcc1-92fc003e8050 req-4fd5abeb-3c88-4ea6-97dc-f18036aedc34 service nova] Acquiring lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-31a97aa0-b004-447f-bcc1-92fc003e8050 req-4fd5abeb-3c88-4ea6-97dc-f18036aedc34 service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-31a97aa0-b004-447f-bcc1-92fc003e8050 req-4fd5abeb-3c88-4ea6-97dc-f18036aedc34 service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.compute.manager [req-31a97aa0-b004-447f-bcc1-92fc003e8050 req-4fd5abeb-3c88-4ea6-97dc-f18036aedc34 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] No waiting events found dispatching network-vif-unplugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:43:22 user nova-compute[75378]: WARNING nova.compute.manager [req-31a97aa0-b004-447f-bcc1-92fc003e8050 req-4fd5abeb-3c88-4ea6-97dc-f18036aedc34 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received unexpected event network-vif-unplugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a for instance with vm_state rescued and task_state unrescuing.
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Start _get_guest_xml network_info=[{"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etYnaShu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2f475dba-59f5-414a-8156-8b438601ecfd', 'attached_at': '2023-11-09T03:43:22.000000', 'detached_at': '', 'volume_id': '93b2608a-e6b8-4844-820c-71f0cd80f3be', 'serial': '93b2608a-e6b8-4844-820c-71f0cd80f3be'}, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'attachment_id': '4a4c0210-b8d7-4b49-a3a9-c4499719834a', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:43:22 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:43:22 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.objects.instance [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2f475dba-59f5-414a-8156-8b438601ecfd {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etYnaShu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:43:22 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:43:22 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:43:22 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:43:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9138af-eb68-45ed-8368-cfc581de65b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:43:22 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb5c7ac-a006-42d9-ad61-019af0194ff5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be] added
Nov 09 03:43:22 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ee5540-ba89-44d7-897a-7fa01673bfd0]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f97d077-d977-4d80-a94c-6c3f377896ec]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etYnaShu {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etYnaShu" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce56abf6-64f3-4eb5-ac70-31d1eca4da16]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'etYnaShu'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f04d76-11d3-4595-8104-123ba01889e8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0562fdc-e26d-4c54-978d-74225da1b287]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 03:43:22 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 03:43:22 user nova-compute[75378]:  {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:43:22 user nova-compute[75378]: WARNING os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 03:43:22 user nova-compute[75378]: 
Nov 09 03:43:22 user nova-compute[75378]: DEBUG nova.objects.instance [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lazy-loading 'flavor' on Instance uuid fadeb1f5-4118-4a08-986a-ff08778b229d {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:22 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Instance destroyed successfully.
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-26a33fb2-e026-4e84-9c25-2529762912be tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.246s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3647096e-1ddd-42b8-9843-179bfa4f6dd2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260]
Nov 09 03:43:22 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260] successful.
Nov 09 03:43:22 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bc679c-87ed-4ddd-976f-81d059bbcc16]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[40090212-eb7e-499b-ba64-db4a9444bf2c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:43:22 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:43:22 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3293f8db-12ba-4109-9a5d-879c5e50bf2e]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:43:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etYnaShu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23733653230393733', 'path': '/dev/sdb'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733653230393733', 'path': '/dev/sdb'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1138780210',display_name='tempest-ServerActionsTestOtherB-server-1138780210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1138780210',id=4,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+s7M8RwDJb3loYxaUJGVxjbTQ9aVX7ngKf1RZUNQALVC7bsteyYsWXKwZsj2SvyMQBcJEfxsQ8l4Bn0IQtqoWxZ715fiA5I3KyJRgBFHf7jRe97Ql+ZXV7Ej5ZLqWSCg==',key_name='tempest-keypair-904427918',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:41:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cb0bda222cd54a44bd26b140d08d8274',ramdisk_id='',reservation_id='r-u0jhm5ex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1007633314',owner_user_name='tempest-ServerActionsTestOtherB-1007633314-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:42:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7bb5d4c95c341beaa22c1bbeacaf4f7',uuid=2f475dba-59f5-414a-8156-8b438601ecfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Converting VIF {"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:9f:69,bridge_name='br-int',has_traffic_filtering=True,id=d0fa9225-bc1d-4d57-b259-5a6d1e3638f8,network=Network(2e704dce-6cba-4cf1-bd3e-d05da48d7839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fa9225-bc') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:43:23 user nova-compute[75378]:   <uuid>2f475dba-59f5-414a-8156-8b438601ecfd</uuid>
Nov 09 03:43:23 user nova-compute[75378]:   <name>instance-00000004</name>
Nov 09 03:43:23 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:43:23 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:43:23 user nova-compute[75378]:   <metadata>
Nov 09 03:43:23 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:43:23 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:43:23 user nova-compute[75378]:       <nova:name>tempest-ServerActionsTestOtherB-server-1138780210</nova:name>
Nov 09 03:43:23 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:43:22</nova:creationTime>
Nov 09 03:43:23 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:43:23 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:43:23 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:43:23 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:43:23 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:43:23 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:43:23 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:43:23 user nova-compute[75378]:       <nova:owner>
Nov 09 03:43:23 user nova-compute[75378]:         <nova:user uuid="e7bb5d4c95c341beaa22c1bbeacaf4f7">tempest-ServerActionsTestOtherB-1007633314-project-member</nova:user>
Nov 09 03:43:23 user nova-compute[75378]:         <nova:project uuid="cb0bda222cd54a44bd26b140d08d8274">tempest-ServerActionsTestOtherB-1007633314</nova:project>
Nov 09 03:43:23 user nova-compute[75378]:       </nova:owner>
Nov 09 03:43:23 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:43:23 user nova-compute[75378]:       <nova:ports>
Nov 09 03:43:23 user nova-compute[75378]:         <nova:port uuid="d0fa9225-bc1d-4d57-b259-5a6d1e3638f8">
Nov 09 03:43:23 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 03:43:23 user nova-compute[75378]:         </nova:port>
Nov 09 03:43:23 user nova-compute[75378]:       </nova:ports>
Nov 09 03:43:23 user nova-compute[75378]:     </nova:instance>
Nov 09 03:43:23 user nova-compute[75378]:   </metadata>
Nov 09 03:43:23 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:43:23 user nova-compute[75378]:     <system>
Nov 09 03:43:23 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:43:23 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:43:23 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:43:23 user nova-compute[75378]:       <entry name="serial">2f475dba-59f5-414a-8156-8b438601ecfd</entry>
Nov 09 03:43:23 user nova-compute[75378]:       <entry name="uuid">2f475dba-59f5-414a-8156-8b438601ecfd</entry>
Nov 09 03:43:23 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:43:23 user nova-compute[75378]:     </system>
Nov 09 03:43:23 user nova-compute[75378]:   </sysinfo>
Nov 09 03:43:23 user nova-compute[75378]:   <os>
Nov 09 03:43:23 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:43:23 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:43:23 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:43:23 user nova-compute[75378]:   </os>
Nov 09 03:43:23 user nova-compute[75378]:   <features>
Nov 09 03:43:23 user nova-compute[75378]:     <acpi/>
Nov 09 03:43:23 user nova-compute[75378]:     <apic/>
Nov 09 03:43:23 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:43:23 user nova-compute[75378]:   </features>
Nov 09 03:43:23 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:43:23 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:43:23 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:43:23 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:43:23 user nova-compute[75378]:   </clock>
Nov 09 03:43:23 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:43:23 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:43:23 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:43:23 user nova-compute[75378]:   </cpu>
Nov 09 03:43:23 user nova-compute[75378]:   <devices>
Nov 09 03:43:23 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:43:23 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:43:23 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk"/>
Nov 09 03:43:23 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:43:23 user nova-compute[75378]:     </disk>
Nov 09 03:43:23 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 03:43:23 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:43:23 user nova-compute[75378]:       <source dev="/dev/sdb"/>
Nov 09 03:43:23 user nova-compute[75378]:       <target dev="vdb" bus="virtio"/>
Nov 09 03:43:23 user nova-compute[75378]:       <serial>93b2608a-e6b8-4844-820c-71f0cd80f3be</serial>
Nov 09 03:43:23 user nova-compute[75378]:     </disk>
Nov 09 03:43:23 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:43:23 user nova-compute[75378]:       <mac address="fa:16:3e:07:9f:69"/>
Nov 09 03:43:23 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:43:23 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:43:23 user nova-compute[75378]:       <target dev="tapd0fa9225-bc"/>
Nov 09 03:43:23 user nova-compute[75378]:     </interface>
Nov 09 03:43:23 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:43:23 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/console.log" append="off"/>
Nov 09 03:43:23 user nova-compute[75378]:     </serial>
Nov 09 03:43:23 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:43:23 user nova-compute[75378]:     <video>
Nov 09 03:43:23 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:43:23 user nova-compute[75378]:     </video>
Nov 09 03:43:23 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:43:23 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:43:23 user nova-compute[75378]:     </rng>
Nov 09 03:43:23 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:43:23 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:43:23 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:43:23 user nova-compute[75378]:     </memballoon>
Nov 09 03:43:23 user nova-compute[75378]:   </devices>
Nov 09 03:43:23 user nova-compute[75378]: </domain>
Nov 09 03:43:23 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1138780210',display_name='tempest-ServerActionsTestOtherB-server-1138780210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1138780210',id=4,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+s7M8RwDJb3loYxaUJGVxjbTQ9aVX7ngKf1RZUNQALVC7bsteyYsWXKwZsj2SvyMQBcJEfxsQ8l4Bn0IQtqoWxZ715fiA5I3KyJRgBFHf7jRe97Ql+ZXV7Ej5ZLqWSCg==',key_name='tempest-keypair-904427918',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:41:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cb0bda222cd54a44bd26b140d08d8274',ramdisk_id='',reservation_id='r-u0jhm5ex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1007633314',owner_user_name='tempest-ServerActionsTestOtherB-1007633314-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:42:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7bb5d4c95c341beaa22c1bbeacaf4f7',uuid=2f475dba-59f5-414a-8156-8b438601ecfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Converting VIF {"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:9f:69,bridge_name='br-int',has_traffic_filtering=True,id=d0fa9225-bc1d-4d57-b259-5a6d1e3638f8,network=Network(2e704dce-6cba-4cf1-bd3e-d05da48d7839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fa9225-bc') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG os_vif [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:9f:69,bridge_name='br-int',has_traffic_filtering=True,id=d0fa9225-bc1d-4d57-b259-5a6d1e3638f8,network=Network(2e704dce-6cba-4cf1-bd3e-d05da48d7839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fa9225-bc') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8cc8b611-6ed6-5dff-86ef-69553918d72c', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0fa9225-bc, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0fa9225-bc, col_values=(('qos', UUID('bf288b06-fd81-4e4a-95f9-e001bfbbf4e3')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0fa9225-bc, col_values=(('external_ids', {'iface-id': 'd0fa9225-bc1d-4d57-b259-5a6d1e3638f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:9f:69', 'vm-uuid': '2f475dba-59f5-414a-8156-8b438601ecfd'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:23 user nova-compute[75378]: INFO os_vif [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:9f:69,bridge_name='br-int',has_traffic_filtering=True,id=d0fa9225-bc1d-4d57-b259-5a6d1e3638f8,network=Network(2e704dce-6cba-4cf1-bd3e-d05da48d7839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fa9225-bc')
Nov 09 03:43:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:24 user nova-compute[75378]: DEBUG nova.compute.manager [req-7e9586ce-d7ea-4a82-a2fb-6f958520e004 req-a749fad8-7394-4e1a-bd08-f22b7816283e service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received event network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:43:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7e9586ce-d7ea-4a82-a2fb-6f958520e004 req-a749fad8-7394-4e1a-bd08-f22b7816283e service nova] Acquiring lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7e9586ce-d7ea-4a82-a2fb-6f958520e004 req-a749fad8-7394-4e1a-bd08-f22b7816283e service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7e9586ce-d7ea-4a82-a2fb-6f958520e004 req-a749fad8-7394-4e1a-bd08-f22b7816283e service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:24 user nova-compute[75378]: DEBUG nova.compute.manager [req-7e9586ce-d7ea-4a82-a2fb-6f958520e004 req-a749fad8-7394-4e1a-bd08-f22b7816283e service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] No waiting events found dispatching network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:43:24 user nova-compute[75378]: WARNING nova.compute.manager [req-7e9586ce-d7ea-4a82-a2fb-6f958520e004 req-a749fad8-7394-4e1a-bd08-f22b7816283e service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received unexpected event network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a for instance with vm_state rescued and task_state unrescuing.
Nov 09 03:43:24 user nova-compute[75378]: DEBUG nova.compute.manager [req-7e9586ce-d7ea-4a82-a2fb-6f958520e004 req-a749fad8-7394-4e1a-bd08-f22b7816283e service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received event network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:43:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7e9586ce-d7ea-4a82-a2fb-6f958520e004 req-a749fad8-7394-4e1a-bd08-f22b7816283e service nova] Acquiring lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7e9586ce-d7ea-4a82-a2fb-6f958520e004 req-a749fad8-7394-4e1a-bd08-f22b7816283e service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7e9586ce-d7ea-4a82-a2fb-6f958520e004 req-a749fad8-7394-4e1a-bd08-f22b7816283e service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:24 user nova-compute[75378]: DEBUG nova.compute.manager [req-7e9586ce-d7ea-4a82-a2fb-6f958520e004 req-a749fad8-7394-4e1a-bd08-f22b7816283e service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] No waiting events found dispatching network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:43:24 user nova-compute[75378]: WARNING nova.compute.manager [req-7e9586ce-d7ea-4a82-a2fb-6f958520e004 req-a749fad8-7394-4e1a-bd08-f22b7816283e service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received unexpected event network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a for instance with vm_state rescued and task_state unrescuing.
Nov 09 03:43:25 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:43:25 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:43:25 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Rebuilding the list of instances to heal {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 03:43:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-9691c96a-287e-40f0-a7e2-70bd56d9d2d3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:43:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-9691c96a-287e-40f0-a7e2-70bd56d9d2d3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:43:25 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 03:43:25 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lazy-loading 'info_cache' on Instance uuid 9691c96a-287e-40f0-a7e2-70bd56d9d2d3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:43:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:25 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Updating instance_info_cache with network_info: [{"id": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "address": "fa:16:3e:cb:7d:a8", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f2f1d8-31", "ovs_interfaceid": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:43:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-9691c96a-287e-40f0-a7e2-70bd56d9d2d3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:43:25 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 03:43:25 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:43:26 user nova-compute[75378]: DEBUG nova.compute.manager [req-824d1448-8c57-4997-a383-facf3caa5481 req-27276a95-f6bb-4404-aa29-f205a915b74c service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:43:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-824d1448-8c57-4997-a383-facf3caa5481 req-27276a95-f6bb-4404-aa29-f205a915b74c service nova] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-824d1448-8c57-4997-a383-facf3caa5481 req-27276a95-f6bb-4404-aa29-f205a915b74c service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-824d1448-8c57-4997-a383-facf3caa5481 req-27276a95-f6bb-4404-aa29-f205a915b74c service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:26 user nova-compute[75378]: DEBUG nova.compute.manager [req-824d1448-8c57-4997-a383-facf3caa5481 req-27276a95-f6bb-4404-aa29-f205a915b74c service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] No waiting events found dispatching network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:43:26 user nova-compute[75378]: WARNING nova.compute.manager [req-824d1448-8c57-4997-a383-facf3caa5481 req-27276a95-f6bb-4404-aa29-f205a915b74c service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received unexpected event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 for instance with vm_state resized and task_state resize_reverting.
Nov 09 03:43:26 user nova-compute[75378]: DEBUG nova.compute.manager [req-d5cab897-1b46-4927-b2bf-9d8dc00b4dcb req-038b45d8-4b9b-46eb-bc48-a5ca8a890801 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received event network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:43:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d5cab897-1b46-4927-b2bf-9d8dc00b4dcb req-038b45d8-4b9b-46eb-bc48-a5ca8a890801 service nova] Acquiring lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d5cab897-1b46-4927-b2bf-9d8dc00b4dcb req-038b45d8-4b9b-46eb-bc48-a5ca8a890801 service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d5cab897-1b46-4927-b2bf-9d8dc00b4dcb req-038b45d8-4b9b-46eb-bc48-a5ca8a890801 service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:26 user nova-compute[75378]: DEBUG nova.compute.manager [req-d5cab897-1b46-4927-b2bf-9d8dc00b4dcb req-038b45d8-4b9b-46eb-bc48-a5ca8a890801 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] No waiting events found dispatching network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:43:26 user nova-compute[75378]: WARNING nova.compute.manager [req-d5cab897-1b46-4927-b2bf-9d8dc00b4dcb req-038b45d8-4b9b-46eb-bc48-a5ca8a890801 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received unexpected event network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a for instance with vm_state rescued and task_state unrescuing.
Nov 09 03:43:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:27 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:43:27 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:43:27 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b14adb21-e658-4d6c-9dcd-22cb6c7b2698 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:43:28 user nova-compute[75378]: DEBUG nova.compute.manager [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:43:28 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Instance running successfully.
Nov 09 03:43:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] finish_revert_migration finished successfully. {{(pid=75378) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 09 03:43:28 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:43:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:28 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:43:28 user nova-compute[75378]: DEBUG nova.compute.manager [req-51b303f6-23bc-442c-b34d-5e6e2ea6d298 req-c011cc5f-10ff-4dc5-901c-aa5282b74c95 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:43:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-51b303f6-23bc-442c-b34d-5e6e2ea6d298 req-c011cc5f-10ff-4dc5-901c-aa5282b74c95 service nova] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-51b303f6-23bc-442c-b34d-5e6e2ea6d298 req-c011cc5f-10ff-4dc5-901c-aa5282b74c95 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-51b303f6-23bc-442c-b34d-5e6e2ea6d298 req-c011cc5f-10ff-4dc5-901c-aa5282b74c95 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:28 user nova-compute[75378]: DEBUG nova.compute.manager [req-51b303f6-23bc-442c-b34d-5e6e2ea6d298 req-c011cc5f-10ff-4dc5-901c-aa5282b74c95 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] No waiting events found dispatching network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:43:28 user nova-compute[75378]: WARNING nova.compute.manager [req-51b303f6-23bc-442c-b34d-5e6e2ea6d298 req-c011cc5f-10ff-4dc5-901c-aa5282b74c95 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received unexpected event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 for instance with vm_state resized and task_state resize_reverting.
Nov 09 03:43:28 user nova-compute[75378]: INFO nova.compute.manager [None req-482281cf-e0d6-4c58-883f-a5eebe7e9c11 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Updating instance to original state: 'active'
Nov 09 03:43:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:43:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:33 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:43:33 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:43:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7679MB free_disk=25.58359146118164GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:43:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9691c96a-287e-40f0-a7e2-70bd56d9d2d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:43:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:43:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:43:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 70a7686e-042c-4be8-8182-69c62027c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:43:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance fadeb1f5-4118-4a08-986a-ff08778b229d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:43:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2f475dba-59f5-414a-8156-8b438601ecfd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:43:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 657ae9e7-1a0b-4a29-acd9-5441c75f5920 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:43:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7d051405-6b57-4db2-9533-c2f4e87134d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:43:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance f32d5f5d-fbf0-40f5-b078-4e46e70a10f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:43:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:43:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:43:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:33 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:43:33 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:43:34 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:43:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.550s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Acquiring lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:43 user nova-compute[75378]: DEBUG nova.objects.instance [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lazy-loading 'flavor' on Instance uuid 657ae9e7-1a0b-4a29-acd9-5441c75f5920 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:43:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Acquiring lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:43 user nova-compute[75378]: INFO nova.compute.manager [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Attaching volume ff8839c6-d249-47ac-8999-b0eb45112fc3 to /dev/vdb
Nov 09 03:43:43 user nova-compute[75378]: DEBUG os_brick.utils [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:43:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d67b55-2813-483c-8ab8-948a53ac6270]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a174ae-e6cd-41ed-9f59-ac7cf39b66fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:43:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba64b17b-4bfa-4966-a668-ecf8dcadf9a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c79a25-7d07-44c7-b96a-52513e02d512]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:43:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:43:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:43:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:43:44 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:43:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f10acb-8c27-4d60-8ed3-3f0f6dca0798]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:43:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:43:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:43:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:43:44 user nova-compute[75378]: DEBUG os_brick.utils [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:43:44 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Updating existing volume attachment record: dd7e4bc8-1463-4524-8cda-92bbd5415132 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:43:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Acquiring lock "fadeb1f5-4118-4a08-986a-ff08778b229d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Acquiring lock "fadeb1f5-4118-4a08-986a-ff08778b229d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:50 user nova-compute[75378]: INFO nova.compute.manager [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Terminating instance
Nov 09 03:43:50 user nova-compute[75378]: DEBUG nova.compute.manager [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:43:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:51 user nova-compute[75378]: DEBUG nova.compute.manager [req-0fcbb2a9-a470-46e0-af73-80e14ea940f6 req-cba94177-89fa-4179-88c9-2cd8dd7c1d38 service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Received event network-vif-unplugged-c831c172-1cc7-428a-b240-f6ced441ef2a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:43:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0fcbb2a9-a470-46e0-af73-80e14ea940f6 req-cba94177-89fa-4179-88c9-2cd8dd7c1d38 service nova] Acquiring lock "fadeb1f5-4118-4a08-986a-ff08778b229d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0fcbb2a9-a470-46e0-af73-80e14ea940f6 req-cba94177-89fa-4179-88c9-2cd8dd7c1d38 service nova] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0fcbb2a9-a470-46e0-af73-80e14ea940f6 req-cba94177-89fa-4179-88c9-2cd8dd7c1d38 service nova] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:51 user nova-compute[75378]: DEBUG nova.compute.manager [req-0fcbb2a9-a470-46e0-af73-80e14ea940f6 req-cba94177-89fa-4179-88c9-2cd8dd7c1d38 service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] No waiting events found dispatching network-vif-unplugged-c831c172-1cc7-428a-b240-f6ced441ef2a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:43:51 user nova-compute[75378]: DEBUG nova.compute.manager [req-0fcbb2a9-a470-46e0-af73-80e14ea940f6 req-cba94177-89fa-4179-88c9-2cd8dd7c1d38 service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Received event network-vif-unplugged-c831c172-1cc7-428a-b240-f6ced441ef2a for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:43:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:51 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Instance destroyed successfully.
Nov 09 03:43:51 user nova-compute[75378]: DEBUG nova.objects.instance [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lazy-loading 'resources' on Instance uuid fadeb1f5-4118-4a08-986a-ff08778b229d {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:43:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:37:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1582652175',display_name='tempest-TestVolumeSwap-server-1582652175',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1582652175',id=8,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyk9T16GFQ+y1h0pOF5Hrm3d7RD92EOy4TdU1mHmhgFKtaR27JmR/D69MWt8+fDMBahxH+u3ZN9qNjPU5RYIoSG14WkbOQ4znhP3S/IGfvqhP5i3qDYDpXEkvPXxUlcRQ==',key_name='tempest-keypair-1553599307',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:37:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5d1f59e34b145bab300bb75cc1b7e2a',ramdisk_id='',reservation_id='r-5md8dbes',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-50463933',owner_user_name='tempest-TestVolumeSwap-50463933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:37:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ddb493bc62a46ab9d2fe559eb2587f2',uuid=fadeb1f5-4118-4a08-986a-ff08778b229d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c831c172-1cc7-428a-b240-f6ced441ef2a", "address": "fa:16:3e:3a:19:8c", "network": {"id": "7cae065f-736a-43fe-a505-62054a7c5af3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-265578846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5d1f59e34b145bab300bb75cc1b7e2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831c172-1c", "ovs_interfaceid": "c831c172-1cc7-428a-b240-f6ced441ef2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:43:51 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Converting VIF {"id": "c831c172-1cc7-428a-b240-f6ced441ef2a", "address": "fa:16:3e:3a:19:8c", "network": {"id": "7cae065f-736a-43fe-a505-62054a7c5af3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-265578846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5d1f59e34b145bab300bb75cc1b7e2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831c172-1c", "ovs_interfaceid": "c831c172-1cc7-428a-b240-f6ced441ef2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:43:51 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=c831c172-1cc7-428a-b240-f6ced441ef2a,network=Network(7cae065f-736a-43fe-a505-62054a7c5af3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc831c172-1c') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:43:51 user nova-compute[75378]: DEBUG os_vif [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=c831c172-1cc7-428a-b240-f6ced441ef2a,network=Network(7cae065f-736a-43fe-a505-62054a7c5af3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc831c172-1c') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:43:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc831c172-1c, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:43:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:43:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f3625bf-1ee6-47af-af8d-50b04b99ca20) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:43:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:43:51 user nova-compute[75378]: INFO os_vif [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:19:8c,bridge_name='br-int',has_traffic_filtering=True,id=c831c172-1cc7-428a-b240-f6ced441ef2a,network=Network(7cae065f-736a-43fe-a505-62054a7c5af3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc831c172-1c')
Nov 09 03:43:51 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Deleting instance files /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d_del
Nov 09 03:43:51 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Deletion of /opt/stack/data/nova/instances/fadeb1f5-4118-4a08-986a-ff08778b229d_del complete
Nov 09 03:43:51 user nova-compute[75378]: INFO nova.compute.manager [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 09 03:43:51 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:43:51 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:43:51 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:43:52 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:43:52 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Took 0.99 seconds to deallocate network for instance.
Nov 09 03:43:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-50805304-2a14-4c0d-ad88-9ccaeb5cdc46 req-e734e93e-cff5-491c-acd2-c5898f53d159 service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Received event network-vif-plugged-c831c172-1cc7-428a-b240-f6ced441ef2a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:43:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-50805304-2a14-4c0d-ad88-9ccaeb5cdc46 req-e734e93e-cff5-491c-acd2-c5898f53d159 service nova] Acquiring lock "fadeb1f5-4118-4a08-986a-ff08778b229d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:43:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-50805304-2a14-4c0d-ad88-9ccaeb5cdc46 req-e734e93e-cff5-491c-acd2-c5898f53d159 service nova] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:43:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-50805304-2a14-4c0d-ad88-9ccaeb5cdc46 req-e734e93e-cff5-491c-acd2-c5898f53d159 service nova] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-50805304-2a14-4c0d-ad88-9ccaeb5cdc46 req-e734e93e-cff5-491c-acd2-c5898f53d159 service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] No waiting events found dispatching network-vif-plugged-c831c172-1cc7-428a-b240-f6ced441ef2a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:43:53 user nova-compute[75378]: WARNING nova.compute.manager [req-50805304-2a14-4c0d-ad88-9ccaeb5cdc46 req-e734e93e-cff5-491c-acd2-c5898f53d159 service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Received unexpected event network-vif-plugged-c831c172-1cc7-428a-b240-f6ced441ef2a for instance with vm_state deleted and task_state None.
Nov 09 03:43:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-50805304-2a14-4c0d-ad88-9ccaeb5cdc46 req-e734e93e-cff5-491c-acd2-c5898f53d159 service nova] [instance: fadeb1f5-4118-4a08-986a-ff08778b229d] Received event network-vif-deleted-c831c172-1cc7-428a-b240-f6ced441ef2a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:43:53 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:43:53 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:43:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:53 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Deleted allocations for instance fadeb1f5-4118-4a08-986a-ff08778b229d
Nov 09 03:43:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-12bb8f09-ca52-49b3-a02a-7e82a48b4bca tempest-TestVolumeSwap-50463933 tempest-TestVolumeSwap-50463933-project-member] Lock "fadeb1f5-4118-4a08-986a-ff08778b229d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.667s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:43:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:43:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:44:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 03:44:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:44:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:44:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "70a7686e-042c-4be8-8182-69c62027c744" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "70a7686e-042c-4be8-8182-69c62027c744" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "70a7686e-042c-4be8-8182-69c62027c744-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "70a7686e-042c-4be8-8182-69c62027c744-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "70a7686e-042c-4be8-8182-69c62027c744-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:44:07 user nova-compute[75378]: INFO nova.compute.manager [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Terminating instance
Nov 09 03:44:07 user nova-compute[75378]: DEBUG nova.compute.manager [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-2d845518-0b48-45f8-bf2e-74c6ab3bd8e2 req-572a3568-6761-4e32-ae0c-4f447886b297 service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Received event network-vif-unplugged-cf0655e0-c321-449f-840d-89a729a9b6ad {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2d845518-0b48-45f8-bf2e-74c6ab3bd8e2 req-572a3568-6761-4e32-ae0c-4f447886b297 service nova] Acquiring lock "70a7686e-042c-4be8-8182-69c62027c744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2d845518-0b48-45f8-bf2e-74c6ab3bd8e2 req-572a3568-6761-4e32-ae0c-4f447886b297 service nova] Lock "70a7686e-042c-4be8-8182-69c62027c744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2d845518-0b48-45f8-bf2e-74c6ab3bd8e2 req-572a3568-6761-4e32-ae0c-4f447886b297 service nova] Lock "70a7686e-042c-4be8-8182-69c62027c744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-2d845518-0b48-45f8-bf2e-74c6ab3bd8e2 req-572a3568-6761-4e32-ae0c-4f447886b297 service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] No waiting events found dispatching network-vif-unplugged-cf0655e0-c321-449f-840d-89a729a9b6ad {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-2d845518-0b48-45f8-bf2e-74c6ab3bd8e2 req-572a3568-6761-4e32-ae0c-4f447886b297 service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Received event network-vif-unplugged-cf0655e0-c321-449f-840d-89a729a9b6ad for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:44:07 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Instance destroyed successfully.
Nov 09 03:44:07 user nova-compute[75378]: DEBUG nova.objects.instance [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lazy-loading 'resources' on Instance uuid 70a7686e-042c-4be8-8182-69c62027c744 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-963914825',display_name='tempest-VolumesAdminNegativeTest-server-963914825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-963914825',id=5,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFVKMfES28A1ktyCRMO/alXBA9IHBbiyikWP72jDo2vFeGgQ5s59bvsdgB9vblPSmeQ1SFmCP/V0ank19sERARincGjeHiKIeClQ1JKZdAPb/mQMufvyIemDuOcBpOxzA==',key_name='tempest-keypair-1634317855',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:37:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13e8a43607594d039f7514185feb8e78',ramdisk_id='',reservation_id='r-4u231271',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-980015254',owner_user_name='tempest-VolumesAdminNegativeTest-980015254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:37:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6811290b00b044f1b1a0430f775d512a',uuid=70a7686e-042c-4be8-8182-69c62027c744,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf0655e0-c321-449f-840d-89a729a9b6ad", "address": "fa:16:3e:83:d7:60", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0655e0-c3", "ovs_interfaceid": "cf0655e0-c321-449f-840d-89a729a9b6ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Converting VIF {"id": "cf0655e0-c321-449f-840d-89a729a9b6ad", "address": "fa:16:3e:83:d7:60", "network": {"id": "bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1029086157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13e8a43607594d039f7514185feb8e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0655e0-c3", "ovs_interfaceid": "cf0655e0-c321-449f-840d-89a729a9b6ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=cf0655e0-c321-449f-840d-89a729a9b6ad,network=Network(bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0655e0-c3') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG os_vif [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=cf0655e0-c321-449f-840d-89a729a9b6ad,network=Network(bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0655e0-c3') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf0655e0-c3, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39f79309-3fc7-4bfb-b398-51766c9f66db) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:44:07 user nova-compute[75378]: INFO os_vif [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:d7:60,bridge_name='br-int',has_traffic_filtering=True,id=cf0655e0-c321-449f-840d-89a729a9b6ad,network=Network(bf278cc7-1cc3-4674-9eab-4d8b3a3f47ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0655e0-c3')
Nov 09 03:44:07 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Deleting instance files /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744_del
Nov 09 03:44:07 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Deletion of /opt/stack/data/nova/instances/70a7686e-042c-4be8-8182-69c62027c744_del complete
Nov 09 03:44:08 user nova-compute[75378]: INFO nova.compute.manager [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 09 03:44:08 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:44:08 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:44:08 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 70a7686e-042c-4be8-8182-69c62027c744] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:44:08 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:44:08 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Took 0.97 seconds to deallocate network for instance.
Nov 09 03:44:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-aad5a717-9ca3-42aa-b847-38151866a0aa req-806d7d3b-22f8-4c2b-9283-d80d76989aa4 service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Received event network-vif-deleted-cf0655e0-c321-449f-840d-89a729a9b6ad {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:44:09 user nova-compute[75378]: INFO nova.compute.manager [req-aad5a717-9ca3-42aa-b847-38151866a0aa req-806d7d3b-22f8-4c2b-9283-d80d76989aa4 service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Neutron deleted interface cf0655e0-c321-449f-840d-89a729a9b6ad; detaching it from the instance and deleting it from the info cache
Nov 09 03:44:09 user nova-compute[75378]: DEBUG nova.network.neutron [req-aad5a717-9ca3-42aa-b847-38151866a0aa req-806d7d3b-22f8-4c2b-9283-d80d76989aa4 service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:44:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-aad5a717-9ca3-42aa-b847-38151866a0aa req-806d7d3b-22f8-4c2b-9283-d80d76989aa4 service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Detach interface failed, port_id=cf0655e0-c321-449f-840d-89a729a9b6ad, reason: Instance 70a7686e-042c-4be8-8182-69c62027c744 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 03:44:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:44:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:44:09 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:44:09 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:44:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:44:09 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Deleted allocations for instance 70a7686e-042c-4be8-8182-69c62027c744
Nov 09 03:44:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7163c2bc-9a2a-4dc4-8d47-b8ccf706b32f tempest-VolumesAdminNegativeTest-980015254 tempest-VolumesAdminNegativeTest-980015254-project-member] Lock "70a7686e-042c-4be8-8182-69c62027c744" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.409s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:44:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-6c5ef37a-a41a-44ac-babb-fff547b8fd0f req-933acc1e-4a1a-4e4f-92d3-2145bab73115 service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Received event network-vif-plugged-cf0655e0-c321-449f-840d-89a729a9b6ad {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:44:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6c5ef37a-a41a-44ac-babb-fff547b8fd0f req-933acc1e-4a1a-4e4f-92d3-2145bab73115 service nova] Acquiring lock "70a7686e-042c-4be8-8182-69c62027c744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:44:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6c5ef37a-a41a-44ac-babb-fff547b8fd0f req-933acc1e-4a1a-4e4f-92d3-2145bab73115 service nova] Lock "70a7686e-042c-4be8-8182-69c62027c744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:44:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6c5ef37a-a41a-44ac-babb-fff547b8fd0f req-933acc1e-4a1a-4e4f-92d3-2145bab73115 service nova] Lock "70a7686e-042c-4be8-8182-69c62027c744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:44:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-6c5ef37a-a41a-44ac-babb-fff547b8fd0f req-933acc1e-4a1a-4e4f-92d3-2145bab73115 service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] No waiting events found dispatching network-vif-plugged-cf0655e0-c321-449f-840d-89a729a9b6ad {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:44:09 user nova-compute[75378]: WARNING nova.compute.manager [req-6c5ef37a-a41a-44ac-babb-fff547b8fd0f req-933acc1e-4a1a-4e4f-92d3-2145bab73115 service nova] [instance: 70a7686e-042c-4be8-8182-69c62027c744] Received unexpected event network-vif-plugged-cf0655e0-c321-449f-840d-89a729a9b6ad for instance with vm_state deleted and task_state None.
Nov 09 03:44:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:14 user nova-compute[75378]: DEBUG nova.compute.manager [None req-67de4883-2a05-4765-b911-67afacaaf015 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:44:14 user nova-compute[75378]: INFO nova.compute.manager [None req-67de4883-2a05-4765-b911-67afacaaf015 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] instance snapshotting
Nov 09 03:44:14 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-67de4883-2a05-4765-b911-67afacaaf015 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Beginning live snapshot process
Nov 09 03:44:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-67de4883-2a05-4765-b911-67afacaaf015 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json -f qcow2 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-67de4883-2a05-4765-b911-67afacaaf015 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-67de4883-2a05-4765-b911-67afacaaf015 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json -f qcow2 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-67de4883-2a05-4765-b911-67afacaaf015 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-67de4883-2a05-4765-b911-67afacaaf015 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-67de4883-2a05-4765-b911-67afacaaf015 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.206s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-67de4883-2a05-4765-b911-67afacaaf015 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcbpo6e4p/1426d3c940254d008a5f174bb3234b50.delta 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-67de4883-2a05-4765-b911-67afacaaf015 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcbpo6e4p/1426d3c940254d008a5f174bb3234b50.delta 1073741824" returned: 0 in 0.061s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:15 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-67de4883-2a05-4765-b911-67afacaaf015 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 09 03:44:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-67de4883-2a05-4765-b911-67afacaaf015 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75378) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 03:44:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-67de4883-2a05-4765-b911-67afacaaf015 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75378) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 03:44:16 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-67de4883-2a05-4765-b911-67afacaaf015 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 09 03:44:16 user nova-compute[75378]: DEBUG nova.privsep.utils [None req-67de4883-2a05-4765-b911-67afacaaf015 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75378) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 03:44:16 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-67de4883-2a05-4765-b911-67afacaaf015 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcbpo6e4p/1426d3c940254d008a5f174bb3234b50.delta /opt/stack/data/nova/instances/snapshots/tmpcbpo6e4p/1426d3c940254d008a5f174bb3234b50 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-67de4883-2a05-4765-b911-67afacaaf015 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcbpo6e4p/1426d3c940254d008a5f174bb3234b50.delta /opt/stack/data/nova/instances/snapshots/tmpcbpo6e4p/1426d3c940254d008a5f174bb3234b50" returned: 0 in 0.522s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:17 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-67de4883-2a05-4765-b911-67afacaaf015 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Snapshot extracted, beginning image upload
Nov 09 03:44:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:44:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 03:44:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:44:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:44:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:20 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-67de4883-2a05-4765-b911-67afacaaf015 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Snapshot image upload complete
Nov 09 03:44:20 user nova-compute[75378]: INFO nova.compute.manager [None req-67de4883-2a05-4765-b911-67afacaaf015 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Took 6.11 seconds to snapshot the instance on the hypervisor.
Nov 09 03:44:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMYwSVDe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:44:25 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:44:25 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:44:25 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c64188-fa73-4e20-9e18-83b07064549d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:44:25 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19ec14b-cbb4-44c5-ba31-984c987be1fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3] added
Nov 09 03:44:25 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e35849-5e2c-42a1-bf26-66c0d2228f44]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[87896644-b673-46a6-a95a-e4ff09086d88]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XMYwSVDe {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XMYwSVDe" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27872a5-a87c-4511-96fb-e0e02afd9400]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XMYwSVDe'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8299e84-02fc-4ae5-b1fc-f968d8351b50]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d91618-969b-4802-866d-1c6dc74165a8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:44:25 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:44:25 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6069dbb-ccf7-48f5-b631-957d30cc1d83]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3, portal: 172.16.0.220,3260]
Nov 09 03:44:25 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3, portal: 172.16.0.220,3260] successful.
Nov 09 03:44:25 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e052e1-e109-49e7-ac21-353b2dcd1b36]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[34eab359-3ce2-4982-85a4-77defa1133b7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:44:25 user nova-compute[75378]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 (non-flash)
Nov 09 03:44:25 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:44:25 user nova-compute[75378]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 (non-flash)
Nov 09 03:44:25 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dfc205-609e-4513-9fdb-ade6fa606db5]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:44:25 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: None {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:44:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:26 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:44:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMYwSVDe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:44:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:44:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23864623265626634', 'path': '/dev/sdc'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:44:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864623265626634', 'path': '/dev/sdc'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:44:26 user nova-compute[75378]: DEBUG nova.objects.instance [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lazy-loading 'flavor' on Instance uuid 657ae9e7-1a0b-4a29-acd9-5441c75f5920 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:44:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 03:44:27 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:44:27 user nova-compute[75378]:   <source dev="/dev/sdc"/>
Nov 09 03:44:27 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:44:27 user nova-compute[75378]:   <serial>ff8839c6-d249-47ac-8999-b0eb45112fc3</serial>
Nov 09 03:44:27 user nova-compute[75378]: </disk>
Nov 09 03:44:27 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 03:44:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:44:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:44:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] No VIF found with MAC fa:16:3e:64:c7:1e, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:44:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-383cbb19-615b-4434-a03f-005564ef1ce2 tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.849s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:44:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:28 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:44:28 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:44:28 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:44:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:44:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:44:28 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 03:44:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Acquiring lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:44:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:44:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Acquiring lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:44:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:44:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:44:28 user nova-compute[75378]: INFO nova.compute.manager [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Terminating instance
Nov 09 03:44:28 user nova-compute[75378]: DEBUG nova.compute.manager [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:44:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:28 user nova-compute[75378]: DEBUG nova.compute.manager [req-96152874-678a-4b4d-a236-027b406370f6 req-85d294a6-eb2c-4539-9b80-0e07ea3cac7e service nova] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Received event network-vif-unplugged-0f303310-c619-4e3d-9fb7-6ab3ce78b215 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:44:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-96152874-678a-4b4d-a236-027b406370f6 req-85d294a6-eb2c-4539-9b80-0e07ea3cac7e service nova] Acquiring lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:44:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-96152874-678a-4b4d-a236-027b406370f6 req-85d294a6-eb2c-4539-9b80-0e07ea3cac7e service nova] Lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:44:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-96152874-678a-4b4d-a236-027b406370f6 req-85d294a6-eb2c-4539-9b80-0e07ea3cac7e service nova] Lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:44:28 user nova-compute[75378]: DEBUG nova.compute.manager [req-96152874-678a-4b4d-a236-027b406370f6 req-85d294a6-eb2c-4539-9b80-0e07ea3cac7e service nova] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] No waiting events found dispatching network-vif-unplugged-0f303310-c619-4e3d-9fb7-6ab3ce78b215 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:44:28 user nova-compute[75378]: DEBUG nova.compute.manager [req-96152874-678a-4b4d-a236-027b406370f6 req-85d294a6-eb2c-4539-9b80-0e07ea3cac7e service nova] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Received event network-vif-unplugged-0f303310-c619-4e3d-9fb7-6ab3ce78b215 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Updating instance_info_cache with network_info: [{"id": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "address": "fa:16:3e:a6:f3:49", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d42515-fd", "ovs_interfaceid": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:44:29 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Instance destroyed successfully.
Nov 09 03:44:29 user nova-compute[75378]: DEBUG nova.objects.instance [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lazy-loading 'resources' on Instance uuid 657ae9e7-1a0b-4a29-acd9-5441c75f5920 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:41:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-737747011',display_name='tempest-DeleteServersTestJSON-server-737747011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-737747011',id=14,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:41:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd9111e384d84382b3aa615c3a10562c',ramdisk_id='',reservation_id='r-msmdw27s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-655269266',owner_user_name='tempest-DeleteServersTestJSON-655269266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:41:55Z,user_data=None,user_id='eebf755b949142df87418824c373513a',uuid=657ae9e7-1a0b-4a29-acd9-5441c75f5920,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f303310-c619-4e3d-9fb7-6ab3ce78b215", "address": "fa:16:3e:64:c7:1e", "network": {"id": "3c26edbc-bd92-4d35-9064-e5efbf5523da", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1203812759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9111e384d84382b3aa615c3a10562c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f303310-c6", "ovs_interfaceid": "0f303310-c619-4e3d-9fb7-6ab3ce78b215", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Converting VIF {"id": "0f303310-c619-4e3d-9fb7-6ab3ce78b215", "address": "fa:16:3e:64:c7:1e", "network": {"id": "3c26edbc-bd92-4d35-9064-e5efbf5523da", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1203812759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd9111e384d84382b3aa615c3a10562c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f303310-c6", "ovs_interfaceid": "0f303310-c619-4e3d-9fb7-6ab3ce78b215", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:c7:1e,bridge_name='br-int',has_traffic_filtering=True,id=0f303310-c619-4e3d-9fb7-6ab3ce78b215,network=Network(3c26edbc-bd92-4d35-9064-e5efbf5523da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f303310-c6') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG os_vif [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:c7:1e,bridge_name='br-int',has_traffic_filtering=True,id=0f303310-c619-4e3d-9fb7-6ab3ce78b215,network=Network(3c26edbc-bd92-4d35-9064-e5efbf5523da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f303310-c6') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f303310-c6, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7a1896b-467f-4323-b4a0-87bc2901d3ca) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:29 user nova-compute[75378]: INFO os_vif [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:c7:1e,bridge_name='br-int',has_traffic_filtering=True,id=0f303310-c619-4e3d-9fb7-6ab3ce78b215,network=Network(3c26edbc-bd92-4d35-9064-e5efbf5523da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f303310-c6')
Nov 09 03:44:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMYwSVDe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:44:29 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:44:29 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd77e1be-94b7-4fdc-8312-b5d8991867f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:44:29 user nova-compute[75378]: No targets found.
Nov 09 03:44:29 user nova-compute[75378]: iSNS:
Nov 09 03:44:29 user nova-compute[75378]: No targets found.
Nov 09 03:44:29 user nova-compute[75378]: STATIC:
Nov 09 03:44:29 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be
Nov 09 03:44:29 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:44:29 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:44:29 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3
Nov 09 03:44:29 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:44:29 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:44:29 user nova-compute[75378]: FIRMWARE:
Nov 09 03:44:29 user nova-compute[75378]: No targets found.
Nov 09 03:44:29 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:44:29 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:44:29 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff5c80f-55fe-4715-87a7-7c267a3d0dc5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d496bbc-11bb-4c78-a3b2-4a40633d399d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:44:29 user nova-compute[75378]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 (non-flash)
Nov 09 03:44:29 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:44:29 user nova-compute[75378]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 (non-flash)
Nov 09 03:44:29 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c717400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3'): ({'sdc'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Removing single pathed devices sdc {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edb50e4-81ca-4026-9bf6-923accbbe4a9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e865d0-a1e8-417f-a1d5-cb43daa5051a]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Flushing IO for device /dev/sdc {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fcd06e-a258-475f-b2d3-8f8d8ad73c39]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbc89f8-24d9-4225-882a-12afd109185a]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] SCSI volumes sdc have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ffc30d-9e96-483c-905c-78b8a83746c4]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[95de8808-630e-4735-bf3a-de2de817db19]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3, portal: 172.16.0.220,3260]
Nov 09 03:44:29 user nova-compute[75378]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3, portal: 172.16.0.220,3260] successful.
Nov 09 03:44:29 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8839c6-d249-47ac-8999-b0eb45112fc3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[026997e4-51ce-435d-bbb3-7ce549a7b2a7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] <== disconnect_volume: return (362ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:44:29 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Deleting instance files /opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920_del
Nov 09 03:44:29 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Deletion of /opt/stack/data/nova/instances/657ae9e7-1a0b-4a29-acd9-5441c75f5920_del complete
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.247s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:29 user nova-compute[75378]: INFO nova.compute.manager [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Took 1.52 seconds to destroy the instance on the hypervisor.
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:30 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:44:30 user nova-compute[75378]: DEBUG nova.compute.manager [req-2cbef55a-707d-4bc5-84b0-970bd4df4021 req-682aff64-d2f4-49b1-a384-501ddedd9165 service nova] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Received event network-vif-deleted-0f303310-c619-4e3d-9fb7-6ab3ce78b215 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:44:30 user nova-compute[75378]: INFO nova.compute.manager [req-2cbef55a-707d-4bc5-84b0-970bd4df4021 req-682aff64-d2f4-49b1-a384-501ddedd9165 service nova] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Neutron deleted interface 0f303310-c619-4e3d-9fb7-6ab3ce78b215; detaching it from the instance and deleting it from the info cache
Nov 09 03:44:30 user nova-compute[75378]: DEBUG nova.network.neutron [req-2cbef55a-707d-4bc5-84b0-970bd4df4021 req-682aff64-d2f4-49b1-a384-501ddedd9165 service nova] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:44:30 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Took 0.67 seconds to deallocate network for instance.
Nov 09 03:44:30 user nova-compute[75378]: DEBUG nova.compute.manager [req-2cbef55a-707d-4bc5-84b0-970bd4df4021 req-682aff64-d2f4-49b1-a384-501ddedd9165 service nova] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Detach interface failed, port_id=0f303310-c619-4e3d-9fb7-6ab3ce78b215, reason: Instance 657ae9e7-1a0b-4a29-acd9-5441c75f5920 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 03:44:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:30 user nova-compute[75378]: DEBUG nova.compute.manager [req-b9f6f798-886c-439f-bda3-5fadeb1e96e7 req-cd96b9ca-a031-414b-9e5e-ae9266398233 service nova] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Received event network-vif-plugged-0f303310-c619-4e3d-9fb7-6ab3ce78b215 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:44:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b9f6f798-886c-439f-bda3-5fadeb1e96e7 req-cd96b9ca-a031-414b-9e5e-ae9266398233 service nova] Acquiring lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:44:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b9f6f798-886c-439f-bda3-5fadeb1e96e7 req-cd96b9ca-a031-414b-9e5e-ae9266398233 service nova] Lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:44:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b9f6f798-886c-439f-bda3-5fadeb1e96e7 req-cd96b9ca-a031-414b-9e5e-ae9266398233 service nova] Lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:44:30 user nova-compute[75378]: DEBUG nova.compute.manager [req-b9f6f798-886c-439f-bda3-5fadeb1e96e7 req-cd96b9ca-a031-414b-9e5e-ae9266398233 service nova] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] No waiting events found dispatching network-vif-plugged-0f303310-c619-4e3d-9fb7-6ab3ce78b215 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:44:30 user nova-compute[75378]: WARNING nova.compute.manager [req-b9f6f798-886c-439f-bda3-5fadeb1e96e7 req-cd96b9ca-a031-414b-9e5e-ae9266398233 service nova] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Received unexpected event network-vif-plugged-0f303310-c619-4e3d-9fb7-6ab3ce78b215 for instance with vm_state active and task_state deleting.
Nov 09 03:44:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:31 user nova-compute[75378]: INFO nova.compute.manager [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] [instance: 657ae9e7-1a0b-4a29-acd9-5441c75f5920] Took 1.13 seconds to detach 1 volumes for instance.
Nov 09 03:44:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:44:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:44:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:32 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:44:32 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:44:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:44:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:44:32 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Deleted allocations for instance 657ae9e7-1a0b-4a29-acd9-5441c75f5920
Nov 09 03:44:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:44:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:44:32 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Error from libvirt while getting description of instance-0000000e: [Error Code 42] Domain not found: no domain with matching uuid '657ae9e7-1a0b-4a29-acd9-5441c75f5920' (instance-0000000e): libvirt.libvirtError: Domain not found: no domain with matching uuid '657ae9e7-1a0b-4a29-acd9-5441c75f5920' (instance-0000000e)
Nov 09 03:44:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-771e00c7-2767-4a50-9c9f-3eba6ffd65ae tempest-DeleteServersTestJSON-655269266 tempest-DeleteServersTestJSON-655269266-project-member] Lock "657ae9e7-1a0b-4a29-acd9-5441c75f5920" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.006s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:44:32 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:44:32 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:44:32 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7826MB free_disk=25.541606903076172GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:44:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:44:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:44:32 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9691c96a-287e-40f0-a7e2-70bd56d9d2d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:44:32 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:44:32 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:44:32 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2f475dba-59f5-414a-8156-8b438601ecfd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:44:32 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7d051405-6b57-4db2-9533-c2f4e87134d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:44:32 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance f32d5f5d-fbf0-40f5-b078-4e46e70a10f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:44:32 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:44:32 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:44:33 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:44:33 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:44:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:44:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:44:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:39 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:44:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Acquiring lock "f32d5f5d-fbf0-40f5-b078-4e46e70a10f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:44:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Lock "f32d5f5d-fbf0-40f5-b078-4e46e70a10f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:44:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Acquiring lock "f32d5f5d-fbf0-40f5-b078-4e46e70a10f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:44:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Lock "f32d5f5d-fbf0-40f5-b078-4e46e70a10f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:44:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Lock "f32d5f5d-fbf0-40f5-b078-4e46e70a10f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:44:58 user nova-compute[75378]: INFO nova.compute.manager [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Terminating instance
Nov 09 03:44:58 user nova-compute[75378]: DEBUG nova.compute.manager [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:44:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:58 user nova-compute[75378]: DEBUG nova.compute.manager [req-05e304e0-4c1e-445e-94b1-47d49ff0c9d2 req-6fd7e7b2-4538-4cee-8d49-e08218dfcd09 service nova] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Received event network-vif-unplugged-97735033-b177-4d66-88eb-30423baf3a2f {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:44:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-05e304e0-4c1e-445e-94b1-47d49ff0c9d2 req-6fd7e7b2-4538-4cee-8d49-e08218dfcd09 service nova] Acquiring lock "f32d5f5d-fbf0-40f5-b078-4e46e70a10f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:44:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-05e304e0-4c1e-445e-94b1-47d49ff0c9d2 req-6fd7e7b2-4538-4cee-8d49-e08218dfcd09 service nova] Lock "f32d5f5d-fbf0-40f5-b078-4e46e70a10f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:44:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-05e304e0-4c1e-445e-94b1-47d49ff0c9d2 req-6fd7e7b2-4538-4cee-8d49-e08218dfcd09 service nova] Lock "f32d5f5d-fbf0-40f5-b078-4e46e70a10f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:44:58 user nova-compute[75378]: DEBUG nova.compute.manager [req-05e304e0-4c1e-445e-94b1-47d49ff0c9d2 req-6fd7e7b2-4538-4cee-8d49-e08218dfcd09 service nova] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] No waiting events found dispatching network-vif-unplugged-97735033-b177-4d66-88eb-30423baf3a2f {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:44:58 user nova-compute[75378]: DEBUG nova.compute.manager [req-05e304e0-4c1e-445e-94b1-47d49ff0c9d2 req-6fd7e7b2-4538-4cee-8d49-e08218dfcd09 service nova] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Received event network-vif-unplugged-97735033-b177-4d66-88eb-30423baf3a2f for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:44:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:59 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Instance destroyed successfully.
Nov 09 03:44:59 user nova-compute[75378]: DEBUG nova.objects.instance [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Lazy-loading 'resources' on Instance uuid f32d5f5d-fbf0-40f5-b078-4e46e70a10f3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:44:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:43:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1710114101',display_name='tempest-VolumesNegativeTest-instance-1710114101',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1710114101',id=16,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:43:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1de69173c2a9468eb75d26d0b8ac3e0f',ramdisk_id='',reservation_id='r-tgrx50lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1061283593',owner_user_name='tempest-VolumesNegativeTest-1061283593-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:43:16Z,user_data=None,user_id='f39ae7bb55f24fc8a0cf78cc3dd9c7b8',uuid=f32d5f5d-fbf0-40f5-b078-4e46e70a10f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97735033-b177-4d66-88eb-30423baf3a2f", "address": "fa:16:3e:ff:35:30", "network": {"id": "e65a7789-3d5c-4bd7-8d6a-21a0ea7bf146", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "03f5a524b2184dac84ddb8b7c3710417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97735033-b1", "ovs_interfaceid": "97735033-b177-4d66-88eb-30423baf3a2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:44:59 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Converting VIF {"id": "97735033-b177-4d66-88eb-30423baf3a2f", "address": "fa:16:3e:ff:35:30", "network": {"id": "e65a7789-3d5c-4bd7-8d6a-21a0ea7bf146", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "03f5a524b2184dac84ddb8b7c3710417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97735033-b1", "ovs_interfaceid": "97735033-b177-4d66-88eb-30423baf3a2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:44:59 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:35:30,bridge_name='br-int',has_traffic_filtering=True,id=97735033-b177-4d66-88eb-30423baf3a2f,network=Network(e65a7789-3d5c-4bd7-8d6a-21a0ea7bf146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97735033-b1') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:44:59 user nova-compute[75378]: DEBUG os_vif [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:35:30,bridge_name='br-int',has_traffic_filtering=True,id=97735033-b177-4d66-88eb-30423baf3a2f,network=Network(e65a7789-3d5c-4bd7-8d6a-21a0ea7bf146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97735033-b1') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:44:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97735033-b1, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:44:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:44:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1862ec3-681b-4456-bfbd-273185464edf) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:44:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:44:59 user nova-compute[75378]: INFO os_vif [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:35:30,bridge_name='br-int',has_traffic_filtering=True,id=97735033-b177-4d66-88eb-30423baf3a2f,network=Network(e65a7789-3d5c-4bd7-8d6a-21a0ea7bf146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97735033-b1')
Nov 09 03:44:59 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Deleting instance files /opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3_del
Nov 09 03:44:59 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Deletion of /opt/stack/data/nova/instances/f32d5f5d-fbf0-40f5-b078-4e46e70a10f3_del complete
Nov 09 03:44:59 user nova-compute[75378]: INFO nova.compute.manager [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 09 03:44:59 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:44:59 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:44:59 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:44:59 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:44:59 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Took 0.62 seconds to deallocate network for instance.
Nov 09 03:44:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:44:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:00 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:45:00 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:45:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:00 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Deleted allocations for instance f32d5f5d-fbf0-40f5-b078-4e46e70a10f3
Nov 09 03:45:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-87e8f163-ceae-4085-b68e-52528460e066 tempest-VolumesNegativeTest-1061283593 tempest-VolumesNegativeTest-1061283593-project-member] Lock "f32d5f5d-fbf0-40f5-b078-4e46e70a10f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.218s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-9db97f10-e702-45f1-b870-27b00a257d90 req-62dd3385-8316-421a-ad60-d1a50cc263ef service nova] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Received event network-vif-plugged-97735033-b177-4d66-88eb-30423baf3a2f {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9db97f10-e702-45f1-b870-27b00a257d90 req-62dd3385-8316-421a-ad60-d1a50cc263ef service nova] Acquiring lock "f32d5f5d-fbf0-40f5-b078-4e46e70a10f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9db97f10-e702-45f1-b870-27b00a257d90 req-62dd3385-8316-421a-ad60-d1a50cc263ef service nova] Lock "f32d5f5d-fbf0-40f5-b078-4e46e70a10f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9db97f10-e702-45f1-b870-27b00a257d90 req-62dd3385-8316-421a-ad60-d1a50cc263ef service nova] Lock "f32d5f5d-fbf0-40f5-b078-4e46e70a10f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-9db97f10-e702-45f1-b870-27b00a257d90 req-62dd3385-8316-421a-ad60-d1a50cc263ef service nova] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] No waiting events found dispatching network-vif-plugged-97735033-b177-4d66-88eb-30423baf3a2f {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:45:00 user nova-compute[75378]: WARNING nova.compute.manager [req-9db97f10-e702-45f1-b870-27b00a257d90 req-62dd3385-8316-421a-ad60-d1a50cc263ef service nova] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Received unexpected event network-vif-plugged-97735033-b177-4d66-88eb-30423baf3a2f for instance with vm_state deleted and task_state None.
Nov 09 03:45:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-9db97f10-e702-45f1-b870-27b00a257d90 req-62dd3385-8316-421a-ad60-d1a50cc263ef service nova] [instance: f32d5f5d-fbf0-40f5-b078-4e46e70a10f3] Received event network-vif-deleted-97735033-b177-4d66-88eb-30423baf3a2f {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "883490f1-6a9f-4ad6-83c4-44b78e681de6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "883490f1-6a9f-4ad6-83c4-44b78e681de6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:18 user nova-compute[75378]: DEBUG nova.compute.manager [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:45:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:18 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:45:18 user nova-compute[75378]: INFO nova.compute.claims [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Claim successful on node user
Nov 09 03:45:19 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:45:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:19 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:45:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:19 user nova-compute[75378]: DEBUG nova.compute.manager [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:45:19 user nova-compute[75378]: DEBUG nova.compute.manager [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:45:19 user nova-compute[75378]: DEBUG nova.network.neutron [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:45:19 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:45:19 user nova-compute[75378]: DEBUG nova.compute.manager [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:45:19 user nova-compute[75378]: DEBUG nova.policy [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b101389f26a84404b72cfc088ec03869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0151a0736b41f498b591b4d3e1a052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:45:19 user nova-compute[75378]: DEBUG nova.compute.manager [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:45:19 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:45:19 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Creating image(s)
Nov 09 03:45:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "/opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "/opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "/opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.225s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.217s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk 1073741824" returned: 0 in 0.072s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.222s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:20 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Checking if we can resize image /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:45:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:20 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Cannot resize image /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:45:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:45:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Ensure instance console log exists: /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:45:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:20 user nova-compute[75378]: DEBUG nova.network.neutron [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Successfully created port: f0d55e97-a560-4a15-aa75-37045342f477 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.network.neutron [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Successfully updated port: f0d55e97-a560-4a15-aa75-37045342f477 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "refresh_cache-883490f1-6a9f-4ad6-83c4-44b78e681de6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquired lock "refresh_cache-883490f1-6a9f-4ad6-83c4-44b78e681de6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.network.neutron [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.compute.manager [req-b7216863-b936-4994-88b7-4ab5aaf33475 req-31b24ed9-c8e5-4d92-91be-b2dac535a3a6 service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Received event network-changed-f0d55e97-a560-4a15-aa75-37045342f477 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.compute.manager [req-b7216863-b936-4994-88b7-4ab5aaf33475 req-31b24ed9-c8e5-4d92-91be-b2dac535a3a6 service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Refreshing instance network info cache due to event network-changed-f0d55e97-a560-4a15-aa75-37045342f477. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b7216863-b936-4994-88b7-4ab5aaf33475 req-31b24ed9-c8e5-4d92-91be-b2dac535a3a6 service nova] Acquiring lock "refresh_cache-883490f1-6a9f-4ad6-83c4-44b78e681de6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.network.neutron [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.network.neutron [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Updating instance_info_cache with network_info: [{"id": "f0d55e97-a560-4a15-aa75-37045342f477", "address": "fa:16:3e:a8:5c:b5", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d55e97-a5", "ovs_interfaceid": "f0d55e97-a560-4a15-aa75-37045342f477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Releasing lock "refresh_cache-883490f1-6a9f-4ad6-83c4-44b78e681de6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.compute.manager [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Instance network_info: |[{"id": "f0d55e97-a560-4a15-aa75-37045342f477", "address": "fa:16:3e:a8:5c:b5", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d55e97-a5", "ovs_interfaceid": "f0d55e97-a560-4a15-aa75-37045342f477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b7216863-b936-4994-88b7-4ab5aaf33475 req-31b24ed9-c8e5-4d92-91be-b2dac535a3a6 service nova] Acquired lock "refresh_cache-883490f1-6a9f-4ad6-83c4-44b78e681de6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.network.neutron [req-b7216863-b936-4994-88b7-4ab5aaf33475 req-31b24ed9-c8e5-4d92-91be-b2dac535a3a6 service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Refreshing network info cache for port f0d55e97-a560-4a15-aa75-37045342f477 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Start _get_guest_xml network_info=[{"id": "f0d55e97-a560-4a15-aa75-37045342f477", "address": "fa:16:3e:a8:5c:b5", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d55e97-a5", "ovs_interfaceid": "f0d55e97-a560-4a15-aa75-37045342f477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:45:21 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:45:21 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:45:21 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:45:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1824959555',display_name='tempest-AttachVolumeTestJSON-server-1824959555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1824959555',id=17,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtGAYXAeKGus3cYjp/BtsP80c2YAL+cFDvI+t9+ev0DjFg7WkutOGLfGoOBXAZBMXMU88mGZ443Gx2pud2okPjgb/PDeKXnBZMHtpwI0fj7KM2Wf0CXM0dCs3pVL41zDg==',key_name='tempest-keypair-1678206802',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d0151a0736b41f498b591b4d3e1a052',ramdisk_id='',reservation_id='r-v4z7ijia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-93032782',owner_user_name='tempest-AttachVolumeTestJSON-93032782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b101389f26a84404b72cfc088ec03869',uuid=883490f1-6a9f-4ad6-83c4-44b78e681de6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0d55e97-a560-4a15-aa75-37045342f477", "address": "fa:16:3e:a8:5c:b5", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d55e97-a5", "ovs_interfaceid": "f0d55e97-a560-4a15-aa75-37045342f477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Converting VIF {"id": "f0d55e97-a560-4a15-aa75-37045342f477", "address": "fa:16:3e:a8:5c:b5", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d55e97-a5", "ovs_interfaceid": "f0d55e97-a560-4a15-aa75-37045342f477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:5c:b5,bridge_name='br-int',has_traffic_filtering=True,id=f0d55e97-a560-4a15-aa75-37045342f477,network=Network(b40bde43-b1d2-4eb4-938c-55c626640880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0d55e97-a5') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG nova.objects.instance [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lazy-loading 'pci_devices' on Instance uuid 883490f1-6a9f-4ad6-83c4-44b78e681de6 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:45:22 user nova-compute[75378]:   <uuid>883490f1-6a9f-4ad6-83c4-44b78e681de6</uuid>
Nov 09 03:45:22 user nova-compute[75378]:   <name>instance-00000011</name>
Nov 09 03:45:22 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:45:22 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:45:22 user nova-compute[75378]:   <metadata>
Nov 09 03:45:22 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:45:22 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:45:22 user nova-compute[75378]:       <nova:name>tempest-AttachVolumeTestJSON-server-1824959555</nova:name>
Nov 09 03:45:22 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:45:21</nova:creationTime>
Nov 09 03:45:22 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:45:22 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:45:22 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:45:22 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:45:22 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:45:22 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:45:22 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:45:22 user nova-compute[75378]:       <nova:owner>
Nov 09 03:45:22 user nova-compute[75378]:         <nova:user uuid="b101389f26a84404b72cfc088ec03869">tempest-AttachVolumeTestJSON-93032782-project-member</nova:user>
Nov 09 03:45:22 user nova-compute[75378]:         <nova:project uuid="8d0151a0736b41f498b591b4d3e1a052">tempest-AttachVolumeTestJSON-93032782</nova:project>
Nov 09 03:45:22 user nova-compute[75378]:       </nova:owner>
Nov 09 03:45:22 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:45:22 user nova-compute[75378]:       <nova:ports>
Nov 09 03:45:22 user nova-compute[75378]:         <nova:port uuid="f0d55e97-a560-4a15-aa75-37045342f477">
Nov 09 03:45:22 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 03:45:22 user nova-compute[75378]:         </nova:port>
Nov 09 03:45:22 user nova-compute[75378]:       </nova:ports>
Nov 09 03:45:22 user nova-compute[75378]:     </nova:instance>
Nov 09 03:45:22 user nova-compute[75378]:   </metadata>
Nov 09 03:45:22 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:45:22 user nova-compute[75378]:     <system>
Nov 09 03:45:22 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:45:22 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:45:22 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:45:22 user nova-compute[75378]:       <entry name="serial">883490f1-6a9f-4ad6-83c4-44b78e681de6</entry>
Nov 09 03:45:22 user nova-compute[75378]:       <entry name="uuid">883490f1-6a9f-4ad6-83c4-44b78e681de6</entry>
Nov 09 03:45:22 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:45:22 user nova-compute[75378]:     </system>
Nov 09 03:45:22 user nova-compute[75378]:   </sysinfo>
Nov 09 03:45:22 user nova-compute[75378]:   <os>
Nov 09 03:45:22 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:45:22 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:45:22 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:45:22 user nova-compute[75378]:   </os>
Nov 09 03:45:22 user nova-compute[75378]:   <features>
Nov 09 03:45:22 user nova-compute[75378]:     <acpi/>
Nov 09 03:45:22 user nova-compute[75378]:     <apic/>
Nov 09 03:45:22 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:45:22 user nova-compute[75378]:   </features>
Nov 09 03:45:22 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:45:22 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:45:22 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:45:22 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:45:22 user nova-compute[75378]:   </clock>
Nov 09 03:45:22 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:45:22 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:45:22 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:45:22 user nova-compute[75378]:   </cpu>
Nov 09 03:45:22 user nova-compute[75378]:   <devices>
Nov 09 03:45:22 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:45:22 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:45:22 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk"/>
Nov 09 03:45:22 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:45:22 user nova-compute[75378]:     </disk>
Nov 09 03:45:22 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:45:22 user nova-compute[75378]:       <mac address="fa:16:3e:a8:5c:b5"/>
Nov 09 03:45:22 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:45:22 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:45:22 user nova-compute[75378]:       <target dev="tapf0d55e97-a5"/>
Nov 09 03:45:22 user nova-compute[75378]:     </interface>
Nov 09 03:45:22 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:45:22 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/console.log" append="off"/>
Nov 09 03:45:22 user nova-compute[75378]:     </serial>
Nov 09 03:45:22 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:45:22 user nova-compute[75378]:     <video>
Nov 09 03:45:22 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:45:22 user nova-compute[75378]:     </video>
Nov 09 03:45:22 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:45:22 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:45:22 user nova-compute[75378]:     </rng>
Nov 09 03:45:22 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:45:22 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:45:22 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:45:22 user nova-compute[75378]:     </memballoon>
Nov 09 03:45:22 user nova-compute[75378]:   </devices>
Nov 09 03:45:22 user nova-compute[75378]: </domain>
Nov 09 03:45:22 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:45:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1824959555',display_name='tempest-AttachVolumeTestJSON-server-1824959555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1824959555',id=17,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtGAYXAeKGus3cYjp/BtsP80c2YAL+cFDvI+t9+ev0DjFg7WkutOGLfGoOBXAZBMXMU88mGZ443Gx2pud2okPjgb/PDeKXnBZMHtpwI0fj7KM2Wf0CXM0dCs3pVL41zDg==',key_name='tempest-keypair-1678206802',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d0151a0736b41f498b591b4d3e1a052',ramdisk_id='',reservation_id='r-v4z7ijia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-93032782',owner_user_name='tempest-AttachVolumeTestJSON-93032782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b101389f26a84404b72cfc088ec03869',uuid=883490f1-6a9f-4ad6-83c4-44b78e681de6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0d55e97-a560-4a15-aa75-37045342f477", "address": "fa:16:3e:a8:5c:b5", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d55e97-a5", "ovs_interfaceid": "f0d55e97-a560-4a15-aa75-37045342f477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Converting VIF {"id": "f0d55e97-a560-4a15-aa75-37045342f477", "address": "fa:16:3e:a8:5c:b5", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d55e97-a5", "ovs_interfaceid": "f0d55e97-a560-4a15-aa75-37045342f477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:5c:b5,bridge_name='br-int',has_traffic_filtering=True,id=f0d55e97-a560-4a15-aa75-37045342f477,network=Network(b40bde43-b1d2-4eb4-938c-55c626640880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0d55e97-a5') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG os_vif [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:5c:b5,bridge_name='br-int',has_traffic_filtering=True,id=f0d55e97-a560-4a15-aa75-37045342f477,network=Network(b40bde43-b1d2-4eb4-938c-55c626640880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0d55e97-a5') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4aba872-ef13-59b4-9f57-e6ed6de576b9', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0d55e97-a5, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0d55e97-a5, col_values=(('qos', UUID('6d4b7845-887b-4548-87a5-529355821f70')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0d55e97-a5, col_values=(('external_ids', {'iface-id': 'f0d55e97-a560-4a15-aa75-37045342f477', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:5c:b5', 'vm-uuid': '883490f1-6a9f-4ad6-83c4-44b78e681de6'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:22 user nova-compute[75378]: INFO os_vif [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:5c:b5,bridge_name='br-int',has_traffic_filtering=True,id=f0d55e97-a560-4a15-aa75-37045342f477,network=Network(b40bde43-b1d2-4eb4-938c-55c626640880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0d55e97-a5')
Nov 09 03:45:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] No VIF found with MAC fa:16:3e:a8:5c:b5, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG nova.network.neutron [req-b7216863-b936-4994-88b7-4ab5aaf33475 req-31b24ed9-c8e5-4d92-91be-b2dac535a3a6 service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Updated VIF entry in instance network info cache for port f0d55e97-a560-4a15-aa75-37045342f477. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG nova.network.neutron [req-b7216863-b936-4994-88b7-4ab5aaf33475 req-31b24ed9-c8e5-4d92-91be-b2dac535a3a6 service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Updating instance_info_cache with network_info: [{"id": "f0d55e97-a560-4a15-aa75-37045342f477", "address": "fa:16:3e:a8:5c:b5", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d55e97-a5", "ovs_interfaceid": "f0d55e97-a560-4a15-aa75-37045342f477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:45:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b7216863-b936-4994-88b7-4ab5aaf33475 req-31b24ed9-c8e5-4d92-91be-b2dac535a3a6 service nova] Releasing lock "refresh_cache-883490f1-6a9f-4ad6-83c4-44b78e681de6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:45:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:23 user nova-compute[75378]: DEBUG nova.compute.manager [req-0a350337-ca81-40ef-9339-4ce84752942f req-6cd5fc41-7ea2-4afe-9c5c-24b1b135a94d service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Received event network-vif-plugged-f0d55e97-a560-4a15-aa75-37045342f477 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0a350337-ca81-40ef-9339-4ce84752942f req-6cd5fc41-7ea2-4afe-9c5c-24b1b135a94d service nova] Acquiring lock "883490f1-6a9f-4ad6-83c4-44b78e681de6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0a350337-ca81-40ef-9339-4ce84752942f req-6cd5fc41-7ea2-4afe-9c5c-24b1b135a94d service nova] Lock "883490f1-6a9f-4ad6-83c4-44b78e681de6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0a350337-ca81-40ef-9339-4ce84752942f req-6cd5fc41-7ea2-4afe-9c5c-24b1b135a94d service nova] Lock "883490f1-6a9f-4ad6-83c4-44b78e681de6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:23 user nova-compute[75378]: DEBUG nova.compute.manager [req-0a350337-ca81-40ef-9339-4ce84752942f req-6cd5fc41-7ea2-4afe-9c5c-24b1b135a94d service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] No waiting events found dispatching network-vif-plugged-f0d55e97-a560-4a15-aa75-37045342f477 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:45:23 user nova-compute[75378]: WARNING nova.compute.manager [req-0a350337-ca81-40ef-9339-4ce84752942f req-6cd5fc41-7ea2-4afe-9c5c-24b1b135a94d service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Received unexpected event network-vif-plugged-f0d55e97-a560-4a15-aa75-37045342f477 for instance with vm_state building and task_state spawning.
Nov 09 03:45:24 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:45:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:25 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:45:25 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:45:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:45:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:45:25 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 03:45:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:25 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:45:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:45:25 user nova-compute[75378]: INFO nova.compute.claims [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Claim successful on node user
Nov 09 03:45:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-ad8a1b86-24c4-482e-ae5a-e714a6a12ba2 req-356c3b86-b309-4596-839c-a1177afa9690 service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Received event network-vif-plugged-f0d55e97-a560-4a15-aa75-37045342f477 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ad8a1b86-24c4-482e-ae5a-e714a6a12ba2 req-356c3b86-b309-4596-839c-a1177afa9690 service nova] Acquiring lock "883490f1-6a9f-4ad6-83c4-44b78e681de6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ad8a1b86-24c4-482e-ae5a-e714a6a12ba2 req-356c3b86-b309-4596-839c-a1177afa9690 service nova] Lock "883490f1-6a9f-4ad6-83c4-44b78e681de6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ad8a1b86-24c4-482e-ae5a-e714a6a12ba2 req-356c3b86-b309-4596-839c-a1177afa9690 service nova] Lock "883490f1-6a9f-4ad6-83c4-44b78e681de6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-ad8a1b86-24c4-482e-ae5a-e714a6a12ba2 req-356c3b86-b309-4596-839c-a1177afa9690 service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] No waiting events found dispatching network-vif-plugged-f0d55e97-a560-4a15-aa75-37045342f477 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:45:25 user nova-compute[75378]: WARNING nova.compute.manager [req-ad8a1b86-24c4-482e-ae5a-e714a6a12ba2 req-356c3b86-b309-4596-839c-a1177afa9690 service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Received unexpected event network-vif-plugged-f0d55e97-a560-4a15-aa75-37045342f477 for instance with vm_state building and task_state spawning.
Nov 09 03:45:25 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:45:25 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG nova.compute.manager [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:45:26 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Instance spawned successfully.
Nov 09 03:45:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Updating instance_info_cache with network_info: [{"id": "4c53e537-1637-4f65-b393-a10e68383acb", "address": "fa:16:3e:d8:76:bf", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c53e537-16", "ovs_interfaceid": "4c53e537-1637-4f65-b393-a10e68383acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:45:26 user nova-compute[75378]: INFO nova.compute.manager [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Took 6.73 seconds to spawn the instance on the hypervisor.
Nov 09 03:45:26 user nova-compute[75378]: DEBUG nova.compute.manager [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:45:26 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:45:26 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG nova.policy [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab29d2c2dda547aeb386aa641f4acd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cddc7aab3e44cf82391eebc6a167b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:45:26 user nova-compute[75378]: INFO nova.compute.manager [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Took 7.58 seconds to build instance.
Nov 09 03:45:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bc67e5c6-e029-41d9-8a25-284a2d030e2b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "883490f1-6a9f-4ad6-83c4-44b78e681de6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.692s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:45:26 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Creating image(s)
Nov 09 03:45:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "/opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "/opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "/opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.231s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.245s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk 1073741824" returned: 0 in 0.057s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:27 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Successfully created port: e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:45:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.226s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:27 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:45:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:27 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Cannot resize image /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:45:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:45:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Ensure instance console log exists: /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:45:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:27 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Successfully updated port: e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:45:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:45:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquired lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:45:27 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:45:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-04ee9b3d-53d8-4417-9950-be8440a274df req-4e84009c-c223-44ab-a9da-b65c4c3c3347 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received event network-changed-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-04ee9b3d-53d8-4417-9950-be8440a274df req-4e84009c-c223-44ab-a9da-b65c4c3c3347 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Refreshing instance network info cache due to event network-changed-e4725ee0-c613-48af-8163-eafad2605fff. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:45:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-04ee9b3d-53d8-4417-9950-be8440a274df req-4e84009c-c223-44ab-a9da-b65c4c3c3347 service nova] Acquiring lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Updating instance_info_cache with network_info: [{"id": "e4725ee0-c613-48af-8163-eafad2605fff", "address": "fa:16:3e:89:f8:61", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4725ee0-c6", "ovs_interfaceid": "e4725ee0-c613-48af-8163-eafad2605fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Releasing lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Instance network_info: |[{"id": "e4725ee0-c613-48af-8163-eafad2605fff", "address": "fa:16:3e:89:f8:61", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4725ee0-c6", "ovs_interfaceid": "e4725ee0-c613-48af-8163-eafad2605fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-04ee9b3d-53d8-4417-9950-be8440a274df req-4e84009c-c223-44ab-a9da-b65c4c3c3347 service nova] Acquired lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.network.neutron [req-04ee9b3d-53d8-4417-9950-be8440a274df req-4e84009c-c223-44ab-a9da-b65c4c3c3347 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Refreshing network info cache for port e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Start _get_guest_xml network_info=[{"id": "e4725ee0-c613-48af-8163-eafad2605fff", "address": "fa:16:3e:89:f8:61", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4725ee0-c6", "ovs_interfaceid": "e4725ee0-c613-48af-8163-eafad2605fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:45:28 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:45:28 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-846627937',display_name='tempest-ServerRescueNegativeTestJSON-server-846627937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-846627937',id=18,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBC3j8XalFsnv+ohCWJaFMOzhebiKVhwDqjVSbRzER5tSDvpTJuoMZ9QtIikxGF9BqxV9wk5YQgyNlPsJFGp6zlCYonssIWXLzu36PmDp5LDOUw0qUWi4uNuNyeb3voJCw==',key_name='tempest-keypair-880565104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87cddc7aab3e44cf82391eebc6a167b1',ramdisk_id='',reservation_id='r-ww0mhtjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1449314788',owner_user_name='tempest-ServerRescueNegativeTestJSON-1449314788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab29d2c2dda547aeb386aa641f4acd24',uuid=89cb3e6d-1b20-4c45-aa0b-a64c92d893c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4725ee0-c613-48af-8163-eafad2605fff", "address": "fa:16:3e:89:f8:61", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4725ee0-c6", "ovs_interfaceid": "e4725ee0-c613-48af-8163-eafad2605fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converting VIF {"id": "e4725ee0-c613-48af-8163-eafad2605fff", "address": "fa:16:3e:89:f8:61", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4725ee0-c6", "ovs_interfaceid": "e4725ee0-c613-48af-8163-eafad2605fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:f8:61,bridge_name='br-int',has_traffic_filtering=True,id=e4725ee0-c613-48af-8163-eafad2605fff,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4725ee0-c6') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.objects.instance [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'pci_devices' on Instance uuid 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:45:28 user nova-compute[75378]:   <uuid>89cb3e6d-1b20-4c45-aa0b-a64c92d893c3</uuid>
Nov 09 03:45:28 user nova-compute[75378]:   <name>instance-00000012</name>
Nov 09 03:45:28 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:45:28 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:45:28 user nova-compute[75378]:   <metadata>
Nov 09 03:45:28 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:45:28 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:45:28 user nova-compute[75378]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-846627937</nova:name>
Nov 09 03:45:28 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:45:28</nova:creationTime>
Nov 09 03:45:28 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:45:28 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:45:28 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:45:28 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:45:28 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:45:28 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:45:28 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:45:28 user nova-compute[75378]:       <nova:owner>
Nov 09 03:45:28 user nova-compute[75378]:         <nova:user uuid="ab29d2c2dda547aeb386aa641f4acd24">tempest-ServerRescueNegativeTestJSON-1449314788-project-member</nova:user>
Nov 09 03:45:28 user nova-compute[75378]:         <nova:project uuid="87cddc7aab3e44cf82391eebc6a167b1">tempest-ServerRescueNegativeTestJSON-1449314788</nova:project>
Nov 09 03:45:28 user nova-compute[75378]:       </nova:owner>
Nov 09 03:45:28 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:45:28 user nova-compute[75378]:       <nova:ports>
Nov 09 03:45:28 user nova-compute[75378]:         <nova:port uuid="e4725ee0-c613-48af-8163-eafad2605fff">
Nov 09 03:45:28 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 09 03:45:28 user nova-compute[75378]:         </nova:port>
Nov 09 03:45:28 user nova-compute[75378]:       </nova:ports>
Nov 09 03:45:28 user nova-compute[75378]:     </nova:instance>
Nov 09 03:45:28 user nova-compute[75378]:   </metadata>
Nov 09 03:45:28 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:45:28 user nova-compute[75378]:     <system>
Nov 09 03:45:28 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:45:28 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:45:28 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:45:28 user nova-compute[75378]:       <entry name="serial">89cb3e6d-1b20-4c45-aa0b-a64c92d893c3</entry>
Nov 09 03:45:28 user nova-compute[75378]:       <entry name="uuid">89cb3e6d-1b20-4c45-aa0b-a64c92d893c3</entry>
Nov 09 03:45:28 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:45:28 user nova-compute[75378]:     </system>
Nov 09 03:45:28 user nova-compute[75378]:   </sysinfo>
Nov 09 03:45:28 user nova-compute[75378]:   <os>
Nov 09 03:45:28 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:45:28 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:45:28 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:45:28 user nova-compute[75378]:   </os>
Nov 09 03:45:28 user nova-compute[75378]:   <features>
Nov 09 03:45:28 user nova-compute[75378]:     <acpi/>
Nov 09 03:45:28 user nova-compute[75378]:     <apic/>
Nov 09 03:45:28 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:45:28 user nova-compute[75378]:   </features>
Nov 09 03:45:28 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:45:28 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:45:28 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:45:28 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:45:28 user nova-compute[75378]:   </clock>
Nov 09 03:45:28 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:45:28 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:45:28 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:45:28 user nova-compute[75378]:   </cpu>
Nov 09 03:45:28 user nova-compute[75378]:   <devices>
Nov 09 03:45:28 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:45:28 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:45:28 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk"/>
Nov 09 03:45:28 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:45:28 user nova-compute[75378]:     </disk>
Nov 09 03:45:28 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:45:28 user nova-compute[75378]:       <mac address="fa:16:3e:89:f8:61"/>
Nov 09 03:45:28 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:45:28 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:45:28 user nova-compute[75378]:       <target dev="tape4725ee0-c6"/>
Nov 09 03:45:28 user nova-compute[75378]:     </interface>
Nov 09 03:45:28 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:45:28 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/console.log" append="off"/>
Nov 09 03:45:28 user nova-compute[75378]:     </serial>
Nov 09 03:45:28 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:45:28 user nova-compute[75378]:     <video>
Nov 09 03:45:28 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:45:28 user nova-compute[75378]:     </video>
Nov 09 03:45:28 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:45:28 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:45:28 user nova-compute[75378]:     </rng>
Nov 09 03:45:28 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:45:28 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:45:28 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:45:28 user nova-compute[75378]:     </memballoon>
Nov 09 03:45:28 user nova-compute[75378]:   </devices>
Nov 09 03:45:28 user nova-compute[75378]: </domain>
Nov 09 03:45:28 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-846627937',display_name='tempest-ServerRescueNegativeTestJSON-server-846627937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-846627937',id=18,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBC3j8XalFsnv+ohCWJaFMOzhebiKVhwDqjVSbRzER5tSDvpTJuoMZ9QtIikxGF9BqxV9wk5YQgyNlPsJFGp6zlCYonssIWXLzu36PmDp5LDOUw0qUWi4uNuNyeb3voJCw==',key_name='tempest-keypair-880565104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='87cddc7aab3e44cf82391eebc6a167b1',ramdisk_id='',reservation_id='r-ww0mhtjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1449314788',owner_user_name='tempest-ServerRescueNegativeTestJSON-1449314788-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab29d2c2dda547aeb386aa641f4acd24',uuid=89cb3e6d-1b20-4c45-aa0b-a64c92d893c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4725ee0-c613-48af-8163-eafad2605fff", "address": "fa:16:3e:89:f8:61", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4725ee0-c6", "ovs_interfaceid": "e4725ee0-c613-48af-8163-eafad2605fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converting VIF {"id": "e4725ee0-c613-48af-8163-eafad2605fff", "address": "fa:16:3e:89:f8:61", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4725ee0-c6", "ovs_interfaceid": "e4725ee0-c613-48af-8163-eafad2605fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:f8:61,bridge_name='br-int',has_traffic_filtering=True,id=e4725ee0-c613-48af-8163-eafad2605fff,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4725ee0-c6') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG os_vif [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:f8:61,bridge_name='br-int',has_traffic_filtering=True,id=e4725ee0-c613-48af-8163-eafad2605fff,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4725ee0-c6') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64506f78-a67f-5e49-bb6c-fd55c11d0351', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4725ee0-c6, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4725ee0-c6, col_values=(('qos', UUID('bcc24d56-4526-4987-84b8-d38fe4df3d7e')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4725ee0-c6, col_values=(('external_ids', {'iface-id': 'e4725ee0-c613-48af-8163-eafad2605fff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:f8:61', 'vm-uuid': '89cb3e6d-1b20-4c45-aa0b-a64c92d893c3'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:28 user nova-compute[75378]: INFO os_vif [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:f8:61,bridge_name='br-int',has_traffic_filtering=True,id=e4725ee0-c613-48af-8163-eafad2605fff,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4725ee0-c6')
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] No VIF found with MAC fa:16:3e:89:f8:61, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:29 user nova-compute[75378]: DEBUG nova.network.neutron [req-04ee9b3d-53d8-4417-9950-be8440a274df req-4e84009c-c223-44ab-a9da-b65c4c3c3347 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Updated VIF entry in instance network info cache for port e4725ee0-c613-48af-8163-eafad2605fff. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:45:29 user nova-compute[75378]: DEBUG nova.network.neutron [req-04ee9b3d-53d8-4417-9950-be8440a274df req-4e84009c-c223-44ab-a9da-b65c4c3c3347 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Updating instance_info_cache with network_info: [{"id": "e4725ee0-c613-48af-8163-eafad2605fff", "address": "fa:16:3e:89:f8:61", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4725ee0-c6", "ovs_interfaceid": "e4725ee0-c613-48af-8163-eafad2605fff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:45:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-04ee9b3d-53d8-4417-9950-be8440a274df req-4e84009c-c223-44ab-a9da-b65c4c3c3347 service nova] Releasing lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:45:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:31 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:45:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:31 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:45:31 user nova-compute[75378]: INFO nova.compute.claims [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Claim successful on node user
Nov 09 03:45:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:45:32 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:45:32 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8124MB free_disk=25.58160400390625GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.006s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.357s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:45:32 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:45:32 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Instance spawned successfully.
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9691c96a-287e-40f0-a7e2-70bd56d9d2d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2f475dba-59f5-414a-8156-8b438601ecfd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7d051405-6b57-4db2-9533-c2f4e87134d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 883490f1-6a9f-4ad6-83c4-44b78e681de6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c4ef6623-863b-40a8-b9ec-720c25ee3484 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:45:32 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:45:33 user nova-compute[75378]: INFO nova.compute.manager [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Took 6.64 seconds to spawn the instance on the hypervisor.
Nov 09 03:45:33 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:45:33 user nova-compute[75378]: INFO nova.virt.block_device [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Booting with volume 981920d2-9809-4a1c-917b-fb19ca23724a at /dev/vda
Nov 09 03:45:33 user nova-compute[75378]: DEBUG os_brick.utils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG nova.policy [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd895f640a78436cb439a4d0e82fe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b7a5a29e104b60ae779f864d5c202f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:45:33 user nova-compute[75378]: INFO nova.compute.manager [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Took 7.72 seconds to build instance.
Nov 09 03:45:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c217e7ba-d383-403e-b7b5-1915a56f410a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58906d2-f212-4599-957c-3fc8b35d3899]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d127ce05-8c5c-46f1-a88b-c72eb9079084 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.888s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fd7e29-eb13-4763-a2ac-fe1550b5648a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d057361-d635-4e07-ac8a-bff523008810]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:45:33 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:45:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e03b8f-98f7-45cf-ba0b-42fa6132bfde]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG os_brick.utils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Updating existing volume attachment record: c2314c06-7768-4a10-a489-6efd2a8b53ad {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.735s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG nova.compute.manager [req-09b7ac7a-9842-4f8f-b763-cf54df129f2d req-1abebd09-c054-4fc6-ac5f-0e75c6bb5ae2 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received event network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-09b7ac7a-9842-4f8f-b763-cf54df129f2d req-1abebd09-c054-4fc6-ac5f-0e75c6bb5ae2 service nova] Acquiring lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-09b7ac7a-9842-4f8f-b763-cf54df129f2d req-1abebd09-c054-4fc6-ac5f-0e75c6bb5ae2 service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-09b7ac7a-9842-4f8f-b763-cf54df129f2d req-1abebd09-c054-4fc6-ac5f-0e75c6bb5ae2 service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:33 user nova-compute[75378]: DEBUG nova.compute.manager [req-09b7ac7a-9842-4f8f-b763-cf54df129f2d req-1abebd09-c054-4fc6-ac5f-0e75c6bb5ae2 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] No waiting events found dispatching network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:45:33 user nova-compute[75378]: WARNING nova.compute.manager [req-09b7ac7a-9842-4f8f-b763-cf54df129f2d req-1abebd09-c054-4fc6-ac5f-0e75c6bb5ae2 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received unexpected event network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff for instance with vm_state active and task_state None.
Nov 09 03:45:34 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Successfully created port: 37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:45:34 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:45:34 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:45:34 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:45:34 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Successfully created port: 427ba1a1-d2a8-431b-aeea-d455e8908e7a {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:45:35 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Successfully created port: e2bab297-674f-41e7-baac-73eb91483899 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:45:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:36 user nova-compute[75378]: DEBUG nova.compute.manager [req-05fa9838-efc6-4a2c-b893-044871452a20 req-3feb5fda-e0d8-4569-a136-c251f392bc95 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received event network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-05fa9838-efc6-4a2c-b893-044871452a20 req-3feb5fda-e0d8-4569-a136-c251f392bc95 service nova] Acquiring lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-05fa9838-efc6-4a2c-b893-044871452a20 req-3feb5fda-e0d8-4569-a136-c251f392bc95 service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-05fa9838-efc6-4a2c-b893-044871452a20 req-3feb5fda-e0d8-4569-a136-c251f392bc95 service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:36 user nova-compute[75378]: DEBUG nova.compute.manager [req-05fa9838-efc6-4a2c-b893-044871452a20 req-3feb5fda-e0d8-4569-a136-c251f392bc95 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] No waiting events found dispatching network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:45:36 user nova-compute[75378]: WARNING nova.compute.manager [req-05fa9838-efc6-4a2c-b893-044871452a20 req-3feb5fda-e0d8-4569-a136-c251f392bc95 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received unexpected event network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff for instance with vm_state active and task_state None.
Nov 09 03:45:36 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Successfully created port: 2195503e-d6da-4598-9478-2956f48d2b8e {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:45:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:38 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Successfully created port: abe16ed0-6d62-41c1-8bfd-da97d9908143 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:45:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:39 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Successfully updated port: 37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:45:39 user nova-compute[75378]: DEBUG nova.compute.manager [req-8d57de4a-4541-400a-a2c4-576835514b20 req-bda572a0-aef1-4443-a67a-b7dd69973b21 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-changed-37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:39 user nova-compute[75378]: DEBUG nova.compute.manager [req-8d57de4a-4541-400a-a2c4-576835514b20 req-bda572a0-aef1-4443-a67a-b7dd69973b21 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Refreshing instance network info cache due to event network-changed-37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:45:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8d57de4a-4541-400a-a2c4-576835514b20 req-bda572a0-aef1-4443-a67a-b7dd69973b21 service nova] Acquiring lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:45:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8d57de4a-4541-400a-a2c4-576835514b20 req-bda572a0-aef1-4443-a67a-b7dd69973b21 service nova] Acquired lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:45:39 user nova-compute[75378]: DEBUG nova.network.neutron [req-8d57de4a-4541-400a-a2c4-576835514b20 req-bda572a0-aef1-4443-a67a-b7dd69973b21 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Refreshing network info cache for port 37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:45:39 user nova-compute[75378]: DEBUG nova.network.neutron [req-8d57de4a-4541-400a-a2c4-576835514b20 req-bda572a0-aef1-4443-a67a-b7dd69973b21 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:45:39 user nova-compute[75378]: DEBUG nova.network.neutron [req-8d57de4a-4541-400a-a2c4-576835514b20 req-bda572a0-aef1-4443-a67a-b7dd69973b21 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:45:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8d57de4a-4541-400a-a2c4-576835514b20 req-bda572a0-aef1-4443-a67a-b7dd69973b21 service nova] Releasing lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:45:40 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Successfully updated port: 95465b85-15fb-4cf7-9db9-23c5e4a755c8 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:45:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "2f475dba-59f5-414a-8156-8b438601ecfd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:40 user nova-compute[75378]: INFO nova.compute.manager [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Terminating instance
Nov 09 03:45:40 user nova-compute[75378]: DEBUG nova.compute.manager [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:45:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:41 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Instance destroyed successfully.
Nov 09 03:45:41 user nova-compute[75378]: DEBUG nova.objects.instance [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lazy-loading 'resources' on Instance uuid 2f475dba-59f5-414a-8156-8b438601ecfd {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1138780210',display_name='tempest-ServerActionsTestOtherB-server-1138780210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1138780210',id=4,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+s7M8RwDJb3loYxaUJGVxjbTQ9aVX7ngKf1RZUNQALVC7bsteyYsWXKwZsj2SvyMQBcJEfxsQ8l4Bn0IQtqoWxZ715fiA5I3KyJRgBFHf7jRe97Ql+ZXV7Ej5ZLqWSCg==',key_name='tempest-keypair-904427918',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:43:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb0bda222cd54a44bd26b140d08d8274',ramdisk_id='',reservation_id='r-u0jhm5ex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1007633314',owner_user_name='tempest-ServerActionsTestOtherB-1007633314-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:43:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7bb5d4c95c341beaa22c1bbeacaf4f7',uuid=2f475dba-59f5-414a-8156-8b438601ecfd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Converting VIF {"id": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "address": "fa:16:3e:07:9f:69", "network": {"id": "2e704dce-6cba-4cf1-bd3e-d05da48d7839", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-853392482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb0bda222cd54a44bd26b140d08d8274", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0fa9225-bc", "ovs_interfaceid": "d0fa9225-bc1d-4d57-b259-5a6d1e3638f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:9f:69,bridge_name='br-int',has_traffic_filtering=True,id=d0fa9225-bc1d-4d57-b259-5a6d1e3638f8,network=Network(2e704dce-6cba-4cf1-bd3e-d05da48d7839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fa9225-bc') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG os_vif [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:9f:69,bridge_name='br-int',has_traffic_filtering=True,id=d0fa9225-bc1d-4d57-b259-5a6d1e3638f8,network=Network(2e704dce-6cba-4cf1-bd3e-d05da48d7839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fa9225-bc') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0fa9225-bc, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG nova.compute.manager [req-87427e5c-7257-40b5-893f-a33dbaa83496 req-fff7292a-443f-4009-b147-4e5aa34b07ad service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-changed-95465b85-15fb-4cf7-9db9-23c5e4a755c8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG nova.compute.manager [req-87427e5c-7257-40b5-893f-a33dbaa83496 req-fff7292a-443f-4009-b147-4e5aa34b07ad service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Refreshing instance network info cache due to event network-changed-95465b85-15fb-4cf7-9db9-23c5e4a755c8. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-87427e5c-7257-40b5-893f-a33dbaa83496 req-fff7292a-443f-4009-b147-4e5aa34b07ad service nova] Acquiring lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-87427e5c-7257-40b5-893f-a33dbaa83496 req-fff7292a-443f-4009-b147-4e5aa34b07ad service nova] Acquired lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG nova.network.neutron [req-87427e5c-7257-40b5-893f-a33dbaa83496 req-fff7292a-443f-4009-b147-4e5aa34b07ad service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Refreshing network info cache for port 95465b85-15fb-4cf7-9db9-23c5e4a755c8 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf288b06-fd81-4e4a-95f9-e001bfbbf4e3) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:41 user nova-compute[75378]: INFO os_vif [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:9f:69,bridge_name='br-int',has_traffic_filtering=True,id=d0fa9225-bc1d-4d57-b259-5a6d1e3638f8,network=Network(2e704dce-6cba-4cf1-bd3e-d05da48d7839),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0fa9225-bc')
Nov 09 03:45:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etYnaShu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:45:41 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:45:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2ebf45-956e-4387-be05-671ecd31937e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:45:41 user nova-compute[75378]: No targets found.
Nov 09 03:45:41 user nova-compute[75378]: iSNS:
Nov 09 03:45:41 user nova-compute[75378]: No targets found.
Nov 09 03:45:41 user nova-compute[75378]: STATIC:
Nov 09 03:45:41 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be
Nov 09 03:45:41 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:45:41 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:45:41 user nova-compute[75378]: FIRMWARE:
Nov 09 03:45:41 user nova-compute[75378]: No targets found.
Nov 09 03:45:41 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:45:41 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:45:41 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cbf303-442f-4b07-af4f-30373ab617ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea228f64-edaa-474c-a106-42266c69dd8a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:45:41 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be (non-flash)
Nov 09 03:45:41 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3b049fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be'): ({'sdb'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Removing single pathed devices sdb {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[284d96cb-6a4a-4ba2-b079-41d86583f71f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Successfully updated port: 4dd2d935-dbaf-445e-aa45-30114c1df2a8 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG nova.network.neutron [req-87427e5c-7257-40b5-893f-a33dbaa83496 req-fff7292a-443f-4009-b147-4e5aa34b07ad service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51bb746-b9bd-4283-84a9-8a7915fff760]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Flushing IO for device /dev/sdb {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d55a4b-d53d-4179-807c-f5a336c455f4]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dfa01a-851f-4d4e-85df-afbd7fc621e9]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21da1ea-fe4e-41fb-8887-05777efcdee8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1051924-c9c4-48ba-a5ff-93c28daa4b6d]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260]
Nov 09 03:45:41 user nova-compute[75378]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be, portal: 172.16.0.220,3260] successful.
Nov 09 03:45:41 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93b2608a-e6b8-4844-820c-71f0cd80f3be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c901e0-36ab-4c8f-b74f-e493556d4e35]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] <== disconnect_volume: return (393ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:45:41 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Deleting instance files /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd_del
Nov 09 03:45:41 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Deletion of /opt/stack/data/nova/instances/2f475dba-59f5-414a-8156-8b438601ecfd_del complete
Nov 09 03:45:41 user nova-compute[75378]: DEBUG nova.network.neutron [req-87427e5c-7257-40b5-893f-a33dbaa83496 req-fff7292a-443f-4009-b147-4e5aa34b07ad service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-87427e5c-7257-40b5-893f-a33dbaa83496 req-fff7292a-443f-4009-b147-4e5aa34b07ad service nova] Releasing lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG nova.compute.manager [req-87427e5c-7257-40b5-893f-a33dbaa83496 req-fff7292a-443f-4009-b147-4e5aa34b07ad service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received event network-vif-unplugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-87427e5c-7257-40b5-893f-a33dbaa83496 req-fff7292a-443f-4009-b147-4e5aa34b07ad service nova] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-87427e5c-7257-40b5-893f-a33dbaa83496 req-fff7292a-443f-4009-b147-4e5aa34b07ad service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-87427e5c-7257-40b5-893f-a33dbaa83496 req-fff7292a-443f-4009-b147-4e5aa34b07ad service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG nova.compute.manager [req-87427e5c-7257-40b5-893f-a33dbaa83496 req-fff7292a-443f-4009-b147-4e5aa34b07ad service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] No waiting events found dispatching network-vif-unplugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:45:41 user nova-compute[75378]: DEBUG nova.compute.manager [req-87427e5c-7257-40b5-893f-a33dbaa83496 req-fff7292a-443f-4009-b147-4e5aa34b07ad service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received event network-vif-unplugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:45:41 user nova-compute[75378]: INFO nova.compute.manager [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Took 1.51 seconds to destroy the instance on the hypervisor.
Nov 09 03:45:41 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:45:42 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:45:42 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:45:42 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Successfully updated port: 427ba1a1-d2a8-431b-aeea-d455e8908e7a {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:45:43 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Successfully updated port: e2bab297-674f-41e7-baac-73eb91483899 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:45:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] Acquiring lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] Lock "2f475dba-59f5-414a-8156-8b438601ecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] No waiting events found dispatching network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:45:43 user nova-compute[75378]: WARNING nova.compute.manager [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received unexpected event network-vif-plugged-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 for instance with vm_state active and task_state deleting.
Nov 09 03:45:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-changed-4dd2d935-dbaf-445e-aa45-30114c1df2a8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Refreshing instance network info cache due to event network-changed-4dd2d935-dbaf-445e-aa45-30114c1df2a8. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:45:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] Acquiring lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:45:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] Acquired lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:45:43 user nova-compute[75378]: DEBUG nova.network.neutron [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Refreshing network info cache for port 4dd2d935-dbaf-445e-aa45-30114c1df2a8 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:45:43 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:45:43 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Took 1.25 seconds to deallocate network for instance.
Nov 09 03:45:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-28140ad1-c365-42f1-93e9-5e54afce05de req-4a9a8733-a699-473f-983e-09f60ee55939 service nova] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Received event network-vif-deleted-d0fa9225-bc1d-4d57-b259-5a6d1e3638f8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:43 user nova-compute[75378]: DEBUG nova.network.neutron [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:45:44 user nova-compute[75378]: DEBUG nova.network.neutron [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:45:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] Releasing lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:45:44 user nova-compute[75378]: DEBUG nova.compute.manager [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-changed-427ba1a1-d2a8-431b-aeea-d455e8908e7a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:44 user nova-compute[75378]: DEBUG nova.compute.manager [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Refreshing instance network info cache due to event network-changed-427ba1a1-d2a8-431b-aeea-d455e8908e7a. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:45:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] Acquiring lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:45:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] Acquired lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:45:44 user nova-compute[75378]: DEBUG nova.network.neutron [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Refreshing network info cache for port 427ba1a1-d2a8-431b-aeea-d455e8908e7a {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:45:44 user nova-compute[75378]: DEBUG nova.network.neutron [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:45:44 user nova-compute[75378]: INFO nova.compute.manager [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] [instance: 2f475dba-59f5-414a-8156-8b438601ecfd] Took 1.20 seconds to detach 1 volumes for instance.
Nov 09 03:45:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:44 user nova-compute[75378]: DEBUG nova.network.neutron [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:45:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cc7414c3-6777-4d26-88fe-7f7e48ee3c3c req-e1aea54d-822f-416e-b05a-540081581937 service nova] Releasing lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Acquiring lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Acquiring lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:45 user nova-compute[75378]: INFO nova.compute.manager [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Terminating instance
Nov 09 03:45:45 user nova-compute[75378]: DEBUG nova.compute.manager [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Successfully updated port: 2195503e-d6da-4598-9478-2956f48d2b8e {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.527s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:45 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Deleted allocations for instance 2f475dba-59f5-414a-8156-8b438601ecfd
Nov 09 03:45:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0c9b21fe-7407-4922-a362-e932d2c44ca0 tempest-ServerActionsTestOtherB-1007633314 tempest-ServerActionsTestOtherB-1007633314-project-member] Lock "2f475dba-59f5-414a-8156-8b438601ecfd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.131s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-2d578094-d366-4db4-88e5-fef406d55cce req-b76c502e-8e30-409a-aa24-9befbd87cdf2 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-changed-e2bab297-674f-41e7-baac-73eb91483899 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-2d578094-d366-4db4-88e5-fef406d55cce req-b76c502e-8e30-409a-aa24-9befbd87cdf2 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Refreshing instance network info cache due to event network-changed-e2bab297-674f-41e7-baac-73eb91483899. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2d578094-d366-4db4-88e5-fef406d55cce req-b76c502e-8e30-409a-aa24-9befbd87cdf2 service nova] Acquiring lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2d578094-d366-4db4-88e5-fef406d55cce req-b76c502e-8e30-409a-aa24-9befbd87cdf2 service nova] Acquired lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG nova.network.neutron [req-2d578094-d366-4db4-88e5-fef406d55cce req-b76c502e-8e30-409a-aa24-9befbd87cdf2 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Refreshing network info cache for port e2bab297-674f-41e7-baac-73eb91483899 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG nova.network.neutron [req-2d578094-d366-4db4-88e5-fef406d55cce req-b76c502e-8e30-409a-aa24-9befbd87cdf2 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:45:45 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Instance destroyed successfully.
Nov 09 03:45:45 user nova-compute[75378]: DEBUG nova.objects.instance [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lazy-loading 'resources' on Instance uuid 9691c96a-287e-40f0-a7e2-70bd56d9d2d3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1308792204',display_name='tempest-ServersNegativeTestJSON-server-1308792204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1308792204',id=1,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:36:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed1024d4b86f47b480b75e55108e6c30',ramdisk_id='',reservation_id='r-bvdat0ij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-218592793',owner_user_name='tempest-ServersNegativeTestJSON-218592793-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:36:42Z,user_data=None,user_id='201443e0d5e84be0b662043093120ae3',uuid=9691c96a-287e-40f0-a7e2-70bd56d9d2d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "address": "fa:16:3e:cb:7d:a8", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f2f1d8-31", "ovs_interfaceid": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Converting VIF {"id": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "address": "fa:16:3e:cb:7d:a8", "network": {"id": "9b18f037-ec04-4c7f-bfc8-17e90dd10787", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1670831283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed1024d4b86f47b480b75e55108e6c30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f2f1d8-31", "ovs_interfaceid": "49f2f1d8-31ba-44d8-bb43-d85162cbfc46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=49f2f1d8-31ba-44d8-bb43-d85162cbfc46,network=Network(9b18f037-ec04-4c7f-bfc8-17e90dd10787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f2f1d8-31') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG os_vif [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=49f2f1d8-31ba-44d8-bb43-d85162cbfc46,network=Network(9b18f037-ec04-4c7f-bfc8-17e90dd10787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f2f1d8-31') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49f2f1d8-31, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1357c0b-3d05-4024-a217-d0f60d3a7e40) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:45:45 user nova-compute[75378]: INFO os_vif [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=49f2f1d8-31ba-44d8-bb43-d85162cbfc46,network=Network(9b18f037-ec04-4c7f-bfc8-17e90dd10787),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f2f1d8-31')
Nov 09 03:45:45 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Deleting instance files /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3_del
Nov 09 03:45:45 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Deletion of /opt/stack/data/nova/instances/9691c96a-287e-40f0-a7e2-70bd56d9d2d3_del complete
Nov 09 03:45:46 user nova-compute[75378]: INFO nova.compute.manager [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 09 03:45:46 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:45:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:46 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:45:46 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:45:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:46 user nova-compute[75378]: DEBUG nova.network.neutron [req-2d578094-d366-4db4-88e5-fef406d55cce req-b76c502e-8e30-409a-aa24-9befbd87cdf2 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:45:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2d578094-d366-4db4-88e5-fef406d55cce req-b76c502e-8e30-409a-aa24-9befbd87cdf2 service nova] Releasing lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:45:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-2d578094-d366-4db4-88e5-fef406d55cce req-b76c502e-8e30-409a-aa24-9befbd87cdf2 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-changed-2195503e-d6da-4598-9478-2956f48d2b8e {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-2d578094-d366-4db4-88e5-fef406d55cce req-b76c502e-8e30-409a-aa24-9befbd87cdf2 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Refreshing instance network info cache due to event network-changed-2195503e-d6da-4598-9478-2956f48d2b8e. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:45:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2d578094-d366-4db4-88e5-fef406d55cce req-b76c502e-8e30-409a-aa24-9befbd87cdf2 service nova] Acquiring lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:45:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2d578094-d366-4db4-88e5-fef406d55cce req-b76c502e-8e30-409a-aa24-9befbd87cdf2 service nova] Acquired lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:45:46 user nova-compute[75378]: DEBUG nova.network.neutron [req-2d578094-d366-4db4-88e5-fef406d55cce req-b76c502e-8e30-409a-aa24-9befbd87cdf2 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Refreshing network info cache for port 2195503e-d6da-4598-9478-2956f48d2b8e {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:45:46 user nova-compute[75378]: DEBUG nova.network.neutron [req-2d578094-d366-4db4-88e5-fef406d55cce req-b76c502e-8e30-409a-aa24-9befbd87cdf2 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:45:46 user nova-compute[75378]: DEBUG nova.network.neutron [req-2d578094-d366-4db4-88e5-fef406d55cce req-b76c502e-8e30-409a-aa24-9befbd87cdf2 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:45:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2d578094-d366-4db4-88e5-fef406d55cce req-b76c502e-8e30-409a-aa24-9befbd87cdf2 service nova] Releasing lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:45:46 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Successfully updated port: abe16ed0-6d62-41c1-8bfd-da97d9908143 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:45:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Acquiring lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:45:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Acquired lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:45:46 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:45:46 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:45:46 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:45:47 user nova-compute[75378]: DEBUG nova.compute.manager [req-5a2a1f92-6286-416f-92d4-0f99a405b528 req-1348d528-60d7-4642-b1db-1b068f413c3d service nova] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Received event network-vif-deleted-49f2f1d8-31ba-44d8-bb43-d85162cbfc46 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:47 user nova-compute[75378]: INFO nova.compute.manager [req-5a2a1f92-6286-416f-92d4-0f99a405b528 req-1348d528-60d7-4642-b1db-1b068f413c3d service nova] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Neutron deleted interface 49f2f1d8-31ba-44d8-bb43-d85162cbfc46; detaching it from the instance and deleting it from the info cache
Nov 09 03:45:47 user nova-compute[75378]: DEBUG nova.network.neutron [req-5a2a1f92-6286-416f-92d4-0f99a405b528 req-1348d528-60d7-4642-b1db-1b068f413c3d service nova] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:45:47 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Took 1.00 seconds to deallocate network for instance.
Nov 09 03:45:47 user nova-compute[75378]: DEBUG nova.compute.manager [req-5a2a1f92-6286-416f-92d4-0f99a405b528 req-1348d528-60d7-4642-b1db-1b068f413c3d service nova] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Detach interface failed, port_id=49f2f1d8-31ba-44d8-bb43-d85162cbfc46, reason: Instance 9691c96a-287e-40f0-a7e2-70bd56d9d2d3 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 03:45:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:47 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:45:47 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:45:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:47 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Deleted allocations for instance 9691c96a-287e-40f0-a7e2-70bd56d9d2d3
Nov 09 03:45:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6bf62d11-cf3c-4b1f-a202-8c1ccfc576a6 tempest-ServersNegativeTestJSON-218592793 tempest-ServersNegativeTestJSON-218592793-project-member] Lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.417s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:47 user nova-compute[75378]: DEBUG nova.compute.manager [req-55133126-6e0d-4054-af91-90e799956b65 req-77cc6134-c187-40c0-8c46-d8a3cab12241 service nova] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Received event network-vif-unplugged-49f2f1d8-31ba-44d8-bb43-d85162cbfc46 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-55133126-6e0d-4054-af91-90e799956b65 req-77cc6134-c187-40c0-8c46-d8a3cab12241 service nova] Acquiring lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-55133126-6e0d-4054-af91-90e799956b65 req-77cc6134-c187-40c0-8c46-d8a3cab12241 service nova] Lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-55133126-6e0d-4054-af91-90e799956b65 req-77cc6134-c187-40c0-8c46-d8a3cab12241 service nova] Lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:47 user nova-compute[75378]: DEBUG nova.compute.manager [req-55133126-6e0d-4054-af91-90e799956b65 req-77cc6134-c187-40c0-8c46-d8a3cab12241 service nova] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] No waiting events found dispatching network-vif-unplugged-49f2f1d8-31ba-44d8-bb43-d85162cbfc46 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:45:47 user nova-compute[75378]: WARNING nova.compute.manager [req-55133126-6e0d-4054-af91-90e799956b65 req-77cc6134-c187-40c0-8c46-d8a3cab12241 service nova] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Received unexpected event network-vif-unplugged-49f2f1d8-31ba-44d8-bb43-d85162cbfc46 for instance with vm_state deleted and task_state None.
Nov 09 03:45:47 user nova-compute[75378]: DEBUG nova.compute.manager [req-55133126-6e0d-4054-af91-90e799956b65 req-77cc6134-c187-40c0-8c46-d8a3cab12241 service nova] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Received event network-vif-plugged-49f2f1d8-31ba-44d8-bb43-d85162cbfc46 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-55133126-6e0d-4054-af91-90e799956b65 req-77cc6134-c187-40c0-8c46-d8a3cab12241 service nova] Acquiring lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-55133126-6e0d-4054-af91-90e799956b65 req-77cc6134-c187-40c0-8c46-d8a3cab12241 service nova] Lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-55133126-6e0d-4054-af91-90e799956b65 req-77cc6134-c187-40c0-8c46-d8a3cab12241 service nova] Lock "9691c96a-287e-40f0-a7e2-70bd56d9d2d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:47 user nova-compute[75378]: DEBUG nova.compute.manager [req-55133126-6e0d-4054-af91-90e799956b65 req-77cc6134-c187-40c0-8c46-d8a3cab12241 service nova] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] No waiting events found dispatching network-vif-plugged-49f2f1d8-31ba-44d8-bb43-d85162cbfc46 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:45:47 user nova-compute[75378]: WARNING nova.compute.manager [req-55133126-6e0d-4054-af91-90e799956b65 req-77cc6134-c187-40c0-8c46-d8a3cab12241 service nova] [instance: 9691c96a-287e-40f0-a7e2-70bd56d9d2d3] Received unexpected event network-vif-plugged-49f2f1d8-31ba-44d8-bb43-d85162cbfc46 for instance with vm_state deleted and task_state None.
Nov 09 03:45:47 user nova-compute[75378]: DEBUG nova.compute.manager [req-55133126-6e0d-4054-af91-90e799956b65 req-77cc6134-c187-40c0-8c46-d8a3cab12241 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-changed-abe16ed0-6d62-41c1-8bfd-da97d9908143 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:47 user nova-compute[75378]: DEBUG nova.compute.manager [req-55133126-6e0d-4054-af91-90e799956b65 req-77cc6134-c187-40c0-8c46-d8a3cab12241 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Refreshing instance network info cache due to event network-changed-abe16ed0-6d62-41c1-8bfd-da97d9908143. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:45:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-55133126-6e0d-4054-af91-90e799956b65 req-77cc6134-c187-40c0-8c46-d8a3cab12241 service nova] Acquiring lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:45:49 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Updating instance_info_cache with network_info: [{"id": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "address": "fa:16:3e:bc:91:1f", "network": {"id": "1c13e251-154e-4521-9b3c-443bb29cc577", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071356817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ed92ed-0e", "ovs_interfaceid": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "address": "fa:16:3e:0d:b1:a6", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95465b85-15", "ovs_interfaceid": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "address": "fa:16:3e:b7:e8:0e", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd2d935-db", "ovs_interfaceid": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "address": "fa:16:3e:35:0f:09", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ba1a1-d2", "ovs_interfaceid": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2bab297-674f-41e7-baac-73eb91483899", "address": "fa:16:3e:b4:02:cf", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bab297-67", "ovs_interfaceid": "e2bab297-674f-41e7-baac-73eb91483899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2195503e-d6da-4598-9478-2956f48d2b8e", "address": "fa:16:3e:9c:68:a7", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2195503e-d6", "ovs_interfaceid": "2195503e-d6da-4598-9478-2956f48d2b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "address": "fa:16:3e:1f:60:09", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe16ed0-6d", "ovs_interfaceid": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:45:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Releasing lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:45:49 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Instance network_info: |[{"id": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "address": "fa:16:3e:bc:91:1f", "network": {"id": "1c13e251-154e-4521-9b3c-443bb29cc577", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071356817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ed92ed-0e", "ovs_interfaceid": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "address": "fa:16:3e:0d:b1:a6", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95465b85-15", "ovs_interfaceid": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "address": "fa:16:3e:b7:e8:0e", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd2d935-db", "ovs_interfaceid": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "address": "fa:16:3e:35:0f:09", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ba1a1-d2", "ovs_interfaceid": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2bab297-674f-41e7-baac-73eb91483899", "address": "fa:16:3e:b4:02:cf", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bab297-67", "ovs_interfaceid": "e2bab297-674f-41e7-baac-73eb91483899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2195503e-d6da-4598-9478-2956f48d2b8e", "address": "fa:16:3e:9c:68:a7", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2195503e-d6", "ovs_interfaceid": "2195503e-d6da-4598-9478-2956f48d2b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "address": "fa:16:3e:1f:60:09", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe16ed0-6d", "ovs_interfaceid": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:45:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-55133126-6e0d-4054-af91-90e799956b65 req-77cc6134-c187-40c0-8c46-d8a3cab12241 service nova] Acquired lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:45:49 user nova-compute[75378]: DEBUG nova.network.neutron [req-55133126-6e0d-4054-af91-90e799956b65 req-77cc6134-c187-40c0-8c46-d8a3cab12241 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Refreshing network info cache for port abe16ed0-6d62-41c1-8bfd-da97d9908143 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:45:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:49 user nova-compute[75378]: DEBUG nova.network.neutron [req-55133126-6e0d-4054-af91-90e799956b65 req-77cc6134-c187-40c0-8c46-d8a3cab12241 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Updated VIF entry in instance network info cache for port abe16ed0-6d62-41c1-8bfd-da97d9908143. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:45:49 user nova-compute[75378]: DEBUG nova.network.neutron [req-55133126-6e0d-4054-af91-90e799956b65 req-77cc6134-c187-40c0-8c46-d8a3cab12241 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Updating instance_info_cache with network_info: [{"id": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "address": "fa:16:3e:bc:91:1f", "network": {"id": "1c13e251-154e-4521-9b3c-443bb29cc577", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071356817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ed92ed-0e", "ovs_interfaceid": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "address": "fa:16:3e:0d:b1:a6", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95465b85-15", "ovs_interfaceid": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "address": "fa:16:3e:b7:e8:0e", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd2d935-db", "ovs_interfaceid": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "address": "fa:16:3e:35:0f:09", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ba1a1-d2", "ovs_interfaceid": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2bab297-674f-41e7-baac-73eb91483899", "address": "fa:16:3e:b4:02:cf", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bab297-67", "ovs_interfaceid": "e2bab297-674f-41e7-baac-73eb91483899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2195503e-d6da-4598-9478-2956f48d2b8e", "address": "fa:16:3e:9c:68:a7", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2195503e-d6", "ovs_interfaceid": "2195503e-d6da-4598-9478-2956f48d2b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "address": "fa:16:3e:1f:60:09", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe16ed0-6d", "ovs_interfaceid": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:45:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-55133126-6e0d-4054-af91-90e799956b65 req-77cc6134-c187-40c0-8c46-d8a3cab12241 service nova] Releasing lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:45:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "2c2acb48-972a-41d7-987e-48e79b3bef93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "2c2acb48-972a-41d7-987e-48e79b3bef93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:45:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:52 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:45:52 user nova-compute[75378]: INFO nova.compute.claims [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Claim successful on node user
Nov 09 03:45:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Acquiring lock "7e12539b-36a3-4691-89fd-e3d155de38d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:45:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:52 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:45:52 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:45:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:45:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.263s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:52 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:45:52 user nova-compute[75378]: INFO nova.compute.claims [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Claim successful on node user
Nov 09 03:45:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:45:52 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:45:52 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:45:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG nova.policy [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d4f0858695e4509a6b0ab99a8212571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548993d280024b60b3778b026177e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:45:53 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Creating image(s)
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "/opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "/opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.188s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG nova.network.neutron [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:45:53 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:45:53 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG nova.policy [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9e8d4eb00ea4ae5878183644245516f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21784a1d205749fd9a4459fe6605a481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.235s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:53 user nova-compute[75378]: INFO nova.virt.block_device [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Booting with volume b3426aa0-910f-4c33-80c6-b74e104bbb09 at /dev/vda
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk 1073741824" returned: 0 in 0.055s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG os_brick.utils [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[285211ae-3742-4493-a587-a91aa3887467]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab22dd9-ba18-4e6b-b9f9-d4ffc0fd939f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Successfully created port: 70d7d7ee-d1e8-4b8c-981b-26394c1b1edc {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5940897c-7ff1-4bba-9aa2-fbbd573bb856]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d25c83-e38f-40c8-89f8-93136766f43b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:45:53 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[02584fba-270c-41fa-a71d-58cc7ba4aa7f]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG os_brick.utils [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Updating existing volume attachment record: 6e0ff1cb-37ed-4ed0-8973-f8a4c53061df {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.296s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:45:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:45:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:45:54 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Cannot resize image /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:45:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:45:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Ensure instance console log exists: /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:45:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:54 user nova-compute[75378]: DEBUG nova.network.neutron [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Successfully created port: d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:45:54 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Successfully updated port: 70d7d7ee-d1e8-4b8c-981b-26394c1b1edc {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:45:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "refresh_cache-2c2acb48-972a-41d7-987e-48e79b3bef93" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:45:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquired lock "refresh_cache-2c2acb48-972a-41d7-987e-48e79b3bef93" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:45:54 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:45:54 user nova-compute[75378]: DEBUG nova.compute.manager [req-a1671ba8-5c86-4389-a67f-bae43413b1ec req-6c6989b0-817b-4b69-86ab-d519bedc275a service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Received event network-changed-70d7d7ee-d1e8-4b8c-981b-26394c1b1edc {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:54 user nova-compute[75378]: DEBUG nova.compute.manager [req-a1671ba8-5c86-4389-a67f-bae43413b1ec req-6c6989b0-817b-4b69-86ab-d519bedc275a service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Refreshing instance network info cache due to event network-changed-70d7d7ee-d1e8-4b8c-981b-26394c1b1edc. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:45:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a1671ba8-5c86-4389-a67f-bae43413b1ec req-6c6989b0-817b-4b69-86ab-d519bedc275a service nova] Acquiring lock "refresh_cache-2c2acb48-972a-41d7-987e-48e79b3bef93" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.network.neutron [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Successfully updated port: d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Acquiring lock "refresh_cache-7e12539b-36a3-4691-89fd-e3d155de38d7" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Acquired lock "refresh_cache-7e12539b-36a3-4691-89fd-e3d155de38d7" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.network.neutron [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-d64b370e-4bb0-43c0-9da1-ca9b84376609 req-538b635a-ee85-4329-ab7d-19f955d2664f service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Received event network-changed-d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-d64b370e-4bb0-43c0-9da1-ca9b84376609 req-538b635a-ee85-4329-ab7d-19f955d2664f service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Refreshing instance network info cache due to event network-changed-d0ea7419-ed5d-43af-86c6-57db8d9382e0. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d64b370e-4bb0-43c0-9da1-ca9b84376609 req-538b635a-ee85-4329-ab7d-19f955d2664f service nova] Acquiring lock "refresh_cache-7e12539b-36a3-4691-89fd-e3d155de38d7" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Updating instance_info_cache with network_info: [{"id": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "address": "fa:16:3e:02:bc:fb", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d7d7ee-d1", "ovs_interfaceid": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.network.neutron [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Releasing lock "refresh_cache-2c2acb48-972a-41d7-987e-48e79b3bef93" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Instance network_info: |[{"id": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "address": "fa:16:3e:02:bc:fb", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d7d7ee-d1", "ovs_interfaceid": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a1671ba8-5c86-4389-a67f-bae43413b1ec req-6c6989b0-817b-4b69-86ab-d519bedc275a service nova] Acquired lock "refresh_cache-2c2acb48-972a-41d7-987e-48e79b3bef93" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.network.neutron [req-a1671ba8-5c86-4389-a67f-bae43413b1ec req-6c6989b0-817b-4b69-86ab-d519bedc275a service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Refreshing network info cache for port 70d7d7ee-d1e8-4b8c-981b-26394c1b1edc {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Start _get_guest_xml network_info=[{"id": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "address": "fa:16:3e:02:bc:fb", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d7d7ee-d1", "ovs_interfaceid": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:45:55 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:45:55 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2036784727',display_name='tempest-ServerActionsTestOtherA-server-2036784727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2036784727',id=20,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFabS+mewwrg7oOEw/0EoMWlEwIz3NoSF6MUhLgvIEWjSZH9d/Fg8M+DuLJkZN6SKSXE9qeztuGxbDfpg7EHMNtmRvy2F5yoI+XGOsX3tR4ssTADXmphKv1NsnpmlrDrQg==',key_name='tempest-keypair-138130530',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548993d280024b60b3778b026177e356',ramdisk_id='',reservation_id='r-aei2sweo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2010465588',owner_user_name='tempest-ServerActionsTestOtherA-2010465588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d4f0858695e4509a6b0ab99a8212571',uuid=2c2acb48-972a-41d7-987e-48e79b3bef93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "address": "fa:16:3e:02:bc:fb", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d7d7ee-d1", "ovs_interfaceid": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converting VIF {"id": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "address": "fa:16:3e:02:bc:fb", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d7d7ee-d1", "ovs_interfaceid": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:bc:fb,bridge_name='br-int',has_traffic_filtering=True,id=70d7d7ee-d1e8-4b8c-981b-26394c1b1edc,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d7d7ee-d1') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c2acb48-972a-41d7-987e-48e79b3bef93 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:45:55 user nova-compute[75378]:   <uuid>2c2acb48-972a-41d7-987e-48e79b3bef93</uuid>
Nov 09 03:45:55 user nova-compute[75378]:   <name>instance-00000014</name>
Nov 09 03:45:55 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:45:55 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:45:55 user nova-compute[75378]:   <metadata>
Nov 09 03:45:55 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:45:55 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:45:55 user nova-compute[75378]:       <nova:name>tempest-ServerActionsTestOtherA-server-2036784727</nova:name>
Nov 09 03:45:55 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:45:55</nova:creationTime>
Nov 09 03:45:55 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:45:55 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:45:55 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:45:55 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:45:55 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:45:55 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:45:55 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:45:55 user nova-compute[75378]:       <nova:owner>
Nov 09 03:45:55 user nova-compute[75378]:         <nova:user uuid="5d4f0858695e4509a6b0ab99a8212571">tempest-ServerActionsTestOtherA-2010465588-project-member</nova:user>
Nov 09 03:45:55 user nova-compute[75378]:         <nova:project uuid="548993d280024b60b3778b026177e356">tempest-ServerActionsTestOtherA-2010465588</nova:project>
Nov 09 03:45:55 user nova-compute[75378]:       </nova:owner>
Nov 09 03:45:55 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:45:55 user nova-compute[75378]:       <nova:ports>
Nov 09 03:45:55 user nova-compute[75378]:         <nova:port uuid="70d7d7ee-d1e8-4b8c-981b-26394c1b1edc">
Nov 09 03:45:55 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 03:45:55 user nova-compute[75378]:         </nova:port>
Nov 09 03:45:55 user nova-compute[75378]:       </nova:ports>
Nov 09 03:45:55 user nova-compute[75378]:     </nova:instance>
Nov 09 03:45:55 user nova-compute[75378]:   </metadata>
Nov 09 03:45:55 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:45:55 user nova-compute[75378]:     <system>
Nov 09 03:45:55 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:45:55 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:45:55 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:45:55 user nova-compute[75378]:       <entry name="serial">2c2acb48-972a-41d7-987e-48e79b3bef93</entry>
Nov 09 03:45:55 user nova-compute[75378]:       <entry name="uuid">2c2acb48-972a-41d7-987e-48e79b3bef93</entry>
Nov 09 03:45:55 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:45:55 user nova-compute[75378]:     </system>
Nov 09 03:45:55 user nova-compute[75378]:   </sysinfo>
Nov 09 03:45:55 user nova-compute[75378]:   <os>
Nov 09 03:45:55 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:45:55 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:45:55 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:45:55 user nova-compute[75378]:   </os>
Nov 09 03:45:55 user nova-compute[75378]:   <features>
Nov 09 03:45:55 user nova-compute[75378]:     <acpi/>
Nov 09 03:45:55 user nova-compute[75378]:     <apic/>
Nov 09 03:45:55 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:45:55 user nova-compute[75378]:   </features>
Nov 09 03:45:55 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:45:55 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:45:55 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:45:55 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:45:55 user nova-compute[75378]:   </clock>
Nov 09 03:45:55 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:45:55 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:45:55 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:45:55 user nova-compute[75378]:   </cpu>
Nov 09 03:45:55 user nova-compute[75378]:   <devices>
Nov 09 03:45:55 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:45:55 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:45:55 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk"/>
Nov 09 03:45:55 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:45:55 user nova-compute[75378]:     </disk>
Nov 09 03:45:55 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:45:55 user nova-compute[75378]:       <mac address="fa:16:3e:02:bc:fb"/>
Nov 09 03:45:55 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:45:55 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:45:55 user nova-compute[75378]:       <target dev="tap70d7d7ee-d1"/>
Nov 09 03:45:55 user nova-compute[75378]:     </interface>
Nov 09 03:45:55 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:45:55 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/console.log" append="off"/>
Nov 09 03:45:55 user nova-compute[75378]:     </serial>
Nov 09 03:45:55 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:45:55 user nova-compute[75378]:     <video>
Nov 09 03:45:55 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:45:55 user nova-compute[75378]:     </video>
Nov 09 03:45:55 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:45:55 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:45:55 user nova-compute[75378]:     </rng>
Nov 09 03:45:55 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:45:55 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:45:55 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:45:55 user nova-compute[75378]:     </memballoon>
Nov 09 03:45:55 user nova-compute[75378]:   </devices>
Nov 09 03:45:55 user nova-compute[75378]: </domain>
Nov 09 03:45:55 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2036784727',display_name='tempest-ServerActionsTestOtherA-server-2036784727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2036784727',id=20,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFabS+mewwrg7oOEw/0EoMWlEwIz3NoSF6MUhLgvIEWjSZH9d/Fg8M+DuLJkZN6SKSXE9qeztuGxbDfpg7EHMNtmRvy2F5yoI+XGOsX3tR4ssTADXmphKv1NsnpmlrDrQg==',key_name='tempest-keypair-138130530',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548993d280024b60b3778b026177e356',ramdisk_id='',reservation_id='r-aei2sweo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2010465588',owner_user_name='tempest-ServerActionsTestOtherA-2010465588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d4f0858695e4509a6b0ab99a8212571',uuid=2c2acb48-972a-41d7-987e-48e79b3bef93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "address": "fa:16:3e:02:bc:fb", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d7d7ee-d1", "ovs_interfaceid": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converting VIF {"id": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "address": "fa:16:3e:02:bc:fb", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d7d7ee-d1", "ovs_interfaceid": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:bc:fb,bridge_name='br-int',has_traffic_filtering=True,id=70d7d7ee-d1e8-4b8c-981b-26394c1b1edc,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d7d7ee-d1') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG os_vif [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:bc:fb,bridge_name='br-int',has_traffic_filtering=True,id=70d7d7ee-d1e8-4b8c-981b-26394c1b1edc,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d7d7ee-d1') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a13d00ee-484e-50db-9f65-b67023c1ef55', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70d7d7ee-d1, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70d7d7ee-d1, col_values=(('qos', UUID('f5ad3942-2cf3-41d2-9724-6986e3d79b5a')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70d7d7ee-d1, col_values=(('external_ids', {'iface-id': '70d7d7ee-d1e8-4b8c-981b-26394c1b1edc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:bc:fb', 'vm-uuid': '2c2acb48-972a-41d7-987e-48e79b3bef93'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:55 user nova-compute[75378]: INFO os_vif [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:bc:fb,bridge_name='br-int',has_traffic_filtering=True,id=70d7d7ee-d1e8-4b8c-981b-26394c1b1edc,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d7d7ee-d1')
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] No VIF found with MAC fa:16:3e:02:bc:fb, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.network.neutron [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Updating instance_info_cache with network_info: [{"id": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "address": "fa:16:3e:3e:8c:6a", "network": {"id": "ba3f17d0-18fb-4a96-a48a-ea93768ee358", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1139879701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21784a1d205749fd9a4459fe6605a481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7419-ed", "ovs_interfaceid": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Releasing lock "refresh_cache-7e12539b-36a3-4691-89fd-e3d155de38d7" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Instance network_info: |[{"id": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "address": "fa:16:3e:3e:8c:6a", "network": {"id": "ba3f17d0-18fb-4a96-a48a-ea93768ee358", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1139879701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21784a1d205749fd9a4459fe6605a481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7419-ed", "ovs_interfaceid": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d64b370e-4bb0-43c0-9da1-ca9b84376609 req-538b635a-ee85-4329-ab7d-19f955d2664f service nova] Acquired lock "refresh_cache-7e12539b-36a3-4691-89fd-e3d155de38d7" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.network.neutron [req-d64b370e-4bb0-43c0-9da1-ca9b84376609 req-538b635a-ee85-4329-ab7d-19f955d2664f service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Refreshing network info cache for port d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.network.neutron [req-a1671ba8-5c86-4389-a67f-bae43413b1ec req-6c6989b0-817b-4b69-86ab-d519bedc275a service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Updated VIF entry in instance network info cache for port 70d7d7ee-d1e8-4b8c-981b-26394c1b1edc. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG nova.network.neutron [req-a1671ba8-5c86-4389-a67f-bae43413b1ec req-6c6989b0-817b-4b69-86ab-d519bedc275a service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Updating instance_info_cache with network_info: [{"id": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "address": "fa:16:3e:02:bc:fb", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d7d7ee-d1", "ovs_interfaceid": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:45:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a1671ba8-5c86-4389-a67f-bae43413b1ec req-6c6989b0-817b-4b69-86ab-d519bedc275a service nova] Releasing lock "refresh_cache-2c2acb48-972a-41d7-987e-48e79b3bef93" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:45:56 user nova-compute[75378]: DEBUG nova.network.neutron [req-d64b370e-4bb0-43c0-9da1-ca9b84376609 req-538b635a-ee85-4329-ab7d-19f955d2664f service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Updated VIF entry in instance network info cache for port d0ea7419-ed5d-43af-86c6-57db8d9382e0. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:45:56 user nova-compute[75378]: DEBUG nova.network.neutron [req-d64b370e-4bb0-43c0-9da1-ca9b84376609 req-538b635a-ee85-4329-ab7d-19f955d2664f service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Updating instance_info_cache with network_info: [{"id": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "address": "fa:16:3e:3e:8c:6a", "network": {"id": "ba3f17d0-18fb-4a96-a48a-ea93768ee358", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1139879701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21784a1d205749fd9a4459fe6605a481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7419-ed", "ovs_interfaceid": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:45:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d64b370e-4bb0-43c0-9da1-ca9b84376609 req-538b635a-ee85-4329-ab7d-19f955d2664f service nova] Releasing lock "refresh_cache-7e12539b-36a3-4691-89fd-e3d155de38d7" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:45:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:57 user nova-compute[75378]: DEBUG nova.compute.manager [req-16e6a74c-1543-40b9-b2bc-5b26c662f235 req-3acbf4fc-d3cd-4647-818d-f44c97e57cc8 service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Received event network-vif-plugged-70d7d7ee-d1e8-4b8c-981b-26394c1b1edc {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-16e6a74c-1543-40b9-b2bc-5b26c662f235 req-3acbf4fc-d3cd-4647-818d-f44c97e57cc8 service nova] Acquiring lock "2c2acb48-972a-41d7-987e-48e79b3bef93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-16e6a74c-1543-40b9-b2bc-5b26c662f235 req-3acbf4fc-d3cd-4647-818d-f44c97e57cc8 service nova] Lock "2c2acb48-972a-41d7-987e-48e79b3bef93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-16e6a74c-1543-40b9-b2bc-5b26c662f235 req-3acbf4fc-d3cd-4647-818d-f44c97e57cc8 service nova] Lock "2c2acb48-972a-41d7-987e-48e79b3bef93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:57 user nova-compute[75378]: DEBUG nova.compute.manager [req-16e6a74c-1543-40b9-b2bc-5b26c662f235 req-3acbf4fc-d3cd-4647-818d-f44c97e57cc8 service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] No waiting events found dispatching network-vif-plugged-70d7d7ee-d1e8-4b8c-981b-26394c1b1edc {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:45:57 user nova-compute[75378]: WARNING nova.compute.manager [req-16e6a74c-1543-40b9-b2bc-5b26c662f235 req-3acbf4fc-d3cd-4647-818d-f44c97e57cc8 service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Received unexpected event network-vif-plugged-70d7d7ee-d1e8-4b8c-981b-26394c1b1edc for instance with vm_state building and task_state spawning.
Nov 09 03:45:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:45:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-99d59fc8-f50e-4740-9946-97c84002b30f req-66c38d5e-e66d-4e5a-910d-05bafe573bf4 service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Received event network-vif-plugged-70d7d7ee-d1e8-4b8c-981b-26394c1b1edc {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:45:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-99d59fc8-f50e-4740-9946-97c84002b30f req-66c38d5e-e66d-4e5a-910d-05bafe573bf4 service nova] Acquiring lock "2c2acb48-972a-41d7-987e-48e79b3bef93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:45:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-99d59fc8-f50e-4740-9946-97c84002b30f req-66c38d5e-e66d-4e5a-910d-05bafe573bf4 service nova] Lock "2c2acb48-972a-41d7-987e-48e79b3bef93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:45:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-99d59fc8-f50e-4740-9946-97c84002b30f req-66c38d5e-e66d-4e5a-910d-05bafe573bf4 service nova] Lock "2c2acb48-972a-41d7-987e-48e79b3bef93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:45:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-99d59fc8-f50e-4740-9946-97c84002b30f req-66c38d5e-e66d-4e5a-910d-05bafe573bf4 service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] No waiting events found dispatching network-vif-plugged-70d7d7ee-d1e8-4b8c-981b-26394c1b1edc {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:45:59 user nova-compute[75378]: WARNING nova.compute.manager [req-99d59fc8-f50e-4740-9946-97c84002b30f req-66c38d5e-e66d-4e5a-910d-05bafe573bf4 service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Received unexpected event network-vif-plugged-70d7d7ee-d1e8-4b8c-981b-26394c1b1edc for instance with vm_state building and task_state spawning.
Nov 09 03:45:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:45:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:45:59 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Instance spawned successfully.
Nov 09 03:45:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:45:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:45:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:45:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:45:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:45:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:45:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:46:00 user nova-compute[75378]: INFO nova.compute.manager [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Took 6.89 seconds to spawn the instance on the hypervisor.
Nov 09 03:46:00 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:46:00 user nova-compute[75378]: INFO nova.compute.manager [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Took 7.75 seconds to build instance.
Nov 09 03:46:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae5c966a-12db-47b1-a7fe-53c1cddf55bd tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "2c2acb48-972a-41d7-987e-48e79b3bef93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.877s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:46:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:02 user nova-compute[75378]: INFO nova.virt.block_device [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Booting with volume 272d88bd-3b32-432e-b625-96fb7c66f6a8 at /dev/vdb
Nov 09 03:46:02 user nova-compute[75378]: DEBUG os_brick.utils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:46:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2446a3-f275-4b85-ad01-4518cf56c71b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[df747a1b-8944-4264-859d-b28b25b24ef8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8c5fe9-866e-41c7-acb7-af9fc367024a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c8b246-1c20-478a-94aa-339004cfbde4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:46:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:46:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:46:02 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:46:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[951cd523-1fe1-489f-ac95-7dc4036c179c]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:46:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:46:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:46:02 user nova-compute[75378]: DEBUG os_brick.utils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:46:02 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Updating existing volume attachment record: e1e1cb4c-49d1-4eb1-b59e-815082a5eb4f {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:46:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "013db901-fbee-4593-a14f-95a03e79fad0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:46:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "013db901-fbee-4593-a14f-95a03e79fad0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:46:12 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:46:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:46:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:46:12 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:46:12 user nova-compute[75378]: INFO nova.compute.claims [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Claim successful on node user
Nov 09 03:46:13 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:46:13 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:46:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:46:13 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:46:13 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:46:13 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:46:13 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:46:13 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:46:13 user nova-compute[75378]: DEBUG nova.policy [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57efcfeacd7f4daf916e7dd04e11d8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2176531ffa4cf7bec818309e39ab8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:46:13 user nova-compute[75378]: INFO nova.virt.block_device [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Booting with blank volume at /dev/vda
Nov 09 03:46:14 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Successfully created port: 5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:46:15 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Successfully updated port: 5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:46:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "refresh_cache-013db901-fbee-4593-a14f-95a03e79fad0" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:46:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquired lock "refresh_cache-013db901-fbee-4593-a14f-95a03e79fad0" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:46:15 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:46:15 user nova-compute[75378]: DEBUG nova.compute.manager [req-f7df7a14-d251-4043-98e0-8003c0f5782b req-e0c6cb46-bb5f-4528-b069-992a8d5db456 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received event network-changed-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:46:15 user nova-compute[75378]: DEBUG nova.compute.manager [req-f7df7a14-d251-4043-98e0-8003c0f5782b req-e0c6cb46-bb5f-4528-b069-992a8d5db456 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Refreshing instance network info cache due to event network-changed-5650a4a6-f99d-42e2-8b94-f18562892154. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:46:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f7df7a14-d251-4043-98e0-8003c0f5782b req-e0c6cb46-bb5f-4528-b069-992a8d5db456 service nova] Acquiring lock "refresh_cache-013db901-fbee-4593-a14f-95a03e79fad0" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:46:15 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:46:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:46:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:46:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 03:46:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:46:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:46:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:15 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Updating instance_info_cache with network_info: [{"id": "5650a4a6-f99d-42e2-8b94-f18562892154", "address": "fa:16:3e:7f:95:df", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5650a4a6-f9", "ovs_interfaceid": "5650a4a6-f99d-42e2-8b94-f18562892154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:46:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Releasing lock "refresh_cache-013db901-fbee-4593-a14f-95a03e79fad0" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:46:15 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Instance network_info: |[{"id": "5650a4a6-f99d-42e2-8b94-f18562892154", "address": "fa:16:3e:7f:95:df", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5650a4a6-f9", "ovs_interfaceid": "5650a4a6-f99d-42e2-8b94-f18562892154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:46:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f7df7a14-d251-4043-98e0-8003c0f5782b req-e0c6cb46-bb5f-4528-b069-992a8d5db456 service nova] Acquired lock "refresh_cache-013db901-fbee-4593-a14f-95a03e79fad0" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:46:15 user nova-compute[75378]: DEBUG nova.network.neutron [req-f7df7a14-d251-4043-98e0-8003c0f5782b req-e0c6cb46-bb5f-4528-b069-992a8d5db456 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Refreshing network info cache for port 5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:46:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:16 user nova-compute[75378]: DEBUG nova.network.neutron [req-f7df7a14-d251-4043-98e0-8003c0f5782b req-e0c6cb46-bb5f-4528-b069-992a8d5db456 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Updated VIF entry in instance network info cache for port 5650a4a6-f99d-42e2-8b94-f18562892154. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:46:16 user nova-compute[75378]: DEBUG nova.network.neutron [req-f7df7a14-d251-4043-98e0-8003c0f5782b req-e0c6cb46-bb5f-4528-b069-992a8d5db456 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Updating instance_info_cache with network_info: [{"id": "5650a4a6-f99d-42e2-8b94-f18562892154", "address": "fa:16:3e:7f:95:df", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5650a4a6-f9", "ovs_interfaceid": "5650a4a6-f99d-42e2-8b94-f18562892154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:46:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f7df7a14-d251-4043-98e0-8003c0f5782b req-e0c6cb46-bb5f-4528-b069-992a8d5db456 service nova] Releasing lock "refresh_cache-013db901-fbee-4593-a14f-95a03e79fad0" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:46:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:46:22 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Creating image(s)
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Did not create local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Ensure instance console log exists: /opt/stack/data/nova/instances/7e12539b-36a3-4691-89fd-e3d155de38d7/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Start _get_guest_xml network_info=[{"id": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "address": "fa:16:3e:3e:8c:6a", "network": {"id": "ba3f17d0-18fb-4a96-a48a-ea93768ee358", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1139879701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21784a1d205749fd9a4459fe6605a481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7419-ed", "ovs_interfaceid": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpOStwFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7e12539b-36a3-4691-89fd-e3d155de38d7', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3426aa0-910f-4c33-80c6-b74e104bbb09', 'serial': 'b3426aa0-910f-4c33-80c6-b74e104bbb09'}, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': '6e0ff1cb-37ed-4ed0-8973-f8a4c53061df', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:46:22 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:46:22 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpOStwFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:46:22 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:46:22 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:46:22 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[65556b2e-6e05-4760-9903-6e422703f8df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:46:22 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5db1838-7f34-46f8-b22f-1fc10717e5a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09] added
Nov 09 03:46:22 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[639330b4-9c38-48c5-9b56-74ca60c4f314]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db7833d-c4b6-4969-9eb5-483ef85090ab]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BpOStwFd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BpOStwFd" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[01eb5a69-16f3-4c75-b40b-3bde7dfc590a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BpOStwFd'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad7679f-73c7-4647-8a9d-631c0df5b554]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2112749-6bbe-404c-bf60-8c3b2d66196f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 03:46:22 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 03:46:22 user nova-compute[75378]:  {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:46:22 user nova-compute[75378]: WARNING os_brick.initiator.connectors.iscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 03:46:22 user nova-compute[75378]: 
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e400a45-daf6-4515-9740-ecabc23199c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09, portal: 172.16.0.220,3260]
Nov 09 03:46:22 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09, portal: 172.16.0.220,3260] successful.
Nov 09 03:46:22 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7835e2-6409-4261-8908-e3c821eec74c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3b196e-cb9e-49fa-b50c-7f105bb01620]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:46:22 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:46:22 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[78050b98-43ce-42c3-8a4f-7b6fbfd38b66]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpOStwFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:46:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26430646635353133', 'path': '/dev/sdb'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430646635353133', 'path': '/dev/sdb'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-630224360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-630224360',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOf5txPg6ouZaGGPli9fXk7MU4joWJGx02BisK3zQA1UKJLHy2CmfWE/XCnKG3U7ArzcfKvhfDz+mZTrfgm201boyTYwnA7PPwqn4OBn8OrHRJiyu0bpUTMNWI1J7qAdA==',key_name='tempest-keypair-1307438617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21784a1d205749fd9a4459fe6605a481',ramdisk_id='',reservation_id='r-6evkz0hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1531549411',owner_user_name='tempest-ServerActionsV293TestJSON-1531549411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9e8d4eb00ea4ae5878183644245516f',uuid=7e12539b-36a3-4691-89fd-e3d155de38d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "address": "fa:16:3e:3e:8c:6a", "network": {"id": "ba3f17d0-18fb-4a96-a48a-ea93768ee358", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1139879701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21784a1d205749fd9a4459fe6605a481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7419-ed", "ovs_interfaceid": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Converting VIF {"id": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "address": "fa:16:3e:3e:8c:6a", "network": {"id": "ba3f17d0-18fb-4a96-a48a-ea93768ee358", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1139879701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21784a1d205749fd9a4459fe6605a481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7419-ed", "ovs_interfaceid": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8c:6a,bridge_name='br-int',has_traffic_filtering=True,id=d0ea7419-ed5d-43af-86c6-57db8d9382e0,network=Network(ba3f17d0-18fb-4a96-a48a-ea93768ee358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea7419-ed') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG nova.objects.instance [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e12539b-36a3-4691-89fd-e3d155de38d7 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:46:23 user nova-compute[75378]:   <uuid>7e12539b-36a3-4691-89fd-e3d155de38d7</uuid>
Nov 09 03:46:23 user nova-compute[75378]:   <name>instance-00000015</name>
Nov 09 03:46:23 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:46:23 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:46:23 user nova-compute[75378]:   <metadata>
Nov 09 03:46:23 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:46:23 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:46:23 user nova-compute[75378]:       <nova:name>tempest-ServerActionsV293TestJSON-server-630224360</nova:name>
Nov 09 03:46:23 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:46:22</nova:creationTime>
Nov 09 03:46:23 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:46:23 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:46:23 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:46:23 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:46:23 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:46:23 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:46:23 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:46:23 user nova-compute[75378]:       <nova:owner>
Nov 09 03:46:23 user nova-compute[75378]:         <nova:user uuid="d9e8d4eb00ea4ae5878183644245516f">tempest-ServerActionsV293TestJSON-1531549411-project-member</nova:user>
Nov 09 03:46:23 user nova-compute[75378]:         <nova:project uuid="21784a1d205749fd9a4459fe6605a481">tempest-ServerActionsV293TestJSON-1531549411</nova:project>
Nov 09 03:46:23 user nova-compute[75378]:       </nova:owner>
Nov 09 03:46:23 user nova-compute[75378]:       <nova:ports>
Nov 09 03:46:23 user nova-compute[75378]:         <nova:port uuid="d0ea7419-ed5d-43af-86c6-57db8d9382e0">
Nov 09 03:46:23 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 09 03:46:23 user nova-compute[75378]:         </nova:port>
Nov 09 03:46:23 user nova-compute[75378]:       </nova:ports>
Nov 09 03:46:23 user nova-compute[75378]:     </nova:instance>
Nov 09 03:46:23 user nova-compute[75378]:   </metadata>
Nov 09 03:46:23 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:46:23 user nova-compute[75378]:     <system>
Nov 09 03:46:23 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:46:23 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:46:23 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:46:23 user nova-compute[75378]:       <entry name="serial">7e12539b-36a3-4691-89fd-e3d155de38d7</entry>
Nov 09 03:46:23 user nova-compute[75378]:       <entry name="uuid">7e12539b-36a3-4691-89fd-e3d155de38d7</entry>
Nov 09 03:46:23 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:46:23 user nova-compute[75378]:     </system>
Nov 09 03:46:23 user nova-compute[75378]:   </sysinfo>
Nov 09 03:46:23 user nova-compute[75378]:   <os>
Nov 09 03:46:23 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:46:23 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:46:23 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:46:23 user nova-compute[75378]:   </os>
Nov 09 03:46:23 user nova-compute[75378]:   <features>
Nov 09 03:46:23 user nova-compute[75378]:     <acpi/>
Nov 09 03:46:23 user nova-compute[75378]:     <apic/>
Nov 09 03:46:23 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:46:23 user nova-compute[75378]:   </features>
Nov 09 03:46:23 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:46:23 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:46:23 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:46:23 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:46:23 user nova-compute[75378]:   </clock>
Nov 09 03:46:23 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:46:23 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:46:23 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:46:23 user nova-compute[75378]:   </cpu>
Nov 09 03:46:23 user nova-compute[75378]:   <devices>
Nov 09 03:46:23 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 03:46:23 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:46:23 user nova-compute[75378]:       <source dev="/dev/sdb"/>
Nov 09 03:46:23 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:46:23 user nova-compute[75378]:       <serial>b3426aa0-910f-4c33-80c6-b74e104bbb09</serial>
Nov 09 03:46:23 user nova-compute[75378]:     </disk>
Nov 09 03:46:23 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:46:23 user nova-compute[75378]:       <mac address="fa:16:3e:3e:8c:6a"/>
Nov 09 03:46:23 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:46:23 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:46:23 user nova-compute[75378]:       <target dev="tapd0ea7419-ed"/>
Nov 09 03:46:23 user nova-compute[75378]:     </interface>
Nov 09 03:46:23 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:46:23 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/7e12539b-36a3-4691-89fd-e3d155de38d7/console.log" append="off"/>
Nov 09 03:46:23 user nova-compute[75378]:     </serial>
Nov 09 03:46:23 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:46:23 user nova-compute[75378]:     <video>
Nov 09 03:46:23 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:46:23 user nova-compute[75378]:     </video>
Nov 09 03:46:23 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:46:23 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:46:23 user nova-compute[75378]:     </rng>
Nov 09 03:46:23 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:46:23 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:46:23 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:46:23 user nova-compute[75378]:     </memballoon>
Nov 09 03:46:23 user nova-compute[75378]:   </devices>
Nov 09 03:46:23 user nova-compute[75378]: </domain>
Nov 09 03:46:23 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-630224360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-630224360',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOf5txPg6ouZaGGPli9fXk7MU4joWJGx02BisK3zQA1UKJLHy2CmfWE/XCnKG3U7ArzcfKvhfDz+mZTrfgm201boyTYwnA7PPwqn4OBn8OrHRJiyu0bpUTMNWI1J7qAdA==',key_name='tempest-keypair-1307438617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21784a1d205749fd9a4459fe6605a481',ramdisk_id='',reservation_id='r-6evkz0hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1531549411',owner_user_name='tempest-ServerActionsV293TestJSON-1531549411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9e8d4eb00ea4ae5878183644245516f',uuid=7e12539b-36a3-4691-89fd-e3d155de38d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "address": "fa:16:3e:3e:8c:6a", "network": {"id": "ba3f17d0-18fb-4a96-a48a-ea93768ee358", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1139879701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21784a1d205749fd9a4459fe6605a481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7419-ed", "ovs_interfaceid": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Converting VIF {"id": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "address": "fa:16:3e:3e:8c:6a", "network": {"id": "ba3f17d0-18fb-4a96-a48a-ea93768ee358", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1139879701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21784a1d205749fd9a4459fe6605a481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7419-ed", "ovs_interfaceid": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8c:6a,bridge_name='br-int',has_traffic_filtering=True,id=d0ea7419-ed5d-43af-86c6-57db8d9382e0,network=Network(ba3f17d0-18fb-4a96-a48a-ea93768ee358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea7419-ed') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG os_vif [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8c:6a,bridge_name='br-int',has_traffic_filtering=True,id=d0ea7419-ed5d-43af-86c6-57db8d9382e0,network=Network(ba3f17d0-18fb-4a96-a48a-ea93768ee358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea7419-ed') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5cb004b1-632b-5792-b533-83b63688ae7f', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0ea7419-ed, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0ea7419-ed, col_values=(('qos', UUID('b772c363-a5b2-495d-a6c4-95f157685387')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0ea7419-ed, col_values=(('external_ids', {'iface-id': 'd0ea7419-ed5d-43af-86c6-57db8d9382e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:8c:6a', 'vm-uuid': '7e12539b-36a3-4691-89fd-e3d155de38d7'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:23 user nova-compute[75378]: INFO os_vif [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8c:6a,bridge_name='br-int',has_traffic_filtering=True,id=d0ea7419-ed5d-43af-86c6-57db8d9382e0,network=Network(ba3f17d0-18fb-4a96-a48a-ea93768ee358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea7419-ed')
Nov 09 03:46:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:46:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] No VIF found with MAC fa:16:3e:3e:8c:6a, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG os_brick.utils [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3888e1d1-0f79-4725-873a-31e3cd066e0e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[325c0925-364b-4bef-b162-882bf1926f77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34c1e9f-330c-444a-b274-3b055efe75fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b538c73d-37f2-4ba6-a7b9-09f42729ccf5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:46:24 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:46:24 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0eb6b5-f030-4a44-9736-c8acf76d022d]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG os_brick.utils [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:46:24 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Updating existing volume attachment record: e906c831-cd64-4184-8b39-76da3dcf8563 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:46:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-9e15261b-9f6d-4e7d-866f-79fcd9a94c17 req-0d47bfff-a787-4eba-a37c-cab05c454eef service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Received event network-vif-plugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:46:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9e15261b-9f6d-4e7d-866f-79fcd9a94c17 req-0d47bfff-a787-4eba-a37c-cab05c454eef service nova] Acquiring lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:46:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9e15261b-9f6d-4e7d-866f-79fcd9a94c17 req-0d47bfff-a787-4eba-a37c-cab05c454eef service nova] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:46:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9e15261b-9f6d-4e7d-866f-79fcd9a94c17 req-0d47bfff-a787-4eba-a37c-cab05c454eef service nova] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:46:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-9e15261b-9f6d-4e7d-866f-79fcd9a94c17 req-0d47bfff-a787-4eba-a37c-cab05c454eef service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] No waiting events found dispatching network-vif-plugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:46:25 user nova-compute[75378]: WARNING nova.compute.manager [req-9e15261b-9f6d-4e7d-866f-79fcd9a94c17 req-0d47bfff-a787-4eba-a37c-cab05c454eef service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Received unexpected event network-vif-plugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 for instance with vm_state building and task_state spawning.
Nov 09 03:46:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:26 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:46:26 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-7d051405-6b57-4db2-9533-c2f4e87134d8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-7d051405-6b57-4db2-9533-c2f4e87134d8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:46:27 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Instance spawned successfully.
Nov 09 03:46:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-0f8872b5-ab93-44a8-90ab-040cf971fa0e req-fc60f3dc-b713-4b27-b47b-21e1ab39aad2 service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Received event network-vif-plugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0f8872b5-ab93-44a8-90ab-040cf971fa0e req-fc60f3dc-b713-4b27-b47b-21e1ab39aad2 service nova] Acquiring lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0f8872b5-ab93-44a8-90ab-040cf971fa0e req-fc60f3dc-b713-4b27-b47b-21e1ab39aad2 service nova] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0f8872b5-ab93-44a8-90ab-040cf971fa0e req-fc60f3dc-b713-4b27-b47b-21e1ab39aad2 service nova] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-0f8872b5-ab93-44a8-90ab-040cf971fa0e req-fc60f3dc-b713-4b27-b47b-21e1ab39aad2 service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] No waiting events found dispatching network-vif-plugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:46:27 user nova-compute[75378]: WARNING nova.compute.manager [req-0f8872b5-ab93-44a8-90ab-040cf971fa0e req-fc60f3dc-b713-4b27-b47b-21e1ab39aad2 service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Received unexpected event network-vif-plugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 for instance with vm_state building and task_state spawning.
Nov 09 03:46:27 user nova-compute[75378]: INFO nova.compute.manager [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 09 03:46:27 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:46:27 user nova-compute[75378]: INFO nova.compute.manager [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Took 35.17 seconds to build instance.
Nov 09 03:46:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4d6f9c9f-2340-4839-b957-75701bfc0728 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.288s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Updating instance_info_cache with network_info: [{"id": "90598abb-8896-4b67-9871-b78f46b1fdfe", "address": "fa:16:3e:ed:1b:d3", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90598abb-88", "ovs_interfaceid": "90598abb-8896-4b67-9871-b78f46b1fdfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-7d051405-6b57-4db2-9533-c2f4e87134d8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 03:46:27 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:46:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:29 user nova-compute[75378]: INFO nova.virt.block_device [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Booting with volume eb2e5acb-e73c-45dc-9cb5-31e6489d682d at /dev/vdc
Nov 09 03:46:29 user nova-compute[75378]: DEBUG os_brick.utils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:46:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:29 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d7acbd-9eef-4a0f-9103-c1e86264561f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:29 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91dc92b-5d94-40a0-8aa8-540fc3441702]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:29 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9aa951d-9768-4639-a47f-72bb24f51caa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:29 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[182f7c31-54f0-4d5f-9c4a-813644d3aa96]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:46:29 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:46:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:46:29 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:46:29 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4553244f-a120-425e-b604-e4cfdad7e39c]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:29 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:46:29 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:46:29 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:46:29 user nova-compute[75378]: DEBUG os_brick.utils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:46:29 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Updating existing volume attachment record: c5e69790-12ce-4e89-9c7f-7b56bc51ebd8 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:46:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "06216917-d7d1-4fd4-a311-e054437e84a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:46:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "06216917-d7d1-4fd4-a311-e054437e84a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:46:30 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:46:30 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:46:30 user nova-compute[75378]: DEBUG nova.compute.manager [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:46:30 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:46:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:46:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:46:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:46:30 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:46:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:46:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:46:30 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:46:30 user nova-compute[75378]: INFO nova.compute.claims [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Claim successful on node user
Nov 09 03:46:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:30 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:46:30 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:46:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.628s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:46:30 user nova-compute[75378]: DEBUG nova.compute.manager [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG nova.compute.manager [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG nova.network.neutron [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:31 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:46:31 user nova-compute[75378]: DEBUG nova.compute.manager [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG nova.policy [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b74e4631d102431f83fe51fc39a3768a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02ac142a06244ef9819e09b22e4a941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG nova.compute.manager [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:46:31 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Creating image(s)
Nov 09 03:46:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "/opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "/opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "/opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "95d1604518a003fe86603e461a25fba6eadd5aed" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "95d1604518a003fe86603e461a25fba6eadd5aed" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d1604518a003fe86603e461a25fba6eadd5aed.part --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.510s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG nova.network.neutron [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Successfully created port: f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d1604518a003fe86603e461a25fba6eadd5aed.part --force-share --output=json" returned: 0 in 0.189s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG nova.virt.images [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] fe7e0145-3989-490e-8549-fd04c87b1bbf was qcow2, converting to raw {{(pid=75378) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG nova.privsep.utils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75378) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 03:46:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/95d1604518a003fe86603e461a25fba6eadd5aed.part /opt/stack/data/nova/instances/_base/95d1604518a003fe86603e461a25fba6eadd5aed.converted {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/95d1604518a003fe86603e461a25fba6eadd5aed.part /opt/stack/data/nova/instances/_base/95d1604518a003fe86603e461a25fba6eadd5aed.converted" returned: 0 in 0.183s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d1604518a003fe86603e461a25fba6eadd5aed.converted --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d1604518a003fe86603e461a25fba6eadd5aed.converted --force-share --output=json" returned: 0 in 0.219s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "95d1604518a003fe86603e461a25fba6eadd5aed" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.104s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d1604518a003fe86603e461a25fba6eadd5aed --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d1604518a003fe86603e461a25fba6eadd5aed --force-share --output=json" returned: 0 in 0.253s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "95d1604518a003fe86603e461a25fba6eadd5aed" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "95d1604518a003fe86603e461a25fba6eadd5aed" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d1604518a003fe86603e461a25fba6eadd5aed --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG nova.network.neutron [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Successfully updated port: f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG nova.compute.manager [req-f1b10948-e48f-4f43-9d40-872fbc9c1b21 req-d64c36eb-aa7a-4adf-bb41-9f0a23aa5c87 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Received event network-changed-f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG nova.compute.manager [req-f1b10948-e48f-4f43-9d40-872fbc9c1b21 req-d64c36eb-aa7a-4adf-bb41-9f0a23aa5c87 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Refreshing instance network info cache due to event network-changed-f18d71ff-8728-41e9-82bf-3d66e09e552a. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f1b10948-e48f-4f43-9d40-872fbc9c1b21 req-d64c36eb-aa7a-4adf-bb41-9f0a23aa5c87 service nova] Acquiring lock "refresh_cache-06216917-d7d1-4fd4-a311-e054437e84a6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f1b10948-e48f-4f43-9d40-872fbc9c1b21 req-d64c36eb-aa7a-4adf-bb41-9f0a23aa5c87 service nova] Acquired lock "refresh_cache-06216917-d7d1-4fd4-a311-e054437e84a6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG nova.network.neutron [req-f1b10948-e48f-4f43-9d40-872fbc9c1b21 req-d64c36eb-aa7a-4adf-bb41-9f0a23aa5c87 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Refreshing network info cache for port f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "refresh_cache-06216917-d7d1-4fd4-a311-e054437e84a6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG nova.network.neutron [req-f1b10948-e48f-4f43-9d40-872fbc9c1b21 req-d64c36eb-aa7a-4adf-bb41-9f0a23aa5c87 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d1604518a003fe86603e461a25fba6eadd5aed --force-share --output=json" returned: 0 in 0.218s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d1604518a003fe86603e461a25fba6eadd5aed,backing_fmt=raw /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d1604518a003fe86603e461a25fba6eadd5aed,backing_fmt=raw /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk 1073741824" returned: 0 in 0.058s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "95d1604518a003fe86603e461a25fba6eadd5aed" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:46:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d1604518a003fe86603e461a25fba6eadd5aed --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.network.neutron [req-f1b10948-e48f-4f43-9d40-872fbc9c1b21 req-d64c36eb-aa7a-4adf-bb41-9f0a23aa5c87 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f1b10948-e48f-4f43-9d40-872fbc9c1b21 req-d64c36eb-aa7a-4adf-bb41-9f0a23aa5c87 service nova] Releasing lock "refresh_cache-06216917-d7d1-4fd4-a311-e054437e84a6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquired lock "refresh_cache-06216917-d7d1-4fd4-a311-e054437e84a6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.network.neutron [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d1604518a003fe86603e461a25fba6eadd5aed --force-share --output=json" returned: 0 in 0.201s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.network.neutron [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Cannot resize image /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Ensure instance console log exists: /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.network.neutron [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Updating instance_info_cache with network_info: [{"id": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "address": "fa:16:3e:a8:c1:72", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d71ff-87", "ovs_interfaceid": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Releasing lock "refresh_cache-06216917-d7d1-4fd4-a311-e054437e84a6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.compute.manager [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Instance network_info: |[{"id": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "address": "fa:16:3e:a8:c1:72", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d71ff-87", "ovs_interfaceid": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Start _get_guest_xml network_info=[{"id": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "address": "fa:16:3e:a8:c1:72", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d71ff-87", "ovs_interfaceid": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:46:27Z,direct_url=<?>,disk_format='qcow2',id=fe7e0145-3989-490e-8549-fd04c87b1bbf,min_disk=0,min_ram=0,name='tempest-scenario-img--1976139148',owner='a02ac142a06244ef9819e09b22e4a941',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:46:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'fe7e0145-3989-490e-8549-fd04c87b1bbf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:33 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:46:33 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:46:27Z,direct_url=<?>,disk_format='qcow2',id=fe7e0145-3989-490e-8549-fd04c87b1bbf,min_disk=0,min_ram=0,name='tempest-scenario-img--1976139148',owner='a02ac142a06244ef9819e09b22e4a941',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:46:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-268422201',display_name='tempest-TestMinimumBasicScenario-server-268422201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-268422201',id=23,image_ref='fe7e0145-3989-490e-8549-fd04c87b1bbf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5VUjQfePCJPThtosrWik/90Fev8SLx+lXghUWZ7Pux7J0g9Au910Z2/wthgd64k+5gb04TiVYNIeAHiEXl7UMhYOVayzfgzu7ZgyfjQfyON+xr+Xu4JclsIwlyTILmzA==',key_name='tempest-TestMinimumBasicScenario-2091302230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a02ac142a06244ef9819e09b22e4a941',ramdisk_id='',reservation_id='r-kzrp4n1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe7e0145-3989-490e-8549-fd04c87b1bbf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-322168895',owner_user_name='tempest-TestMinimumBasicScenario-322168895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:46:31Z,user_data=None,user_id='b74e4631d102431f83fe51fc39a3768a',uuid=06216917-d7d1-4fd4-a311-e054437e84a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "address": "fa:16:3e:a8:c1:72", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d71ff-87", "ovs_interfaceid": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Converting VIF {"id": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "address": "fa:16:3e:a8:c1:72", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d71ff-87", "ovs_interfaceid": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c1:72,bridge_name='br-int',has_traffic_filtering=True,id=f18d71ff-8728-41e9-82bf-3d66e09e552a,network=Network(5fa0c6e5-0332-4a5f-b866-8f823ceaa13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d71ff-87') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.objects.instance [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lazy-loading 'pci_devices' on Instance uuid 06216917-d7d1-4fd4-a311-e054437e84a6 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:46:33 user nova-compute[75378]:   <uuid>06216917-d7d1-4fd4-a311-e054437e84a6</uuid>
Nov 09 03:46:33 user nova-compute[75378]:   <name>instance-00000017</name>
Nov 09 03:46:33 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:46:33 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:46:33 user nova-compute[75378]:   <metadata>
Nov 09 03:46:33 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:46:33 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:46:33 user nova-compute[75378]:       <nova:name>tempest-TestMinimumBasicScenario-server-268422201</nova:name>
Nov 09 03:46:33 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:46:33</nova:creationTime>
Nov 09 03:46:33 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:46:33 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:46:33 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:46:33 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:46:33 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:46:33 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:46:33 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:46:33 user nova-compute[75378]:       <nova:owner>
Nov 09 03:46:33 user nova-compute[75378]:         <nova:user uuid="b74e4631d102431f83fe51fc39a3768a">tempest-TestMinimumBasicScenario-322168895-project-member</nova:user>
Nov 09 03:46:33 user nova-compute[75378]:         <nova:project uuid="a02ac142a06244ef9819e09b22e4a941">tempest-TestMinimumBasicScenario-322168895</nova:project>
Nov 09 03:46:33 user nova-compute[75378]:       </nova:owner>
Nov 09 03:46:33 user nova-compute[75378]:       <nova:root type="image" uuid="fe7e0145-3989-490e-8549-fd04c87b1bbf"/>
Nov 09 03:46:33 user nova-compute[75378]:       <nova:ports>
Nov 09 03:46:33 user nova-compute[75378]:         <nova:port uuid="f18d71ff-8728-41e9-82bf-3d66e09e552a">
Nov 09 03:46:33 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 09 03:46:33 user nova-compute[75378]:         </nova:port>
Nov 09 03:46:33 user nova-compute[75378]:       </nova:ports>
Nov 09 03:46:33 user nova-compute[75378]:     </nova:instance>
Nov 09 03:46:33 user nova-compute[75378]:   </metadata>
Nov 09 03:46:33 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:46:33 user nova-compute[75378]:     <system>
Nov 09 03:46:33 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:46:33 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:46:33 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:46:33 user nova-compute[75378]:       <entry name="serial">06216917-d7d1-4fd4-a311-e054437e84a6</entry>
Nov 09 03:46:33 user nova-compute[75378]:       <entry name="uuid">06216917-d7d1-4fd4-a311-e054437e84a6</entry>
Nov 09 03:46:33 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:46:33 user nova-compute[75378]:     </system>
Nov 09 03:46:33 user nova-compute[75378]:   </sysinfo>
Nov 09 03:46:33 user nova-compute[75378]:   <os>
Nov 09 03:46:33 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:46:33 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:46:33 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:46:33 user nova-compute[75378]:   </os>
Nov 09 03:46:33 user nova-compute[75378]:   <features>
Nov 09 03:46:33 user nova-compute[75378]:     <acpi/>
Nov 09 03:46:33 user nova-compute[75378]:     <apic/>
Nov 09 03:46:33 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:46:33 user nova-compute[75378]:   </features>
Nov 09 03:46:33 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:46:33 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:46:33 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:46:33 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:46:33 user nova-compute[75378]:   </clock>
Nov 09 03:46:33 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:46:33 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:46:33 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:46:33 user nova-compute[75378]:   </cpu>
Nov 09 03:46:33 user nova-compute[75378]:   <devices>
Nov 09 03:46:33 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:46:33 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:46:33 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk"/>
Nov 09 03:46:33 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:46:33 user nova-compute[75378]:     </disk>
Nov 09 03:46:33 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:46:33 user nova-compute[75378]:       <mac address="fa:16:3e:a8:c1:72"/>
Nov 09 03:46:33 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:46:33 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:46:33 user nova-compute[75378]:       <target dev="tapf18d71ff-87"/>
Nov 09 03:46:33 user nova-compute[75378]:     </interface>
Nov 09 03:46:33 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:46:33 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/console.log" append="off"/>
Nov 09 03:46:33 user nova-compute[75378]:     </serial>
Nov 09 03:46:33 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:46:33 user nova-compute[75378]:     <video>
Nov 09 03:46:33 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:46:33 user nova-compute[75378]:     </video>
Nov 09 03:46:33 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:46:33 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:46:33 user nova-compute[75378]:     </rng>
Nov 09 03:46:33 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:46:33 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:46:33 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:46:33 user nova-compute[75378]:     </memballoon>
Nov 09 03:46:33 user nova-compute[75378]:   </devices>
Nov 09 03:46:33 user nova-compute[75378]: </domain>
Nov 09 03:46:33 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-268422201',display_name='tempest-TestMinimumBasicScenario-server-268422201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-268422201',id=23,image_ref='fe7e0145-3989-490e-8549-fd04c87b1bbf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5VUjQfePCJPThtosrWik/90Fev8SLx+lXghUWZ7Pux7J0g9Au910Z2/wthgd64k+5gb04TiVYNIeAHiEXl7UMhYOVayzfgzu7ZgyfjQfyON+xr+Xu4JclsIwlyTILmzA==',key_name='tempest-TestMinimumBasicScenario-2091302230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a02ac142a06244ef9819e09b22e4a941',ramdisk_id='',reservation_id='r-kzrp4n1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe7e0145-3989-490e-8549-fd04c87b1bbf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-322168895',owner_user_name='tempest-TestMinimumBasicScenario-322168895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:46:31Z,user_data=None,user_id='b74e4631d102431f83fe51fc39a3768a',uuid=06216917-d7d1-4fd4-a311-e054437e84a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "address": "fa:16:3e:a8:c1:72", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d71ff-87", "ovs_interfaceid": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Converting VIF {"id": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "address": "fa:16:3e:a8:c1:72", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d71ff-87", "ovs_interfaceid": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c1:72,bridge_name='br-int',has_traffic_filtering=True,id=f18d71ff-8728-41e9-82bf-3d66e09e552a,network=Network(5fa0c6e5-0332-4a5f-b866-8f823ceaa13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d71ff-87') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG os_vif [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c1:72,bridge_name='br-int',has_traffic_filtering=True,id=f18d71ff-8728-41e9-82bf-3d66e09e552a,network=Network(5fa0c6e5-0332-4a5f-b866-8f823ceaa13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d71ff-87') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e6b1782-a9fa-55b8-98af-e9c3ac25070d', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf18d71ff-87, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf18d71ff-87, col_values=(('qos', UUID('f90cab8b-1728-4b2d-a125-749990dc77b9')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf18d71ff-87, col_values=(('external_ids', {'iface-id': 'f18d71ff-8728-41e9-82bf-3d66e09e552a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:c1:72', 'vm-uuid': '06216917-d7d1-4fd4-a311-e054437e84a6'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:33 user nova-compute[75378]: INFO os_vif [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c1:72,bridge_name='br-int',has_traffic_filtering=True,id=f18d71ff-8728-41e9-82bf-3d66e09e552a,network=Network(5fa0c6e5-0332-4a5f-b866-8f823ceaa13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d71ff-87')
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] No VIF found with MAC fa:16:3e:a8:c1:72, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:34 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:46:34 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:46:34 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7883MB free_disk=25.509342193603516GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:46:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:46:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:46:34 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:46:34 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:46:34 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7d051405-6b57-4db2-9533-c2f4e87134d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:46:34 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 883490f1-6a9f-4ad6-83c4-44b78e681de6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:46:34 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:46:34 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c4ef6623-863b-40a8-b9ec-720c25ee3484 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:46:34 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2c2acb48-972a-41d7-987e-48e79b3bef93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:46:34 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7e12539b-36a3-4691-89fd-e3d155de38d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:46:34 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 013db901-fbee-4593-a14f-95a03e79fad0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:46:34 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 06216917-d7d1-4fd4-a311-e054437e84a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:46:34 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:46:34 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:46:34 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:46:34 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:46:35 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:46:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:46:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:35 user nova-compute[75378]: DEBUG nova.compute.manager [req-e9d9fecc-feb8-4496-aa0b-caf3cda39da4 req-8cfd4ad1-e9b6-4ce4-82e9-f276b0d0a203 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Received event network-vif-plugged-f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:46:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e9d9fecc-feb8-4496-aa0b-caf3cda39da4 req-8cfd4ad1-e9b6-4ce4-82e9-f276b0d0a203 service nova] Acquiring lock "06216917-d7d1-4fd4-a311-e054437e84a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:46:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e9d9fecc-feb8-4496-aa0b-caf3cda39da4 req-8cfd4ad1-e9b6-4ce4-82e9-f276b0d0a203 service nova] Lock "06216917-d7d1-4fd4-a311-e054437e84a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:46:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e9d9fecc-feb8-4496-aa0b-caf3cda39da4 req-8cfd4ad1-e9b6-4ce4-82e9-f276b0d0a203 service nova] Lock "06216917-d7d1-4fd4-a311-e054437e84a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:46:35 user nova-compute[75378]: DEBUG nova.compute.manager [req-e9d9fecc-feb8-4496-aa0b-caf3cda39da4 req-8cfd4ad1-e9b6-4ce4-82e9-f276b0d0a203 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] No waiting events found dispatching network-vif-plugged-f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:46:35 user nova-compute[75378]: WARNING nova.compute.manager [req-e9d9fecc-feb8-4496-aa0b-caf3cda39da4 req-8cfd4ad1-e9b6-4ce4-82e9-f276b0d0a203 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Received unexpected event network-vif-plugged-f18d71ff-8728-41e9-82bf-3d66e09e552a for instance with vm_state building and task_state spawning.
Nov 09 03:46:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:36 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:46:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:37 user nova-compute[75378]: DEBUG nova.compute.manager [req-825d5b7f-656d-41ac-b4f6-ffd1baf67cd7 req-bb88c178-272a-4429-b66a-db0af05b52cd service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Received event network-vif-plugged-f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:46:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-825d5b7f-656d-41ac-b4f6-ffd1baf67cd7 req-bb88c178-272a-4429-b66a-db0af05b52cd service nova] Acquiring lock "06216917-d7d1-4fd4-a311-e054437e84a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:46:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-825d5b7f-656d-41ac-b4f6-ffd1baf67cd7 req-bb88c178-272a-4429-b66a-db0af05b52cd service nova] Lock "06216917-d7d1-4fd4-a311-e054437e84a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:46:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-825d5b7f-656d-41ac-b4f6-ffd1baf67cd7 req-bb88c178-272a-4429-b66a-db0af05b52cd service nova] Lock "06216917-d7d1-4fd4-a311-e054437e84a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:46:37 user nova-compute[75378]: DEBUG nova.compute.manager [req-825d5b7f-656d-41ac-b4f6-ffd1baf67cd7 req-bb88c178-272a-4429-b66a-db0af05b52cd service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] No waiting events found dispatching network-vif-plugged-f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:46:37 user nova-compute[75378]: WARNING nova.compute.manager [req-825d5b7f-656d-41ac-b4f6-ffd1baf67cd7 req-bb88c178-272a-4429-b66a-db0af05b52cd service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Received unexpected event network-vif-plugged-f18d71ff-8728-41e9-82bf-3d66e09e552a for instance with vm_state building and task_state spawning.
Nov 09 03:46:37 user nova-compute[75378]: DEBUG nova.compute.manager [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:46:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:46:37 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Instance spawned successfully.
Nov 09 03:46:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:46:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:46:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:46:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:46:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:46:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:46:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:46:37 user nova-compute[75378]: INFO nova.compute.manager [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Took 6.40 seconds to spawn the instance on the hypervisor.
Nov 09 03:46:37 user nova-compute[75378]: DEBUG nova.compute.manager [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:46:37 user nova-compute[75378]: INFO nova.compute.manager [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Took 7.52 seconds to build instance.
Nov 09 03:46:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f8be3aa-6e11-4493-b335-56eb79dc065f tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "06216917-d7d1-4fd4-a311-e054437e84a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.753s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:46:38 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:46:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:46:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:46:52 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Creating image(s)
Nov 09 03:46:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Did not create local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 03:46:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Ensure instance console log exists: /opt/stack/data/nova/instances/013db901-fbee-4593-a14f-95a03e79fad0/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:46:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:46:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:46:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Start _get_guest_xml network_info=[{"id": "5650a4a6-f99d-42e2-8b94-f18562892154", "address": "fa:16:3e:7f:95:df", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5650a4a6-f9", "ovs_interfaceid": "5650a4a6-f99d-42e2-8b94-f18562892154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aSeGHxRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '013db901-fbee-4593-a14f-95a03e79fad0', 'attached_at': '', 'detached_at': '', 'volume_id': '35d5d634-9dbe-4a80-b298-47934fd627dc', 'serial': '35d5d634-9dbe-4a80-b298-47934fd627dc'}, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'e906c831-cd64-4184-8b39-76da3dcf8563', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:46:53 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:46:53 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:46:53 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aSeGHxRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:46:53 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:46:53 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:46:53 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[056a7ae7-3f21-4bea-847e-7b3f69c486e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:46:53 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e24cf2-884e-4097-87d8-fb5841e737ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc] added
Nov 09 03:46:53 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71b9c0d-24f4-48fc-b467-5db367a94806]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ac7d93-31f3-4b9b-9061-7b1c9ebcfc41]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aSeGHxRK {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aSeGHxRK" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe206b6-607b-442d-bf5c-a70855a000fa]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aSeGHxRK'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[969c561c-e35a-4ae4-ab93-92c81e144899]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[612e16b7-c394-4d7a-bee7-f0768f4d513a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:46:53 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:46:53 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e011ec3-3623-44e1-8cbe-eb381f964695]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc, portal: 172.16.0.220,3260]
Nov 09 03:46:53 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc, portal: 172.16.0.220,3260] successful.
Nov 09 03:46:53 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fb22d9-951c-45b4-9801-018348b5c654]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[78706a92-e5b0-41bb-9905-f92c623a32b6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:46:53 user nova-compute[75378]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:46:53 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:46:53 user nova-compute[75378]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:46:53 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0192cc4-f5ce-4f68-b0f8-d2ba3c1e3c14]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: None {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:46:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aSeGHxRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26135666632663735', 'path': '/dev/sdc'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135666632663735', 'path': '/dev/sdc'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-51079469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-51079469',id=22,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c2176531ffa4cf7bec818309e39ab8d',ramdisk_id='',reservation_id='r-v7do5wzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:46:14Z,user_data=None,user_id='57efcfeacd7f4daf916e7dd04e11d8f2',uuid=013db901-fbee-4593-a14f-95a03e79fad0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5650a4a6-f99d-42e2-8b94-f18562892154", "address": "fa:16:3e:7f:95:df", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5650a4a6-f9", "ovs_interfaceid": "5650a4a6-f99d-42e2-8b94-f18562892154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converting VIF {"id": "5650a4a6-f99d-42e2-8b94-f18562892154", "address": "fa:16:3e:7f:95:df", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5650a4a6-f9", "ovs_interfaceid": "5650a4a6-f99d-42e2-8b94-f18562892154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:95:df,bridge_name='br-int',has_traffic_filtering=True,id=5650a4a6-f99d-42e2-8b94-f18562892154,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5650a4a6-f9') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG nova.objects.instance [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'pci_devices' on Instance uuid 013db901-fbee-4593-a14f-95a03e79fad0 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:46:54 user nova-compute[75378]:   <uuid>013db901-fbee-4593-a14f-95a03e79fad0</uuid>
Nov 09 03:46:54 user nova-compute[75378]:   <name>instance-00000016</name>
Nov 09 03:46:54 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:46:54 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:46:54 user nova-compute[75378]:   <metadata>
Nov 09 03:46:54 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:46:54 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:46:54 user nova-compute[75378]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-51079469</nova:name>
Nov 09 03:46:54 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:46:53</nova:creationTime>
Nov 09 03:46:54 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:46:54 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:46:54 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:46:54 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:46:54 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:46:54 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:46:54 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:46:54 user nova-compute[75378]:       <nova:owner>
Nov 09 03:46:54 user nova-compute[75378]:         <nova:user uuid="57efcfeacd7f4daf916e7dd04e11d8f2">tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member</nova:user>
Nov 09 03:46:54 user nova-compute[75378]:         <nova:project uuid="4c2176531ffa4cf7bec818309e39ab8d">tempest-ServerBootFromVolumeStableRescueTest-1679422577</nova:project>
Nov 09 03:46:54 user nova-compute[75378]:       </nova:owner>
Nov 09 03:46:54 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:46:54 user nova-compute[75378]:       <nova:ports>
Nov 09 03:46:54 user nova-compute[75378]:         <nova:port uuid="5650a4a6-f99d-42e2-8b94-f18562892154">
Nov 09 03:46:54 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 09 03:46:54 user nova-compute[75378]:         </nova:port>
Nov 09 03:46:54 user nova-compute[75378]:       </nova:ports>
Nov 09 03:46:54 user nova-compute[75378]:     </nova:instance>
Nov 09 03:46:54 user nova-compute[75378]:   </metadata>
Nov 09 03:46:54 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:46:54 user nova-compute[75378]:     <system>
Nov 09 03:46:54 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:46:54 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:46:54 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:46:54 user nova-compute[75378]:       <entry name="serial">013db901-fbee-4593-a14f-95a03e79fad0</entry>
Nov 09 03:46:54 user nova-compute[75378]:       <entry name="uuid">013db901-fbee-4593-a14f-95a03e79fad0</entry>
Nov 09 03:46:54 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:46:54 user nova-compute[75378]:     </system>
Nov 09 03:46:54 user nova-compute[75378]:   </sysinfo>
Nov 09 03:46:54 user nova-compute[75378]:   <os>
Nov 09 03:46:54 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:46:54 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:46:54 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:46:54 user nova-compute[75378]:   </os>
Nov 09 03:46:54 user nova-compute[75378]:   <features>
Nov 09 03:46:54 user nova-compute[75378]:     <acpi/>
Nov 09 03:46:54 user nova-compute[75378]:     <apic/>
Nov 09 03:46:54 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:46:54 user nova-compute[75378]:   </features>
Nov 09 03:46:54 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:46:54 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:46:54 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:46:54 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:46:54 user nova-compute[75378]:   </clock>
Nov 09 03:46:54 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:46:54 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:46:54 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:46:54 user nova-compute[75378]:   </cpu>
Nov 09 03:46:54 user nova-compute[75378]:   <devices>
Nov 09 03:46:54 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 03:46:54 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:46:54 user nova-compute[75378]:       <source dev="/dev/sdc"/>
Nov 09 03:46:54 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:46:54 user nova-compute[75378]:       <serial>35d5d634-9dbe-4a80-b298-47934fd627dc</serial>
Nov 09 03:46:54 user nova-compute[75378]:     </disk>
Nov 09 03:46:54 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:46:54 user nova-compute[75378]:       <mac address="fa:16:3e:7f:95:df"/>
Nov 09 03:46:54 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:46:54 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:46:54 user nova-compute[75378]:       <target dev="tap5650a4a6-f9"/>
Nov 09 03:46:54 user nova-compute[75378]:     </interface>
Nov 09 03:46:54 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:46:54 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/013db901-fbee-4593-a14f-95a03e79fad0/console.log" append="off"/>
Nov 09 03:46:54 user nova-compute[75378]:     </serial>
Nov 09 03:46:54 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:46:54 user nova-compute[75378]:     <video>
Nov 09 03:46:54 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:46:54 user nova-compute[75378]:     </video>
Nov 09 03:46:54 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:46:54 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:46:54 user nova-compute[75378]:     </rng>
Nov 09 03:46:54 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:46:54 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:46:54 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:46:54 user nova-compute[75378]:     </memballoon>
Nov 09 03:46:54 user nova-compute[75378]:   </devices>
Nov 09 03:46:54 user nova-compute[75378]: </domain>
Nov 09 03:46:54 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-51079469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-51079469',id=22,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c2176531ffa4cf7bec818309e39ab8d',ramdisk_id='',reservation_id='r-v7do5wzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:46:14Z,user_data=None,user_id='57efcfeacd7f4daf916e7dd04e11d8f2',uuid=013db901-fbee-4593-a14f-95a03e79fad0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5650a4a6-f99d-42e2-8b94-f18562892154", "address": "fa:16:3e:7f:95:df", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5650a4a6-f9", "ovs_interfaceid": "5650a4a6-f99d-42e2-8b94-f18562892154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converting VIF {"id": "5650a4a6-f99d-42e2-8b94-f18562892154", "address": "fa:16:3e:7f:95:df", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5650a4a6-f9", "ovs_interfaceid": "5650a4a6-f99d-42e2-8b94-f18562892154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:95:df,bridge_name='br-int',has_traffic_filtering=True,id=5650a4a6-f99d-42e2-8b94-f18562892154,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5650a4a6-f9') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG os_vif [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:95:df,bridge_name='br-int',has_traffic_filtering=True,id=5650a4a6-f99d-42e2-8b94-f18562892154,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5650a4a6-f9') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40e990e4-0828-53ec-a5d9-218409500431', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5650a4a6-f9, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5650a4a6-f9, col_values=(('qos', UUID('becda733-2466-453c-b14e-f3095ce8394c')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5650a4a6-f9, col_values=(('external_ids', {'iface-id': '5650a4a6-f99d-42e2-8b94-f18562892154', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:95:df', 'vm-uuid': '013db901-fbee-4593-a14f-95a03e79fad0'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:54 user nova-compute[75378]: INFO os_vif [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:95:df,bridge_name='br-int',has_traffic_filtering=True,id=5650a4a6-f99d-42e2-8b94-f18562892154,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5650a4a6-f9')
Nov 09 03:46:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:46:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] No VIF found with MAC fa:16:3e:7f:95:df, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:46:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:56 user nova-compute[75378]: DEBUG nova.compute.manager [req-0d85f14c-28e0-44da-905d-0b2d6e6301a9 req-97a6da4f-6091-4977-b500-ab2b3a2b40a8 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received event network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:46:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0d85f14c-28e0-44da-905d-0b2d6e6301a9 req-97a6da4f-6091-4977-b500-ab2b3a2b40a8 service nova] Acquiring lock "013db901-fbee-4593-a14f-95a03e79fad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:46:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0d85f14c-28e0-44da-905d-0b2d6e6301a9 req-97a6da4f-6091-4977-b500-ab2b3a2b40a8 service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:46:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0d85f14c-28e0-44da-905d-0b2d6e6301a9 req-97a6da4f-6091-4977-b500-ab2b3a2b40a8 service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:46:56 user nova-compute[75378]: DEBUG nova.compute.manager [req-0d85f14c-28e0-44da-905d-0b2d6e6301a9 req-97a6da4f-6091-4977-b500-ab2b3a2b40a8 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] No waiting events found dispatching network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:46:56 user nova-compute[75378]: WARNING nova.compute.manager [req-0d85f14c-28e0-44da-905d-0b2d6e6301a9 req-97a6da4f-6091-4977-b500-ab2b3a2b40a8 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received unexpected event network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 for instance with vm_state building and task_state spawning.
Nov 09 03:46:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:46:58 user nova-compute[75378]: DEBUG nova.compute.manager [req-ea32f906-ad8e-40e6-8676-87a252c4596a req-f3337235-55ea-40e1-9fb2-324237d77e21 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received event network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:46:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ea32f906-ad8e-40e6-8676-87a252c4596a req-f3337235-55ea-40e1-9fb2-324237d77e21 service nova] Acquiring lock "013db901-fbee-4593-a14f-95a03e79fad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:46:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ea32f906-ad8e-40e6-8676-87a252c4596a req-f3337235-55ea-40e1-9fb2-324237d77e21 service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:46:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ea32f906-ad8e-40e6-8676-87a252c4596a req-f3337235-55ea-40e1-9fb2-324237d77e21 service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:46:58 user nova-compute[75378]: DEBUG nova.compute.manager [req-ea32f906-ad8e-40e6-8676-87a252c4596a req-f3337235-55ea-40e1-9fb2-324237d77e21 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] No waiting events found dispatching network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:46:58 user nova-compute[75378]: WARNING nova.compute.manager [req-ea32f906-ad8e-40e6-8676-87a252c4596a req-f3337235-55ea-40e1-9fb2-324237d77e21 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received unexpected event network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 for instance with vm_state building and task_state spawning.
Nov 09 03:46:58 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:46:58 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:46:58 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Instance spawned successfully.
Nov 09 03:46:58 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:46:58 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:46:58 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:46:58 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:46:58 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:46:58 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:46:58 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:46:59 user nova-compute[75378]: INFO nova.compute.manager [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Took 6.09 seconds to spawn the instance on the hypervisor.
Nov 09 03:46:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:46:59 user nova-compute[75378]: INFO nova.compute.manager [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Took 46.44 seconds to build instance.
Nov 09 03:46:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d69b3096-a297-43a2-98f3-3549291f144f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "013db901-fbee-4593-a14f-95a03e79fad0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.586s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:46:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:47:00 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Creating image(s)
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Did not create local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Ensure instance console log exists: /opt/stack/data/nova/instances/c4ef6623-863b-40a8-b9ec-720c25ee3484/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Start _get_guest_xml network_info=[{"id": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "address": "fa:16:3e:bc:91:1f", "network": {"id": "1c13e251-154e-4521-9b3c-443bb29cc577", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071356817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ed92ed-0e", "ovs_interfaceid": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "address": "fa:16:3e:0d:b1:a6", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95465b85-15", "ovs_interfaceid": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "address": "fa:16:3e:b7:e8:0e", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd2d935-db", "ovs_interfaceid": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "address": "fa:16:3e:35:0f:09", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ba1a1-d2", "ovs_interfaceid": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2bab297-674f-41e7-baac-73eb91483899", "address": "fa:16:3e:b4:02:cf", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bab297-67", "ovs_interfaceid": "e2bab297-674f-41e7-baac-73eb91483899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2195503e-d6da-4598-9478-2956f48d2b8e", "address": "fa:16:3e:9c:68:a7", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2195503e-d6", "ovs_interfaceid": "2195503e-d6da-4598-9478-2956f48d2b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "address": "fa:16:3e:1f:60:09", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe16ed0-6d", "ovs_interfaceid": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoAjFXsO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c4ef6623-863b-40a8-b9ec-720c25ee3484', 'attached_at': '', 'detached_at': '', 'volume_id': '981920d2-9809-4a1c-917b-fb19ca23724a', 'serial': '981920d2-9809-4a1c-917b-fb19ca23724a'}, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'c2314c06-7768-4a10-a489-6efd2a8b53ad', 'disk_bus': 'virtio', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaDJhmpG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c4ef6623-863b-40a8-b9ec-720c25ee3484', 'attached_at': '', 'detached_at': '', 'volume_id': '272d88bd-3b32-432e-b625-96fb7c66f6a8', 'serial': '272d88bd-3b32-432e-b625-96fb7c66f6a8'}, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': 1, 'guest_format': None, 'attachment_id': 'e1e1cb4c-49d1-4eb1-b59e-815082a5eb4f', 'disk_bus': 'virtio', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwbRzDso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c4ef6623-863b-40a8-b9ec-720c25ee3484', 'attached_at': '', 'detached_at': '', 'volume_id': 'eb2e5acb-e73c-45dc-9cb5-31e6489d682d', 'serial': 'eb2e5acb-e73c-45dc-9cb5-31e6489d682d'}, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'boot_index': 2, 'guest_format': None, 'attachment_id': 'c5e69790-12ce-4e89-9c7f-7b56bc51ebd8', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:47:00 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:47:00 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoAjFXsO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:47:00 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:47:00 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:47:00 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c26bb1d-f844-4ea4-968e-5ff89bad9f8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:47:00 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da07113-8746-474f-aa0f-5068d2c938b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a] added
Nov 09 03:47:00 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e59e24-c0a2-4756-93ce-a0f687440a3a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffcd48e-d876-4e9e-8709-730d83172aa8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WoAjFXsO {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WoAjFXsO" returned: 0 in 0.057s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[00237eb6-3de1-426c-8243-81529f0f8d55]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WoAjFXsO'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[169be56b-d8bc-45c2-bf4e-9ec62b839a9f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[83159c91-1d9a-4b31-94e3-80027618b4f4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:47:00 user nova-compute[75378]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:47:00 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:47:00 user nova-compute[75378]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:47:00 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35051f5-cdd2-4e3f-8204-73737b657ce0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a, portal: 172.16.0.220,3260]
Nov 09 03:47:00 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a, portal: 172.16.0.220,3260] successful.
Nov 09 03:47:00 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d249e1c0-b08b-4b53-ab5f-07e7fde82324]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cd0b33-74ff-4d46-bcd7-4709f57b3515]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:47:00 user nova-compute[75378]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:47:00 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:47:00 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:47:00 user nova-compute[75378]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:47:00 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:47:00 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[848d4d89-9d79-451b-aa6a-c61a4823081c]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:47:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoAjFXsO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:47:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:47:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '26261336337646463', 'path': '/dev/sdd'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:47:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261336337646463', 'path': '/dev/sdd'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaDJhmpG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:47:02 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:47:02 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:47:02 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[26955431-e52b-4abf-90d0-33e3d3e73f9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:47:02 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0db2d2e-7e8c-4848-94ba-4ccf0c298a80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8] added
Nov 09 03:47:02 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ad18bd-7134-43fa-b7dd-26e256cbf3e1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05cbbb0-57d8-4791-8f28-5a4357e2d208]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AaDJhmpG {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AaDJhmpG" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d4b2bd-541b-46af-baa4-1c60489d7ca1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AaDJhmpG'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae22f77-e5c2-43e7-9df3-7ef620f37788]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a5c1c7-cdbd-45d6-b743-363a639069e2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:47:02 user nova-compute[75378]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:47:02 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:47:02 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:47:02 user nova-compute[75378]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:47:02 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:47:02 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5e1eb3-c197-4a8c-8a40-f9581f90ea3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8, portal: 172.16.0.220,3260]
Nov 09 03:47:02 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8, portal: 172.16.0.220,3260] successful.
Nov 09 03:47:02 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbe485c-fc72-4665-8e33-2d8ab08bb7e9]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5934d010-9092-482c-bcb9-f9cea21fa3f3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:47:02 user nova-compute[75378]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:47:02 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:47:02 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:47:02 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:47:02 user nova-compute[75378]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:47:02 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:47:02 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:47:02 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8c550d-2edf-4406-883e-6ee481c1f3dc]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:47:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaDJhmpG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23831653363623136', 'path': '/dev/sde'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831653363623136', 'path': '/dev/sde'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwbRzDso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:47:03 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:47:03 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:47:03 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b0916a-8923-47d9-8f7d-e8cbd2d73370]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:47:03 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[db955593-a513-40a4-9f44-30baa6d55528]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d] added
Nov 09 03:47:03 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1292e80b-b11a-4bfb-a611-ecb5903a61c1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafa80d8-a53d-4601-b355-49887f9a28bd]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nwbRzDso {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nwbRzDso" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[31af60c9-6ee5-4ba0-9586-d005e8ca8778]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nwbRzDso'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[241c1711-6086-4aac-a24e-9e8e95504f33]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[409f1c33-40ea-47cb-8328-6abc882be476]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:47:03 user nova-compute[75378]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:47:03 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:47:03 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:47:03 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:47:03 user nova-compute[75378]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:47:03 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:47:03 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:47:03 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0d7d41-5395-4ffe-bdab-fc3137f254ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d, portal: 172.16.0.220,3260]
Nov 09 03:47:03 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d, portal: 172.16.0.220,3260] successful.
Nov 09 03:47:03 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94d5413-d550-434f-85ac-388ca5449124]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e213aa-2d76-4102-acd5-90221fe39796]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:47:03 user nova-compute[75378]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:47:03 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:47:03 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:47:03 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:47:03 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:47:03 user nova-compute[75378]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:47:03 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:47:03 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:47:03 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:47:03 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e9fea0-f2e9-4d44-a693-ecc612b63e7f]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:03 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: None {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwbRzDso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26437386265646439', 'path': '/dev/sdf'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437386265646439', 'path': '/dev/sdf'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237131222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237131222',id=19,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH/xMJVpGaoZZKT5yOQG9YEsZHK0qinmMJc/4GspFhdUxnsc9HXa+tGmNHJBRf9ENKRejYCxxtWI6LtFW1RAoW6wOuC43TGFdsh0nVlz83OuXmFj2lwOBO1pGyFNwxCfA==',key_name='tempest-keypair-1130216547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b7a5a29e104b60ae779f864d5c202f',ramdisk_id='',reservation_id='r-xxkikjoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1739662256',owner_user_name='tempest-TaggedBootDevicesTest_v242-1739662256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd895f640a78436cb439a4d0e82fe36f',uuid=c4ef6623-863b-40a8-b9ec-720c25ee3484,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "address": "fa:16:3e:bc:91:1f", "network": {"id": "1c13e251-154e-4521-9b3c-443bb29cc577", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071356817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ed92ed-0e", "ovs_interfaceid": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converting VIF {"id": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "address": "fa:16:3e:bc:91:1f", "network": {"id": "1c13e251-154e-4521-9b3c-443bb29cc577", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071356817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ed92ed-0e", "ovs_interfaceid": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:91:1f,bridge_name='br-int',has_traffic_filtering=True,id=37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d,network=Network(1c13e251-154e-4521-9b3c-443bb29cc577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ed92ed-0e') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237131222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237131222',id=19,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH/xMJVpGaoZZKT5yOQG9YEsZHK0qinmMJc/4GspFhdUxnsc9HXa+tGmNHJBRf9ENKRejYCxxtWI6LtFW1RAoW6wOuC43TGFdsh0nVlz83OuXmFj2lwOBO1pGyFNwxCfA==',key_name='tempest-keypair-1130216547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b7a5a29e104b60ae779f864d5c202f',ramdisk_id='',reservation_id='r-xxkikjoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1739662256',owner_user_name='tempest-TaggedBootDevicesTest_v242-1739662256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd895f640a78436cb439a4d0e82fe36f',uuid=c4ef6623-863b-40a8-b9ec-720c25ee3484,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "address": "fa:16:3e:0d:b1:a6", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95465b85-15", "ovs_interfaceid": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converting VIF {"id": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "address": "fa:16:3e:0d:b1:a6", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95465b85-15", "ovs_interfaceid": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b1:a6,bridge_name='br-int',has_traffic_filtering=True,id=95465b85-15fb-4cf7-9db9-23c5e4a755c8,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap95465b85-15') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237131222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237131222',id=19,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH/xMJVpGaoZZKT5yOQG9YEsZHK0qinmMJc/4GspFhdUxnsc9HXa+tGmNHJBRf9ENKRejYCxxtWI6LtFW1RAoW6wOuC43TGFdsh0nVlz83OuXmFj2lwOBO1pGyFNwxCfA==',key_name='tempest-keypair-1130216547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b7a5a29e104b60ae779f864d5c202f',ramdisk_id='',reservation_id='r-xxkikjoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1739662256',owner_user_name='tempest-TaggedBootDevicesTest_v242-1739662256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd895f640a78436cb439a4d0e82fe36f',uuid=c4ef6623-863b-40a8-b9ec-720c25ee3484,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "address": "fa:16:3e:b7:e8:0e", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd2d935-db", "ovs_interfaceid": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converting VIF {"id": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "address": "fa:16:3e:b7:e8:0e", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd2d935-db", "ovs_interfaceid": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e8:0e,bridge_name='br-int',has_traffic_filtering=True,id=4dd2d935-dbaf-445e-aa45-30114c1df2a8,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4dd2d935-db') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237131222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237131222',id=19,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH/xMJVpGaoZZKT5yOQG9YEsZHK0qinmMJc/4GspFhdUxnsc9HXa+tGmNHJBRf9ENKRejYCxxtWI6LtFW1RAoW6wOuC43TGFdsh0nVlz83OuXmFj2lwOBO1pGyFNwxCfA==',key_name='tempest-keypair-1130216547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b7a5a29e104b60ae779f864d5c202f',ramdisk_id='',reservation_id='r-xxkikjoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1739662256',owner_user_name='tempest-TaggedBootDevicesTest_v242-1739662256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd895f640a78436cb439a4d0e82fe36f',uuid=c4ef6623-863b-40a8-b9ec-720c25ee3484,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "address": "fa:16:3e:35:0f:09", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ba1a1-d2", "ovs_interfaceid": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converting VIF {"id": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "address": "fa:16:3e:35:0f:09", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ba1a1-d2", "ovs_interfaceid": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=427ba1a1-d2a8-431b-aeea-d455e8908e7a,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427ba1a1-d2') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237131222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237131222',id=19,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH/xMJVpGaoZZKT5yOQG9YEsZHK0qinmMJc/4GspFhdUxnsc9HXa+tGmNHJBRf9ENKRejYCxxtWI6LtFW1RAoW6wOuC43TGFdsh0nVlz83OuXmFj2lwOBO1pGyFNwxCfA==',key_name='tempest-keypair-1130216547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b7a5a29e104b60ae779f864d5c202f',ramdisk_id='',reservation_id='r-xxkikjoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1739662256',owner_user_name='tempest-TaggedBootDevicesTest_v242-1739662256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd895f640a78436cb439a4d0e82fe36f',uuid=c4ef6623-863b-40a8-b9ec-720c25ee3484,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2bab297-674f-41e7-baac-73eb91483899", "address": "fa:16:3e:b4:02:cf", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bab297-67", "ovs_interfaceid": "e2bab297-674f-41e7-baac-73eb91483899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converting VIF {"id": "e2bab297-674f-41e7-baac-73eb91483899", "address": "fa:16:3e:b4:02:cf", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bab297-67", "ovs_interfaceid": "e2bab297-674f-41e7-baac-73eb91483899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:02:cf,bridge_name='br-int',has_traffic_filtering=True,id=e2bab297-674f-41e7-baac-73eb91483899,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2bab297-67') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237131222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237131222',id=19,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH/xMJVpGaoZZKT5yOQG9YEsZHK0qinmMJc/4GspFhdUxnsc9HXa+tGmNHJBRf9ENKRejYCxxtWI6LtFW1RAoW6wOuC43TGFdsh0nVlz83OuXmFj2lwOBO1pGyFNwxCfA==',key_name='tempest-keypair-1130216547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b7a5a29e104b60ae779f864d5c202f',ramdisk_id='',reservation_id='r-xxkikjoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1739662256',owner_user_name='tempest-TaggedBootDevicesTest_v242-1739662256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd895f640a78436cb439a4d0e82fe36f',uuid=c4ef6623-863b-40a8-b9ec-720c25ee3484,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2195503e-d6da-4598-9478-2956f48d2b8e", "address": "fa:16:3e:9c:68:a7", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2195503e-d6", "ovs_interfaceid": "2195503e-d6da-4598-9478-2956f48d2b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converting VIF {"id": "2195503e-d6da-4598-9478-2956f48d2b8e", "address": "fa:16:3e:9c:68:a7", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2195503e-d6", "ovs_interfaceid": "2195503e-d6da-4598-9478-2956f48d2b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:68:a7,bridge_name='br-int',has_traffic_filtering=True,id=2195503e-d6da-4598-9478-2956f48d2b8e,network=Network(36b4d72f-7b08-4926-b623-bcc9260201a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2195503e-d6') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237131222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237131222',id=19,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH/xMJVpGaoZZKT5yOQG9YEsZHK0qinmMJc/4GspFhdUxnsc9HXa+tGmNHJBRf9ENKRejYCxxtWI6LtFW1RAoW6wOuC43TGFdsh0nVlz83OuXmFj2lwOBO1pGyFNwxCfA==',key_name='tempest-keypair-1130216547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b7a5a29e104b60ae779f864d5c202f',ramdisk_id='',reservation_id='r-xxkikjoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1739662256',owner_user_name='tempest-TaggedBootDevicesTest_v242-1739662256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd895f640a78436cb439a4d0e82fe36f',uuid=c4ef6623-863b-40a8-b9ec-720c25ee3484,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "address": "fa:16:3e:1f:60:09", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe16ed0-6d", "ovs_interfaceid": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converting VIF {"id": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "address": "fa:16:3e:1f:60:09", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe16ed0-6d", "ovs_interfaceid": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:60:09,bridge_name='br-int',has_traffic_filtering=True,id=abe16ed0-6d62-41c1-8bfd-da97d9908143,network=Network(36b4d72f-7b08-4926-b623-bcc9260201a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe16ed0-6d') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.objects.instance [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lazy-loading 'pci_devices' on Instance uuid c4ef6623-863b-40a8-b9ec-720c25ee3484 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:47:04 user nova-compute[75378]:   <uuid>c4ef6623-863b-40a8-b9ec-720c25ee3484</uuid>
Nov 09 03:47:04 user nova-compute[75378]:   <name>instance-00000013</name>
Nov 09 03:47:04 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:47:04 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:47:04 user nova-compute[75378]:   <metadata>
Nov 09 03:47:04 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:47:04 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:47:04 user nova-compute[75378]:       <nova:name>tempest-device-tagging-server-1237131222</nova:name>
Nov 09 03:47:04 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:47:00</nova:creationTime>
Nov 09 03:47:04 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:47:04 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:47:04 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:47:04 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:47:04 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:47:04 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:47:04 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:47:04 user nova-compute[75378]:       <nova:owner>
Nov 09 03:47:04 user nova-compute[75378]:         <nova:user uuid="dd895f640a78436cb439a4d0e82fe36f">tempest-TaggedBootDevicesTest_v242-1739662256-project-member</nova:user>
Nov 09 03:47:04 user nova-compute[75378]:         <nova:project uuid="a9b7a5a29e104b60ae779f864d5c202f">tempest-TaggedBootDevicesTest_v242-1739662256</nova:project>
Nov 09 03:47:04 user nova-compute[75378]:       </nova:owner>
Nov 09 03:47:04 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:47:04 user nova-compute[75378]:       <nova:ports>
Nov 09 03:47:04 user nova-compute[75378]:         <nova:port uuid="37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d">
Nov 09 03:47:04 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 03:47:04 user nova-compute[75378]:         </nova:port>
Nov 09 03:47:04 user nova-compute[75378]:         <nova:port uuid="95465b85-15fb-4cf7-9db9-23c5e4a755c8">
Nov 09 03:47:04 user nova-compute[75378]:           <nova:ip type="fixed" address="10.1.1.170" ipVersion="4"/>
Nov 09 03:47:04 user nova-compute[75378]:         </nova:port>
Nov 09 03:47:04 user nova-compute[75378]:         <nova:port uuid="4dd2d935-dbaf-445e-aa45-30114c1df2a8">
Nov 09 03:47:04 user nova-compute[75378]:           <nova:ip type="fixed" address="10.1.1.44" ipVersion="4"/>
Nov 09 03:47:04 user nova-compute[75378]:         </nova:port>
Nov 09 03:47:04 user nova-compute[75378]:         <nova:port uuid="427ba1a1-d2a8-431b-aeea-d455e8908e7a">
Nov 09 03:47:04 user nova-compute[75378]:           <nova:ip type="fixed" address="10.1.1.83" ipVersion="4"/>
Nov 09 03:47:04 user nova-compute[75378]:         </nova:port>
Nov 09 03:47:04 user nova-compute[75378]:         <nova:port uuid="e2bab297-674f-41e7-baac-73eb91483899">
Nov 09 03:47:04 user nova-compute[75378]:           <nova:ip type="fixed" address="10.1.1.20" ipVersion="4"/>
Nov 09 03:47:04 user nova-compute[75378]:         </nova:port>
Nov 09 03:47:04 user nova-compute[75378]:         <nova:port uuid="2195503e-d6da-4598-9478-2956f48d2b8e">
Nov 09 03:47:04 user nova-compute[75378]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 09 03:47:04 user nova-compute[75378]:         </nova:port>
Nov 09 03:47:04 user nova-compute[75378]:         <nova:port uuid="abe16ed0-6d62-41c1-8bfd-da97d9908143">
Nov 09 03:47:04 user nova-compute[75378]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 09 03:47:04 user nova-compute[75378]:         </nova:port>
Nov 09 03:47:04 user nova-compute[75378]:       </nova:ports>
Nov 09 03:47:04 user nova-compute[75378]:     </nova:instance>
Nov 09 03:47:04 user nova-compute[75378]:   </metadata>
Nov 09 03:47:04 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:47:04 user nova-compute[75378]:     <system>
Nov 09 03:47:04 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:47:04 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:47:04 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:47:04 user nova-compute[75378]:       <entry name="serial">c4ef6623-863b-40a8-b9ec-720c25ee3484</entry>
Nov 09 03:47:04 user nova-compute[75378]:       <entry name="uuid">c4ef6623-863b-40a8-b9ec-720c25ee3484</entry>
Nov 09 03:47:04 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:47:04 user nova-compute[75378]:     </system>
Nov 09 03:47:04 user nova-compute[75378]:   </sysinfo>
Nov 09 03:47:04 user nova-compute[75378]:   <os>
Nov 09 03:47:04 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:47:04 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:47:04 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:47:04 user nova-compute[75378]:   </os>
Nov 09 03:47:04 user nova-compute[75378]:   <features>
Nov 09 03:47:04 user nova-compute[75378]:     <acpi/>
Nov 09 03:47:04 user nova-compute[75378]:     <apic/>
Nov 09 03:47:04 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:47:04 user nova-compute[75378]:   </features>
Nov 09 03:47:04 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:47:04 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:47:04 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:47:04 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:47:04 user nova-compute[75378]:   </clock>
Nov 09 03:47:04 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:47:04 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:47:04 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:47:04 user nova-compute[75378]:   </cpu>
Nov 09 03:47:04 user nova-compute[75378]:   <devices>
Nov 09 03:47:04 user nova-compute[75378]:     <disk type="file" device="cdrom">
Nov 09 03:47:04 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none"/>
Nov 09 03:47:04 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/c4ef6623-863b-40a8-b9ec-720c25ee3484/disk.config"/>
Nov 09 03:47:04 user nova-compute[75378]:       <target dev="hda" bus="ide"/>
Nov 09 03:47:04 user nova-compute[75378]:     </disk>
Nov 09 03:47:04 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 03:47:04 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:47:04 user nova-compute[75378]:       <source dev="/dev/sdd"/>
Nov 09 03:47:04 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:47:04 user nova-compute[75378]:       <serial>981920d2-9809-4a1c-917b-fb19ca23724a</serial>
Nov 09 03:47:04 user nova-compute[75378]:     </disk>
Nov 09 03:47:04 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 03:47:04 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:47:04 user nova-compute[75378]:       <source dev="/dev/sde"/>
Nov 09 03:47:04 user nova-compute[75378]:       <target dev="vdb" bus="virtio"/>
Nov 09 03:47:04 user nova-compute[75378]:       <serial>272d88bd-3b32-432e-b625-96fb7c66f6a8</serial>
Nov 09 03:47:04 user nova-compute[75378]:     </disk>
Nov 09 03:47:04 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 03:47:04 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:47:04 user nova-compute[75378]:       <source dev="/dev/sdf"/>
Nov 09 03:47:04 user nova-compute[75378]:       <target dev="vdc" bus="virtio"/>
Nov 09 03:47:04 user nova-compute[75378]:       <serial>eb2e5acb-e73c-45dc-9cb5-31e6489d682d</serial>
Nov 09 03:47:04 user nova-compute[75378]:     </disk>
Nov 09 03:47:04 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:47:04 user nova-compute[75378]:       <mac address="fa:16:3e:bc:91:1f"/>
Nov 09 03:47:04 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:47:04 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:47:04 user nova-compute[75378]:       <target dev="tap37ed92ed-0e"/>
Nov 09 03:47:04 user nova-compute[75378]:     </interface>
Nov 09 03:47:04 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:47:04 user nova-compute[75378]:       <mac address="fa:16:3e:0d:b1:a6"/>
Nov 09 03:47:04 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:47:04 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:47:04 user nova-compute[75378]:       <target dev="tap95465b85-15"/>
Nov 09 03:47:04 user nova-compute[75378]:     </interface>
Nov 09 03:47:04 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:47:04 user nova-compute[75378]:       <mac address="fa:16:3e:b7:e8:0e"/>
Nov 09 03:47:04 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:47:04 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:47:04 user nova-compute[75378]:       <target dev="tap4dd2d935-db"/>
Nov 09 03:47:04 user nova-compute[75378]:     </interface>
Nov 09 03:47:04 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:47:04 user nova-compute[75378]:       <mac address="fa:16:3e:35:0f:09"/>
Nov 09 03:47:04 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:47:04 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:47:04 user nova-compute[75378]:       <target dev="tap427ba1a1-d2"/>
Nov 09 03:47:04 user nova-compute[75378]:     </interface>
Nov 09 03:47:04 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:47:04 user nova-compute[75378]:       <mac address="fa:16:3e:b4:02:cf"/>
Nov 09 03:47:04 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:47:04 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:47:04 user nova-compute[75378]:       <target dev="tape2bab297-67"/>
Nov 09 03:47:04 user nova-compute[75378]:     </interface>
Nov 09 03:47:04 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:47:04 user nova-compute[75378]:       <mac address="fa:16:3e:9c:68:a7"/>
Nov 09 03:47:04 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:47:04 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:47:04 user nova-compute[75378]:       <target dev="tap2195503e-d6"/>
Nov 09 03:47:04 user nova-compute[75378]:     </interface>
Nov 09 03:47:04 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:47:04 user nova-compute[75378]:       <mac address="fa:16:3e:1f:60:09"/>
Nov 09 03:47:04 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:47:04 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:47:04 user nova-compute[75378]:       <target dev="tapabe16ed0-6d"/>
Nov 09 03:47:04 user nova-compute[75378]:     </interface>
Nov 09 03:47:04 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:47:04 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/c4ef6623-863b-40a8-b9ec-720c25ee3484/console.log" append="off"/>
Nov 09 03:47:04 user nova-compute[75378]:     </serial>
Nov 09 03:47:04 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:47:04 user nova-compute[75378]:     <video>
Nov 09 03:47:04 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:47:04 user nova-compute[75378]:     </video>
Nov 09 03:47:04 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:47:04 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:47:04 user nova-compute[75378]:     </rng>
Nov 09 03:47:04 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:47:04 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:47:04 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:47:04 user nova-compute[75378]:     </memballoon>
Nov 09 03:47:04 user nova-compute[75378]:   </devices>
Nov 09 03:47:04 user nova-compute[75378]: </domain>
Nov 09 03:47:04 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237131222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237131222',id=19,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH/xMJVpGaoZZKT5yOQG9YEsZHK0qinmMJc/4GspFhdUxnsc9HXa+tGmNHJBRf9ENKRejYCxxtWI6LtFW1RAoW6wOuC43TGFdsh0nVlz83OuXmFj2lwOBO1pGyFNwxCfA==',key_name='tempest-keypair-1130216547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b7a5a29e104b60ae779f864d5c202f',ramdisk_id='',reservation_id='r-xxkikjoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1739662256',owner_user_name='tempest-TaggedBootDevicesTest_v242-1739662256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd895f640a78436cb439a4d0e82fe36f',uuid=c4ef6623-863b-40a8-b9ec-720c25ee3484,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "address": "fa:16:3e:bc:91:1f", "network": {"id": "1c13e251-154e-4521-9b3c-443bb29cc577", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071356817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ed92ed-0e", "ovs_interfaceid": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converting VIF {"id": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "address": "fa:16:3e:bc:91:1f", "network": {"id": "1c13e251-154e-4521-9b3c-443bb29cc577", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071356817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ed92ed-0e", "ovs_interfaceid": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:91:1f,bridge_name='br-int',has_traffic_filtering=True,id=37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d,network=Network(1c13e251-154e-4521-9b3c-443bb29cc577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ed92ed-0e') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG os_vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:91:1f,bridge_name='br-int',has_traffic_filtering=True,id=37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d,network=Network(1c13e251-154e-4521-9b3c-443bb29cc577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ed92ed-0e') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fcfc921a-2e2c-5be7-a508-1135afb99676', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37ed92ed-0e, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37ed92ed-0e, col_values=(('qos', UUID('4ae27179-ad46-49aa-ad3f-55f4c354ef0a')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37ed92ed-0e, col_values=(('external_ids', {'iface-id': '37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:91:1f', 'vm-uuid': 'c4ef6623-863b-40a8-b9ec-720c25ee3484'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:04 user nova-compute[75378]: INFO os_vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:91:1f,bridge_name='br-int',has_traffic_filtering=True,id=37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d,network=Network(1c13e251-154e-4521-9b3c-443bb29cc577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ed92ed-0e')
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237131222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237131222',id=19,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH/xMJVpGaoZZKT5yOQG9YEsZHK0qinmMJc/4GspFhdUxnsc9HXa+tGmNHJBRf9ENKRejYCxxtWI6LtFW1RAoW6wOuC43TGFdsh0nVlz83OuXmFj2lwOBO1pGyFNwxCfA==',key_name='tempest-keypair-1130216547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b7a5a29e104b60ae779f864d5c202f',ramdisk_id='',reservation_id='r-xxkikjoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1739662256',owner_user_name='tempest-TaggedBootDevicesTest_v242-1739662256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd895f640a78436cb439a4d0e82fe36f',uuid=c4ef6623-863b-40a8-b9ec-720c25ee3484,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "address": "fa:16:3e:0d:b1:a6", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95465b85-15", "ovs_interfaceid": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converting VIF {"id": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "address": "fa:16:3e:0d:b1:a6", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95465b85-15", "ovs_interfaceid": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b1:a6,bridge_name='br-int',has_traffic_filtering=True,id=95465b85-15fb-4cf7-9db9-23c5e4a755c8,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap95465b85-15') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG os_vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b1:a6,bridge_name='br-int',has_traffic_filtering=True,id=95465b85-15fb-4cf7-9db9-23c5e4a755c8,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap95465b85-15') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e59cc295-1fc1-578c-95d9-5889dc59fc24', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95465b85-15, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95465b85-15, col_values=(('qos', UUID('d0f8186a-7fa4-46bf-b3c9-b6f020e552df')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95465b85-15, col_values=(('external_ids', {'iface-id': '95465b85-15fb-4cf7-9db9-23c5e4a755c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:b1:a6', 'vm-uuid': 'c4ef6623-863b-40a8-b9ec-720c25ee3484'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: INFO os_vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b1:a6,bridge_name='br-int',has_traffic_filtering=True,id=95465b85-15fb-4cf7-9db9-23c5e4a755c8,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap95465b85-15')
Nov 09 03:47:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237131222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237131222',id=19,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH/xMJVpGaoZZKT5yOQG9YEsZHK0qinmMJc/4GspFhdUxnsc9HXa+tGmNHJBRf9ENKRejYCxxtWI6LtFW1RAoW6wOuC43TGFdsh0nVlz83OuXmFj2lwOBO1pGyFNwxCfA==',key_name='tempest-keypair-1130216547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b7a5a29e104b60ae779f864d5c202f',ramdisk_id='',reservation_id='r-xxkikjoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1739662256',owner_user_name='tempest-TaggedBootDevicesTest_v242-1739662256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd895f640a78436cb439a4d0e82fe36f',uuid=c4ef6623-863b-40a8-b9ec-720c25ee3484,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "address": "fa:16:3e:b7:e8:0e", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd2d935-db", "ovs_interfaceid": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converting VIF {"id": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "address": "fa:16:3e:b7:e8:0e", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd2d935-db", "ovs_interfaceid": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e8:0e,bridge_name='br-int',has_traffic_filtering=True,id=4dd2d935-dbaf-445e-aa45-30114c1df2a8,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4dd2d935-db') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG os_vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e8:0e,bridge_name='br-int',has_traffic_filtering=True,id=4dd2d935-dbaf-445e-aa45-30114c1df2a8,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4dd2d935-db') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9dbb285c-2e6a-534a-8de4-fadf54d61cf4', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4dd2d935-db, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4dd2d935-db, col_values=(('qos', UUID('8c23b5e0-f05a-4822-9040-b21153cc739d')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4dd2d935-db, col_values=(('external_ids', {'iface-id': '4dd2d935-dbaf-445e-aa45-30114c1df2a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:e8:0e', 'vm-uuid': 'c4ef6623-863b-40a8-b9ec-720c25ee3484'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: INFO os_vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e8:0e,bridge_name='br-int',has_traffic_filtering=True,id=4dd2d935-dbaf-445e-aa45-30114c1df2a8,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4dd2d935-db')
Nov 09 03:47:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237131222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237131222',id=19,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH/xMJVpGaoZZKT5yOQG9YEsZHK0qinmMJc/4GspFhdUxnsc9HXa+tGmNHJBRf9ENKRejYCxxtWI6LtFW1RAoW6wOuC43TGFdsh0nVlz83OuXmFj2lwOBO1pGyFNwxCfA==',key_name='tempest-keypair-1130216547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b7a5a29e104b60ae779f864d5c202f',ramdisk_id='',reservation_id='r-xxkikjoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1739662256',owner_user_name='tempest-TaggedBootDevicesTest_v242-1739662256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd895f640a78436cb439a4d0e82fe36f',uuid=c4ef6623-863b-40a8-b9ec-720c25ee3484,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "address": "fa:16:3e:35:0f:09", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ba1a1-d2", "ovs_interfaceid": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converting VIF {"id": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "address": "fa:16:3e:35:0f:09", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ba1a1-d2", "ovs_interfaceid": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=427ba1a1-d2a8-431b-aeea-d455e8908e7a,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427ba1a1-d2') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG os_vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=427ba1a1-d2a8-431b-aeea-d455e8908e7a,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427ba1a1-d2') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7840a343-54c2-5a81-bb20-00b75ba75ab3', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap427ba1a1-d2, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap427ba1a1-d2, col_values=(('qos', UUID('be2e1fd0-726f-4f0b-987b-85cfbfdb4f3b')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap427ba1a1-d2, col_values=(('external_ids', {'iface-id': '427ba1a1-d2a8-431b-aeea-d455e8908e7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:0f:09', 'vm-uuid': 'c4ef6623-863b-40a8-b9ec-720c25ee3484'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: INFO os_vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=427ba1a1-d2a8-431b-aeea-d455e8908e7a,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427ba1a1-d2')
Nov 09 03:47:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237131222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237131222',id=19,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH/xMJVpGaoZZKT5yOQG9YEsZHK0qinmMJc/4GspFhdUxnsc9HXa+tGmNHJBRf9ENKRejYCxxtWI6LtFW1RAoW6wOuC43TGFdsh0nVlz83OuXmFj2lwOBO1pGyFNwxCfA==',key_name='tempest-keypair-1130216547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b7a5a29e104b60ae779f864d5c202f',ramdisk_id='',reservation_id='r-xxkikjoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1739662256',owner_user_name='tempest-TaggedBootDevicesTest_v242-1739662256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd895f640a78436cb439a4d0e82fe36f',uuid=c4ef6623-863b-40a8-b9ec-720c25ee3484,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2bab297-674f-41e7-baac-73eb91483899", "address": "fa:16:3e:b4:02:cf", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bab297-67", "ovs_interfaceid": "e2bab297-674f-41e7-baac-73eb91483899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converting VIF {"id": "e2bab297-674f-41e7-baac-73eb91483899", "address": "fa:16:3e:b4:02:cf", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bab297-67", "ovs_interfaceid": "e2bab297-674f-41e7-baac-73eb91483899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:02:cf,bridge_name='br-int',has_traffic_filtering=True,id=e2bab297-674f-41e7-baac-73eb91483899,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2bab297-67') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG os_vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:02:cf,bridge_name='br-int',has_traffic_filtering=True,id=e2bab297-674f-41e7-baac-73eb91483899,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2bab297-67') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2d9d252-614a-512f-a296-aa5a9c61a651', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2bab297-67, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2bab297-67, col_values=(('qos', UUID('59889eb2-c093-4b7b-922b-d0017124285f')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2bab297-67, col_values=(('external_ids', {'iface-id': 'e2bab297-674f-41e7-baac-73eb91483899', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:02:cf', 'vm-uuid': 'c4ef6623-863b-40a8-b9ec-720c25ee3484'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: INFO os_vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:02:cf,bridge_name='br-int',has_traffic_filtering=True,id=e2bab297-674f-41e7-baac-73eb91483899,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2bab297-67')
Nov 09 03:47:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237131222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237131222',id=19,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH/xMJVpGaoZZKT5yOQG9YEsZHK0qinmMJc/4GspFhdUxnsc9HXa+tGmNHJBRf9ENKRejYCxxtWI6LtFW1RAoW6wOuC43TGFdsh0nVlz83OuXmFj2lwOBO1pGyFNwxCfA==',key_name='tempest-keypair-1130216547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b7a5a29e104b60ae779f864d5c202f',ramdisk_id='',reservation_id='r-xxkikjoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1739662256',owner_user_name='tempest-TaggedBootDevicesTest_v242-1739662256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd895f640a78436cb439a4d0e82fe36f',uuid=c4ef6623-863b-40a8-b9ec-720c25ee3484,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2195503e-d6da-4598-9478-2956f48d2b8e", "address": "fa:16:3e:9c:68:a7", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2195503e-d6", "ovs_interfaceid": "2195503e-d6da-4598-9478-2956f48d2b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converting VIF {"id": "2195503e-d6da-4598-9478-2956f48d2b8e", "address": "fa:16:3e:9c:68:a7", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2195503e-d6", "ovs_interfaceid": "2195503e-d6da-4598-9478-2956f48d2b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:68:a7,bridge_name='br-int',has_traffic_filtering=True,id=2195503e-d6da-4598-9478-2956f48d2b8e,network=Network(36b4d72f-7b08-4926-b623-bcc9260201a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2195503e-d6') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG os_vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:68:a7,bridge_name='br-int',has_traffic_filtering=True,id=2195503e-d6da-4598-9478-2956f48d2b8e,network=Network(36b4d72f-7b08-4926-b623-bcc9260201a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2195503e-d6') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ad6f872-1110-598e-8981-e6cde9e817eb', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2195503e-d6, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2195503e-d6, col_values=(('qos', UUID('362d7277-fa48-440d-a8b9-b146223f6c26')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2195503e-d6, col_values=(('external_ids', {'iface-id': '2195503e-d6da-4598-9478-2956f48d2b8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:68:a7', 'vm-uuid': 'c4ef6623-863b-40a8-b9ec-720c25ee3484'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: INFO os_vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:68:a7,bridge_name='br-int',has_traffic_filtering=True,id=2195503e-d6da-4598-9478-2956f48d2b8e,network=Network(36b4d72f-7b08-4926-b623-bcc9260201a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2195503e-d6')
Nov 09 03:47:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237131222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237131222',id=19,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH/xMJVpGaoZZKT5yOQG9YEsZHK0qinmMJc/4GspFhdUxnsc9HXa+tGmNHJBRf9ENKRejYCxxtWI6LtFW1RAoW6wOuC43TGFdsh0nVlz83OuXmFj2lwOBO1pGyFNwxCfA==',key_name='tempest-keypair-1130216547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9b7a5a29e104b60ae779f864d5c202f',ramdisk_id='',reservation_id='r-xxkikjoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1739662256',owner_user_name='tempest-TaggedBootDevicesTest_v242-1739662256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd895f640a78436cb439a4d0e82fe36f',uuid=c4ef6623-863b-40a8-b9ec-720c25ee3484,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "address": "fa:16:3e:1f:60:09", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe16ed0-6d", "ovs_interfaceid": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converting VIF {"id": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "address": "fa:16:3e:1f:60:09", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe16ed0-6d", "ovs_interfaceid": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:60:09,bridge_name='br-int',has_traffic_filtering=True,id=abe16ed0-6d62-41c1-8bfd-da97d9908143,network=Network(36b4d72f-7b08-4926-b623-bcc9260201a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe16ed0-6d') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG os_vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:60:09,bridge_name='br-int',has_traffic_filtering=True,id=abe16ed0-6d62-41c1-8bfd-da97d9908143,network=Network(36b4d72f-7b08-4926-b623-bcc9260201a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe16ed0-6d') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '780171f0-46ae-5791-abef-50437f9ccc54', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabe16ed0-6d, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapabe16ed0-6d, col_values=(('qos', UUID('af05a216-c7bb-4b28-88ae-b3f93fb517b5')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapabe16ed0-6d, col_values=(('external_ids', {'iface-id': 'abe16ed0-6d62-41c1-8bfd-da97d9908143', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:60:09', 'vm-uuid': 'c4ef6623-863b-40a8-b9ec-720c25ee3484'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: INFO os_vif [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:60:09,bridge_name='br-int',has_traffic_filtering=True,id=abe16ed0-6d62-41c1-8bfd-da97d9908143,network=Network(36b4d72f-7b08-4926-b623-bcc9260201a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe16ed0-6d')
Nov 09 03:47:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] No BDM found with device name hda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] No VIF found with MAC fa:16:3e:bc:91:1f, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:47:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] No VIF found with MAC fa:16:3e:b4:02:cf, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:47:05 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Using config drive
Nov 09 03:47:06 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Creating config drive at /opt/stack/data/nova/instances/c4ef6623-863b-40a8-b9ec-720c25ee3484/disk.config
Nov 09 03:47:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c4ef6623-863b-40a8-b9ec-720c25ee3484/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpi0jqfhgu {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c4ef6623-863b-40a8-b9ec-720c25ee3484/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpi0jqfhgu" returned: 0 in 0.069s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:08 user nova-compute[75378]: DEBUG nova.compute.manager [req-9c5a2f75-b999-46bc-a3e6-3aee07630206 req-5debf4dc-ed4d-468d-ae10-65f8d768ef13 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-plugged-37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9c5a2f75-b999-46bc-a3e6-3aee07630206 req-5debf4dc-ed4d-468d-ae10-65f8d768ef13 service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9c5a2f75-b999-46bc-a3e6-3aee07630206 req-5debf4dc-ed4d-468d-ae10-65f8d768ef13 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9c5a2f75-b999-46bc-a3e6-3aee07630206 req-5debf4dc-ed4d-468d-ae10-65f8d768ef13 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:08 user nova-compute[75378]: DEBUG nova.compute.manager [req-9c5a2f75-b999-46bc-a3e6-3aee07630206 req-5debf4dc-ed4d-468d-ae10-65f8d768ef13 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-plugged-37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:08 user nova-compute[75378]: WARNING nova.compute.manager [req-9c5a2f75-b999-46bc-a3e6-3aee07630206 req-5debf4dc-ed4d-468d-ae10-65f8d768ef13 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received unexpected event network-vif-plugged-37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d for instance with vm_state building and task_state spawning.
Nov 09 03:47:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-plugged-37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-plugged-37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:10 user nova-compute[75378]: WARNING nova.compute.manager [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received unexpected event network-vif-plugged-37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d for instance with vm_state building and task_state spawning.
Nov 09 03:47:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-plugged-95465b85-15fb-4cf7-9db9-23c5e4a755c8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-plugged-95465b85-15fb-4cf7-9db9-23c5e4a755c8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:10 user nova-compute[75378]: WARNING nova.compute.manager [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received unexpected event network-vif-plugged-95465b85-15fb-4cf7-9db9-23c5e4a755c8 for instance with vm_state building and task_state spawning.
Nov 09 03:47:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-plugged-95465b85-15fb-4cf7-9db9-23c5e4a755c8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-plugged-95465b85-15fb-4cf7-9db9-23c5e4a755c8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:10 user nova-compute[75378]: WARNING nova.compute.manager [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received unexpected event network-vif-plugged-95465b85-15fb-4cf7-9db9-23c5e4a755c8 for instance with vm_state building and task_state spawning.
Nov 09 03:47:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-plugged-4dd2d935-dbaf-445e-aa45-30114c1df2a8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-plugged-4dd2d935-dbaf-445e-aa45-30114c1df2a8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:10 user nova-compute[75378]: WARNING nova.compute.manager [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received unexpected event network-vif-plugged-4dd2d935-dbaf-445e-aa45-30114c1df2a8 for instance with vm_state building and task_state spawning.
Nov 09 03:47:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-plugged-4dd2d935-dbaf-445e-aa45-30114c1df2a8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-plugged-4dd2d935-dbaf-445e-aa45-30114c1df2a8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:10 user nova-compute[75378]: WARNING nova.compute.manager [req-e14c459a-794f-4b04-a471-4bc5771213b4 req-eadc2dd0-a22d-4be2-bac9-9b8da5eb1e1e service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received unexpected event network-vif-plugged-4dd2d935-dbaf-445e-aa45-30114c1df2a8 for instance with vm_state building and task_state spawning.
Nov 09 03:47:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-e6c7ead5-09d1-4c1c-b50e-c353370b23c2 req-69a98310-4d03-427c-a9cb-9e2aa6e6cc98 service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Received event network-changed-f0d55e97-a560-4a15-aa75-37045342f477 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-e6c7ead5-09d1-4c1c-b50e-c353370b23c2 req-69a98310-4d03-427c-a9cb-9e2aa6e6cc98 service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Refreshing instance network info cache due to event network-changed-f0d55e97-a560-4a15-aa75-37045342f477. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e6c7ead5-09d1-4c1c-b50e-c353370b23c2 req-69a98310-4d03-427c-a9cb-9e2aa6e6cc98 service nova] Acquiring lock "refresh_cache-883490f1-6a9f-4ad6-83c4-44b78e681de6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e6c7ead5-09d1-4c1c-b50e-c353370b23c2 req-69a98310-4d03-427c-a9cb-9e2aa6e6cc98 service nova] Acquired lock "refresh_cache-883490f1-6a9f-4ad6-83c4-44b78e681de6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG nova.network.neutron [req-e6c7ead5-09d1-4c1c-b50e-c353370b23c2 req-69a98310-4d03-427c-a9cb-9e2aa6e6cc98 service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Refreshing network info cache for port f0d55e97-a560-4a15-aa75-37045342f477 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "2abe50f8-3c9b-417e-889f-1d565089d678" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "2abe50f8-3c9b-417e-889f-1d565089d678" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:10 user nova-compute[75378]: DEBUG nova.compute.manager [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:47:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:11 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:47:11 user nova-compute[75378]: INFO nova.compute.claims [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Claim successful on node user
Nov 09 03:47:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:11 user nova-compute[75378]: DEBUG nova.network.neutron [req-e6c7ead5-09d1-4c1c-b50e-c353370b23c2 req-69a98310-4d03-427c-a9cb-9e2aa6e6cc98 service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Updated VIF entry in instance network info cache for port f0d55e97-a560-4a15-aa75-37045342f477. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:47:11 user nova-compute[75378]: DEBUG nova.network.neutron [req-e6c7ead5-09d1-4c1c-b50e-c353370b23c2 req-69a98310-4d03-427c-a9cb-9e2aa6e6cc98 service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Updating instance_info_cache with network_info: [{"id": "f0d55e97-a560-4a15-aa75-37045342f477", "address": "fa:16:3e:a8:5c:b5", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d55e97-a5", "ovs_interfaceid": "f0d55e97-a560-4a15-aa75-37045342f477", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:47:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e6c7ead5-09d1-4c1c-b50e-c353370b23c2 req-69a98310-4d03-427c-a9cb-9e2aa6e6cc98 service nova] Releasing lock "refresh_cache-883490f1-6a9f-4ad6-83c4-44b78e681de6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:47:11 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:47:11 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:47:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.614s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:11 user nova-compute[75378]: DEBUG nova.compute.manager [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:47:11 user nova-compute[75378]: DEBUG nova.compute.manager [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:47:11 user nova-compute[75378]: DEBUG nova.network.neutron [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:47:11 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:47:11 user nova-compute[75378]: DEBUG nova.compute.manager [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:47:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.compute.manager [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:47:12 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Creating image(s)
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "/opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "/opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "/opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.policy [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fadaa571b9b47a4a5978149c070f344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6633f406337a45599d107946b7d4dfdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.278s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-f1a298f5-8b4b-4b92-accf-cc969c5131f5 req-562ecd16-e5f9-48b1-9335-c9e761df4336 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-plugged-abe16ed0-6d62-41c1-8bfd-da97d9908143 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f1a298f5-8b4b-4b92-accf-cc969c5131f5 req-562ecd16-e5f9-48b1-9335-c9e761df4336 service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f1a298f5-8b4b-4b92-accf-cc969c5131f5 req-562ecd16-e5f9-48b1-9335-c9e761df4336 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f1a298f5-8b4b-4b92-accf-cc969c5131f5 req-562ecd16-e5f9-48b1-9335-c9e761df4336 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-f1a298f5-8b4b-4b92-accf-cc969c5131f5 req-562ecd16-e5f9-48b1-9335-c9e761df4336 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-plugged-abe16ed0-6d62-41c1-8bfd-da97d9908143 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:12 user nova-compute[75378]: WARNING nova.compute.manager [req-f1a298f5-8b4b-4b92-accf-cc969c5131f5 req-562ecd16-e5f9-48b1-9335-c9e761df4336 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received unexpected event network-vif-plugged-abe16ed0-6d62-41c1-8bfd-da97d9908143 for instance with vm_state building and task_state spawning.
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-f1a298f5-8b4b-4b92-accf-cc969c5131f5 req-562ecd16-e5f9-48b1-9335-c9e761df4336 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-plugged-abe16ed0-6d62-41c1-8bfd-da97d9908143 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f1a298f5-8b4b-4b92-accf-cc969c5131f5 req-562ecd16-e5f9-48b1-9335-c9e761df4336 service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f1a298f5-8b4b-4b92-accf-cc969c5131f5 req-562ecd16-e5f9-48b1-9335-c9e761df4336 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f1a298f5-8b4b-4b92-accf-cc969c5131f5 req-562ecd16-e5f9-48b1-9335-c9e761df4336 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-f1a298f5-8b4b-4b92-accf-cc969c5131f5 req-562ecd16-e5f9-48b1-9335-c9e761df4336 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-plugged-abe16ed0-6d62-41c1-8bfd-da97d9908143 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:12 user nova-compute[75378]: WARNING nova.compute.manager [req-f1a298f5-8b4b-4b92-accf-cc969c5131f5 req-562ecd16-e5f9-48b1-9335-c9e761df4336 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received unexpected event network-vif-plugged-abe16ed0-6d62-41c1-8bfd-da97d9908143 for instance with vm_state building and task_state spawning.
Nov 09 03:47:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-95ef5810-dbfd-4ba9-a87d-901d5e8f48fd req-229e1991-f5a1-4bcd-b87c-cb4b87297fb8 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-plugged-427ba1a1-d2a8-431b-aeea-d455e8908e7a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-95ef5810-dbfd-4ba9-a87d-901d5e8f48fd req-229e1991-f5a1-4bcd-b87c-cb4b87297fb8 service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-95ef5810-dbfd-4ba9-a87d-901d5e8f48fd req-229e1991-f5a1-4bcd-b87c-cb4b87297fb8 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-95ef5810-dbfd-4ba9-a87d-901d5e8f48fd req-229e1991-f5a1-4bcd-b87c-cb4b87297fb8 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-95ef5810-dbfd-4ba9-a87d-901d5e8f48fd req-229e1991-f5a1-4bcd-b87c-cb4b87297fb8 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-plugged-427ba1a1-d2a8-431b-aeea-d455e8908e7a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:12 user nova-compute[75378]: WARNING nova.compute.manager [req-95ef5810-dbfd-4ba9-a87d-901d5e8f48fd req-229e1991-f5a1-4bcd-b87c-cb4b87297fb8 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received unexpected event network-vif-plugged-427ba1a1-d2a8-431b-aeea-d455e8908e7a for instance with vm_state building and task_state spawning.
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.194s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk 1073741824" returned: 0 in 0.056s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:12 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Instance spawned successfully.
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:47:12 user nova-compute[75378]: INFO nova.compute.manager [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Took 12.33 seconds to spawn the instance on the hypervisor.
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.262s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-167d7d66-edd2-4aec-96ba-982fb833787a req-19978c86-64bf-466b-8280-03a5fc2cbc69 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-plugged-e2bab297-674f-41e7-baac-73eb91483899 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-167d7d66-edd2-4aec-96ba-982fb833787a req-19978c86-64bf-466b-8280-03a5fc2cbc69 service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-167d7d66-edd2-4aec-96ba-982fb833787a req-19978c86-64bf-466b-8280-03a5fc2cbc69 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-167d7d66-edd2-4aec-96ba-982fb833787a req-19978c86-64bf-466b-8280-03a5fc2cbc69 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-167d7d66-edd2-4aec-96ba-982fb833787a req-19978c86-64bf-466b-8280-03a5fc2cbc69 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-plugged-e2bab297-674f-41e7-baac-73eb91483899 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:12 user nova-compute[75378]: WARNING nova.compute.manager [req-167d7d66-edd2-4aec-96ba-982fb833787a req-19978c86-64bf-466b-8280-03a5fc2cbc69 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received unexpected event network-vif-plugged-e2bab297-674f-41e7-baac-73eb91483899 for instance with vm_state building and task_state spawning.
Nov 09 03:47:12 user nova-compute[75378]: INFO nova.compute.manager [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Took 101.23 seconds to build instance.
Nov 09 03:47:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9ef72c1f-146b-4d27-9474-b6430f2e72b8 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 101.391s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:13 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Cannot resize image /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:47:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:47:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Ensure instance console log exists: /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:47:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:14 user nova-compute[75378]: DEBUG nova.network.neutron [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Successfully created port: f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:47:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-43f884ef-4bd3-4d99-a570-44e780b71586 req-9dd1ced7-2e1c-4652-b92f-c2ab61952f02 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-plugged-427ba1a1-d2a8-431b-aeea-d455e8908e7a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-43f884ef-4bd3-4d99-a570-44e780b71586 req-9dd1ced7-2e1c-4652-b92f-c2ab61952f02 service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-43f884ef-4bd3-4d99-a570-44e780b71586 req-9dd1ced7-2e1c-4652-b92f-c2ab61952f02 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-43f884ef-4bd3-4d99-a570-44e780b71586 req-9dd1ced7-2e1c-4652-b92f-c2ab61952f02 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-43f884ef-4bd3-4d99-a570-44e780b71586 req-9dd1ced7-2e1c-4652-b92f-c2ab61952f02 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-plugged-427ba1a1-d2a8-431b-aeea-d455e8908e7a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:14 user nova-compute[75378]: WARNING nova.compute.manager [req-43f884ef-4bd3-4d99-a570-44e780b71586 req-9dd1ced7-2e1c-4652-b92f-c2ab61952f02 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received unexpected event network-vif-plugged-427ba1a1-d2a8-431b-aeea-d455e8908e7a for instance with vm_state active and task_state None.
Nov 09 03:47:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-43f884ef-4bd3-4d99-a570-44e780b71586 req-9dd1ced7-2e1c-4652-b92f-c2ab61952f02 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-plugged-2195503e-d6da-4598-9478-2956f48d2b8e {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-43f884ef-4bd3-4d99-a570-44e780b71586 req-9dd1ced7-2e1c-4652-b92f-c2ab61952f02 service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-43f884ef-4bd3-4d99-a570-44e780b71586 req-9dd1ced7-2e1c-4652-b92f-c2ab61952f02 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-43f884ef-4bd3-4d99-a570-44e780b71586 req-9dd1ced7-2e1c-4652-b92f-c2ab61952f02 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-43f884ef-4bd3-4d99-a570-44e780b71586 req-9dd1ced7-2e1c-4652-b92f-c2ab61952f02 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-plugged-2195503e-d6da-4598-9478-2956f48d2b8e {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:14 user nova-compute[75378]: WARNING nova.compute.manager [req-43f884ef-4bd3-4d99-a570-44e780b71586 req-9dd1ced7-2e1c-4652-b92f-c2ab61952f02 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received unexpected event network-vif-plugged-2195503e-d6da-4598-9478-2956f48d2b8e for instance with vm_state active and task_state None.
Nov 09 03:47:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-43f884ef-4bd3-4d99-a570-44e780b71586 req-9dd1ced7-2e1c-4652-b92f-c2ab61952f02 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-plugged-2195503e-d6da-4598-9478-2956f48d2b8e {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-43f884ef-4bd3-4d99-a570-44e780b71586 req-9dd1ced7-2e1c-4652-b92f-c2ab61952f02 service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-43f884ef-4bd3-4d99-a570-44e780b71586 req-9dd1ced7-2e1c-4652-b92f-c2ab61952f02 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-43f884ef-4bd3-4d99-a570-44e780b71586 req-9dd1ced7-2e1c-4652-b92f-c2ab61952f02 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-43f884ef-4bd3-4d99-a570-44e780b71586 req-9dd1ced7-2e1c-4652-b92f-c2ab61952f02 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-plugged-2195503e-d6da-4598-9478-2956f48d2b8e {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:14 user nova-compute[75378]: WARNING nova.compute.manager [req-43f884ef-4bd3-4d99-a570-44e780b71586 req-9dd1ced7-2e1c-4652-b92f-c2ab61952f02 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received unexpected event network-vif-plugged-2195503e-d6da-4598-9478-2956f48d2b8e for instance with vm_state active and task_state None.
Nov 09 03:47:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-91dd7ce8-4ceb-4ec6-b5c8-10c6dbf5a408 req-d865b114-0c65-473e-8101-f08a4e5c0cae service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-plugged-e2bab297-674f-41e7-baac-73eb91483899 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-91dd7ce8-4ceb-4ec6-b5c8-10c6dbf5a408 req-d865b114-0c65-473e-8101-f08a4e5c0cae service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-91dd7ce8-4ceb-4ec6-b5c8-10c6dbf5a408 req-d865b114-0c65-473e-8101-f08a4e5c0cae service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-91dd7ce8-4ceb-4ec6-b5c8-10c6dbf5a408 req-d865b114-0c65-473e-8101-f08a4e5c0cae service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-91dd7ce8-4ceb-4ec6-b5c8-10c6dbf5a408 req-d865b114-0c65-473e-8101-f08a4e5c0cae service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-plugged-e2bab297-674f-41e7-baac-73eb91483899 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:14 user nova-compute[75378]: WARNING nova.compute.manager [req-91dd7ce8-4ceb-4ec6-b5c8-10c6dbf5a408 req-d865b114-0c65-473e-8101-f08a4e5c0cae service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received unexpected event network-vif-plugged-e2bab297-674f-41e7-baac-73eb91483899 for instance with vm_state active and task_state None.
Nov 09 03:47:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.network.neutron [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Successfully updated port: f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquired lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.network.neutron [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.network.neutron [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.network.neutron [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Updating instance_info_cache with network_info: [{"id": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "address": "fa:16:3e:76:38:86", "network": {"id": "99b3e8be-7102-4b9a-aeae-3151b634d431", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6633f406337a45599d107946b7d4dfdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d1103d-bc", "ovs_interfaceid": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Releasing lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.compute.manager [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Instance network_info: |[{"id": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "address": "fa:16:3e:76:38:86", "network": {"id": "99b3e8be-7102-4b9a-aeae-3151b634d431", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6633f406337a45599d107946b7d4dfdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d1103d-bc", "ovs_interfaceid": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Start _get_guest_xml network_info=[{"id": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "address": "fa:16:3e:76:38:86", "network": {"id": "99b3e8be-7102-4b9a-aeae-3151b634d431", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6633f406337a45599d107946b7d4dfdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d1103d-bc", "ovs_interfaceid": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:47:15 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:47:15 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:47:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-923846665',display_name='tempest-ServerStableDeviceRescueTest-server-923846665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-923846665',id=24,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6vPwFrNFPEfbM2OavXaL8l/ouKox+s8izxBC7SxRx4T9FG3kQK/fpJG8Pg3/KTsjW9v2sQ6HRculfxxLxqRaMpZaq1p8ooFGUp+q7xPNn822yLnMs4FIk9MYMVPb05XQ==',key_name='tempest-keypair-1087149700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6633f406337a45599d107946b7d4dfdd',ramdisk_id='',reservation_id='r-e4hle5lx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1146989307',owner_user_name='tempest-ServerStableDeviceRescueTest-1146989307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:47:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fadaa571b9b47a4a5978149c070f344',uuid=2abe50f8-3c9b-417e-889f-1d565089d678,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "address": "fa:16:3e:76:38:86", "network": {"id": "99b3e8be-7102-4b9a-aeae-3151b634d431", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6633f406337a45599d107946b7d4dfdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d1103d-bc", "ovs_interfaceid": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Converting VIF {"id": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "address": "fa:16:3e:76:38:86", "network": {"id": "99b3e8be-7102-4b9a-aeae-3151b634d431", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6633f406337a45599d107946b7d4dfdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d1103d-bc", "ovs_interfaceid": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:38:86,bridge_name='br-int',has_traffic_filtering=True,id=f3d1103d-bcfc-4db6-b227-e1448c56f689,network=Network(99b3e8be-7102-4b9a-aeae-3151b634d431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3d1103d-bc') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:47:15 user nova-compute[75378]: DEBUG nova.objects.instance [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lazy-loading 'pci_devices' on Instance uuid 2abe50f8-3c9b-417e-889f-1d565089d678 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:47:16 user nova-compute[75378]:   <uuid>2abe50f8-3c9b-417e-889f-1d565089d678</uuid>
Nov 09 03:47:16 user nova-compute[75378]:   <name>instance-00000018</name>
Nov 09 03:47:16 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:47:16 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:47:16 user nova-compute[75378]:   <metadata>
Nov 09 03:47:16 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:47:16 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:47:16 user nova-compute[75378]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-923846665</nova:name>
Nov 09 03:47:16 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:47:15</nova:creationTime>
Nov 09 03:47:16 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:47:16 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:47:16 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:47:16 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:47:16 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:47:16 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:47:16 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:47:16 user nova-compute[75378]:       <nova:owner>
Nov 09 03:47:16 user nova-compute[75378]:         <nova:user uuid="9fadaa571b9b47a4a5978149c070f344">tempest-ServerStableDeviceRescueTest-1146989307-project-member</nova:user>
Nov 09 03:47:16 user nova-compute[75378]:         <nova:project uuid="6633f406337a45599d107946b7d4dfdd">tempest-ServerStableDeviceRescueTest-1146989307</nova:project>
Nov 09 03:47:16 user nova-compute[75378]:       </nova:owner>
Nov 09 03:47:16 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:47:16 user nova-compute[75378]:       <nova:ports>
Nov 09 03:47:16 user nova-compute[75378]:         <nova:port uuid="f3d1103d-bcfc-4db6-b227-e1448c56f689">
Nov 09 03:47:16 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 03:47:16 user nova-compute[75378]:         </nova:port>
Nov 09 03:47:16 user nova-compute[75378]:       </nova:ports>
Nov 09 03:47:16 user nova-compute[75378]:     </nova:instance>
Nov 09 03:47:16 user nova-compute[75378]:   </metadata>
Nov 09 03:47:16 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:47:16 user nova-compute[75378]:     <system>
Nov 09 03:47:16 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:47:16 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:47:16 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:47:16 user nova-compute[75378]:       <entry name="serial">2abe50f8-3c9b-417e-889f-1d565089d678</entry>
Nov 09 03:47:16 user nova-compute[75378]:       <entry name="uuid">2abe50f8-3c9b-417e-889f-1d565089d678</entry>
Nov 09 03:47:16 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:47:16 user nova-compute[75378]:     </system>
Nov 09 03:47:16 user nova-compute[75378]:   </sysinfo>
Nov 09 03:47:16 user nova-compute[75378]:   <os>
Nov 09 03:47:16 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:47:16 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:47:16 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:47:16 user nova-compute[75378]:   </os>
Nov 09 03:47:16 user nova-compute[75378]:   <features>
Nov 09 03:47:16 user nova-compute[75378]:     <acpi/>
Nov 09 03:47:16 user nova-compute[75378]:     <apic/>
Nov 09 03:47:16 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:47:16 user nova-compute[75378]:   </features>
Nov 09 03:47:16 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:47:16 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:47:16 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:47:16 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:47:16 user nova-compute[75378]:   </clock>
Nov 09 03:47:16 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:47:16 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:47:16 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:47:16 user nova-compute[75378]:   </cpu>
Nov 09 03:47:16 user nova-compute[75378]:   <devices>
Nov 09 03:47:16 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:47:16 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:47:16 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk"/>
Nov 09 03:47:16 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:47:16 user nova-compute[75378]:     </disk>
Nov 09 03:47:16 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:47:16 user nova-compute[75378]:       <mac address="fa:16:3e:76:38:86"/>
Nov 09 03:47:16 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:47:16 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:47:16 user nova-compute[75378]:       <target dev="tapf3d1103d-bc"/>
Nov 09 03:47:16 user nova-compute[75378]:     </interface>
Nov 09 03:47:16 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:47:16 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/console.log" append="off"/>
Nov 09 03:47:16 user nova-compute[75378]:     </serial>
Nov 09 03:47:16 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:47:16 user nova-compute[75378]:     <video>
Nov 09 03:47:16 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:47:16 user nova-compute[75378]:     </video>
Nov 09 03:47:16 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:47:16 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:47:16 user nova-compute[75378]:     </rng>
Nov 09 03:47:16 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:47:16 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:47:16 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:47:16 user nova-compute[75378]:     </memballoon>
Nov 09 03:47:16 user nova-compute[75378]:   </devices>
Nov 09 03:47:16 user nova-compute[75378]: </domain>
Nov 09 03:47:16 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:47:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-923846665',display_name='tempest-ServerStableDeviceRescueTest-server-923846665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-923846665',id=24,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6vPwFrNFPEfbM2OavXaL8l/ouKox+s8izxBC7SxRx4T9FG3kQK/fpJG8Pg3/KTsjW9v2sQ6HRculfxxLxqRaMpZaq1p8ooFGUp+q7xPNn822yLnMs4FIk9MYMVPb05XQ==',key_name='tempest-keypair-1087149700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6633f406337a45599d107946b7d4dfdd',ramdisk_id='',reservation_id='r-e4hle5lx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1146989307',owner_user_name='tempest-ServerStableDeviceRescueTest-1146989307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:47:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fadaa571b9b47a4a5978149c070f344',uuid=2abe50f8-3c9b-417e-889f-1d565089d678,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "address": "fa:16:3e:76:38:86", "network": {"id": "99b3e8be-7102-4b9a-aeae-3151b634d431", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6633f406337a45599d107946b7d4dfdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d1103d-bc", "ovs_interfaceid": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Converting VIF {"id": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "address": "fa:16:3e:76:38:86", "network": {"id": "99b3e8be-7102-4b9a-aeae-3151b634d431", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6633f406337a45599d107946b7d4dfdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d1103d-bc", "ovs_interfaceid": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:38:86,bridge_name='br-int',has_traffic_filtering=True,id=f3d1103d-bcfc-4db6-b227-e1448c56f689,network=Network(99b3e8be-7102-4b9a-aeae-3151b634d431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3d1103d-bc') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG os_vif [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:38:86,bridge_name='br-int',has_traffic_filtering=True,id=f3d1103d-bcfc-4db6-b227-e1448c56f689,network=Network(99b3e8be-7102-4b9a-aeae-3151b634d431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3d1103d-bc') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dec70a1d-afd3-5ca3-a3f3-bfc4028fed46', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3d1103d-bc, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3d1103d-bc, col_values=(('qos', UUID('048d44d8-1738-44a9-971c-02d7e5b57128')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3d1103d-bc, col_values=(('external_ids', {'iface-id': 'f3d1103d-bcfc-4db6-b227-e1448c56f689', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:38:86', 'vm-uuid': '2abe50f8-3c9b-417e-889f-1d565089d678'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:16 user nova-compute[75378]: INFO os_vif [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:38:86,bridge_name='br-int',has_traffic_filtering=True,id=f3d1103d-bcfc-4db6-b227-e1448c56f689,network=Network(99b3e8be-7102-4b9a-aeae-3151b634d431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3d1103d-bc')
Nov 09 03:47:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] No VIF found with MAC fa:16:3e:76:38:86, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG nova.compute.manager [req-2e526591-de50-49f2-a082-07823a59d8c3 req-73319bd3-27d3-4cf4-99b4-c05ce2b951b8 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received event network-changed-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG nova.compute.manager [req-2e526591-de50-49f2-a082-07823a59d8c3 req-73319bd3-27d3-4cf4-99b4-c05ce2b951b8 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Refreshing instance network info cache due to event network-changed-f3d1103d-bcfc-4db6-b227-e1448c56f689. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2e526591-de50-49f2-a082-07823a59d8c3 req-73319bd3-27d3-4cf4-99b4-c05ce2b951b8 service nova] Acquiring lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2e526591-de50-49f2-a082-07823a59d8c3 req-73319bd3-27d3-4cf4-99b4-c05ce2b951b8 service nova] Acquired lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:47:16 user nova-compute[75378]: DEBUG nova.network.neutron [req-2e526591-de50-49f2-a082-07823a59d8c3 req-73319bd3-27d3-4cf4-99b4-c05ce2b951b8 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Refreshing network info cache for port f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:47:17 user nova-compute[75378]: DEBUG nova.network.neutron [req-2e526591-de50-49f2-a082-07823a59d8c3 req-73319bd3-27d3-4cf4-99b4-c05ce2b951b8 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Updated VIF entry in instance network info cache for port f3d1103d-bcfc-4db6-b227-e1448c56f689. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:47:17 user nova-compute[75378]: DEBUG nova.network.neutron [req-2e526591-de50-49f2-a082-07823a59d8c3 req-73319bd3-27d3-4cf4-99b4-c05ce2b951b8 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Updating instance_info_cache with network_info: [{"id": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "address": "fa:16:3e:76:38:86", "network": {"id": "99b3e8be-7102-4b9a-aeae-3151b634d431", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6633f406337a45599d107946b7d4dfdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d1103d-bc", "ovs_interfaceid": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:47:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2e526591-de50-49f2-a082-07823a59d8c3 req-73319bd3-27d3-4cf4-99b4-c05ce2b951b8 service nova] Releasing lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:47:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-319b2a3c-1f52-4db9-87f2-ffc3a21a212c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "883490f1-6a9f-4ad6-83c4-44b78e681de6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-319b2a3c-1f52-4db9-87f2-ffc3a21a212c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "883490f1-6a9f-4ad6-83c4-44b78e681de6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:17 user nova-compute[75378]: DEBUG nova.objects.instance [None req-319b2a3c-1f52-4db9-87f2-ffc3a21a212c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lazy-loading 'flavor' on Instance uuid 883490f1-6a9f-4ad6-83c4-44b78e681de6 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:47:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-319b2a3c-1f52-4db9-87f2-ffc3a21a212c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "883490f1-6a9f-4ad6-83c4-44b78e681de6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-319b2a3c-1f52-4db9-87f2-ffc3a21a212c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "883490f1-6a9f-4ad6-83c4-44b78e681de6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-319b2a3c-1f52-4db9-87f2-ffc3a21a212c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "883490f1-6a9f-4ad6-83c4-44b78e681de6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:18 user nova-compute[75378]: INFO nova.compute.manager [None req-319b2a3c-1f52-4db9-87f2-ffc3a21a212c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Attaching volume 0480d20b-8103-4ca6-b760-d81d2031366d to /dev/vdb
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Cleaning up deleted instances {{(pid=75378) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] There are 0 instances to clean {{(pid=75378) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG os_brick.utils [None req-319b2a3c-1f52-4db9-87f2-ffc3a21a212c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bed1315-17f8-4a8b-8e44-afdfb5bddb06]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f18e262-8dc5-40fa-931f-fd5c7e5e6299]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG nova.compute.manager [req-1fbc43a0-e9d6-482e-9b1e-65cc18c1c255 req-96015505-b9f5-4b9c-9e72-d2aa4aafd8e6 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received event network-changed-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG nova.compute.manager [req-1fbc43a0-e9d6-482e-9b1e-65cc18c1c255 req-96015505-b9f5-4b9c-9e72-d2aa4aafd8e6 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Refreshing instance network info cache due to event network-changed-e4725ee0-c613-48af-8163-eafad2605fff. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1fbc43a0-e9d6-482e-9b1e-65cc18c1c255 req-96015505-b9f5-4b9c-9e72-d2aa4aafd8e6 service nova] Acquiring lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1fbc43a0-e9d6-482e-9b1e-65cc18c1c255 req-96015505-b9f5-4b9c-9e72-d2aa4aafd8e6 service nova] Acquired lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG nova.network.neutron [req-1fbc43a0-e9d6-482e-9b1e-65cc18c1c255 req-96015505-b9f5-4b9c-9e72-d2aa4aafd8e6 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Refreshing network info cache for port e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[403693a3-22bd-4eff-a23f-ed1ef2322c84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43d727b-d31a-45d6-aea7-3a650544471d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-319b2a3c-1f52-4db9-87f2-ffc3a21a212c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-319b2a3c-1f52-4db9-87f2-ffc3a21a212c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-319b2a3c-1f52-4db9-87f2-ffc3a21a212c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:47:18 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[43130be2-b449-4985-a4e6-29c64abcfde9]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-319b2a3c-1f52-4db9-87f2-ffc3a21a212c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-319b2a3c-1f52-4db9-87f2-ffc3a21a212c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-319b2a3c-1f52-4db9-87f2-ffc3a21a212c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG os_brick.utils [None req-319b2a3c-1f52-4db9-87f2-ffc3a21a212c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] <== get_connector_properties: return (217ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-319b2a3c-1f52-4db9-87f2-ffc3a21a212c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Updating existing volume attachment record: 203ddceb-8c77-4676-95c7-aa255b270147 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG nova.objects.instance [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'flavor' on Instance uuid 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:18 user nova-compute[75378]: INFO nova.compute.manager [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Attaching volume 49c0abde-7447-477d-8cff-0a805a87bf0f to /dev/vdb
Nov 09 03:47:19 user nova-compute[75378]: DEBUG os_brick.utils [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c820778-0df7-41b1-a528-60587036456c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6718ae9-992c-41c5-b979-7af4ca0fdc03]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8730036a-cb03-47b1-9398-2fa17fbcb08b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[becf7b8d-a5ba-40f7-9157-0b19898cf8da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG nova.network.neutron [req-1fbc43a0-e9d6-482e-9b1e-65cc18c1c255 req-96015505-b9f5-4b9c-9e72-d2aa4aafd8e6 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Updated VIF entry in instance network info cache for port e4725ee0-c613-48af-8163-eafad2605fff. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG nova.network.neutron [req-1fbc43a0-e9d6-482e-9b1e-65cc18c1c255 req-96015505-b9f5-4b9c-9e72-d2aa4aafd8e6 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Updating instance_info_cache with network_info: [{"id": "e4725ee0-c613-48af-8163-eafad2605fff", "address": "fa:16:3e:89:f8:61", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4725ee0-c6", "ovs_interfaceid": "e4725ee0-c613-48af-8163-eafad2605fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:47:19 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:47:19 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[639a794e-6595-4bf8-8c7e-92cab719b30f]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG os_brick.utils [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Updating existing volume attachment record: 62dc1643-c639-48fb-b823-7ba615e5eed2 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1fbc43a0-e9d6-482e-9b1e-65cc18c1c255 req-96015505-b9f5-4b9c-9e72-d2aa4aafd8e6 service nova] Releasing lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:47:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:20 user nova-compute[75378]: DEBUG nova.compute.manager [req-d62b129e-591e-48e4-a9ff-64f0d714e435 req-63fefaef-dc61-467d-8781-74ec50473c16 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received event network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d62b129e-591e-48e4-a9ff-64f0d714e435 req-63fefaef-dc61-467d-8781-74ec50473c16 service nova] Acquiring lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d62b129e-591e-48e4-a9ff-64f0d714e435 req-63fefaef-dc61-467d-8781-74ec50473c16 service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d62b129e-591e-48e4-a9ff-64f0d714e435 req-63fefaef-dc61-467d-8781-74ec50473c16 service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:20 user nova-compute[75378]: DEBUG nova.compute.manager [req-d62b129e-591e-48e4-a9ff-64f0d714e435 req-63fefaef-dc61-467d-8781-74ec50473c16 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] No waiting events found dispatching network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:20 user nova-compute[75378]: WARNING nova.compute.manager [req-d62b129e-591e-48e4-a9ff-64f0d714e435 req-63fefaef-dc61-467d-8781-74ec50473c16 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received unexpected event network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 for instance with vm_state building and task_state spawning.
Nov 09 03:47:20 user nova-compute[75378]: DEBUG nova.compute.manager [req-d62b129e-591e-48e4-a9ff-64f0d714e435 req-63fefaef-dc61-467d-8781-74ec50473c16 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received event network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d62b129e-591e-48e4-a9ff-64f0d714e435 req-63fefaef-dc61-467d-8781-74ec50473c16 service nova] Acquiring lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d62b129e-591e-48e4-a9ff-64f0d714e435 req-63fefaef-dc61-467d-8781-74ec50473c16 service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d62b129e-591e-48e4-a9ff-64f0d714e435 req-63fefaef-dc61-467d-8781-74ec50473c16 service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:20 user nova-compute[75378]: DEBUG nova.compute.manager [req-d62b129e-591e-48e4-a9ff-64f0d714e435 req-63fefaef-dc61-467d-8781-74ec50473c16 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] No waiting events found dispatching network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:20 user nova-compute[75378]: WARNING nova.compute.manager [req-d62b129e-591e-48e4-a9ff-64f0d714e435 req-63fefaef-dc61-467d-8781-74ec50473c16 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received unexpected event network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 for instance with vm_state building and task_state spawning.
Nov 09 03:47:20 user nova-compute[75378]: DEBUG nova.compute.manager [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:47:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:47:20 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Instance spawned successfully.
Nov 09 03:47:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:47:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:47:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:47:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:47:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:47:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:47:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:47:20 user nova-compute[75378]: INFO nova.compute.manager [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Took 8.70 seconds to spawn the instance on the hypervisor.
Nov 09 03:47:20 user nova-compute[75378]: DEBUG nova.compute.manager [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:47:20 user nova-compute[75378]: INFO nova.compute.manager [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Took 9.74 seconds to build instance.
Nov 09 03:47:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-224d52ff-4684-48ae-b9c9-452143931fb5 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "2abe50f8-3c9b-417e-889f-1d565089d678" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.909s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Acquiring lock "cc4b9517-2616-4cfb-82f7-8379f4619962" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "cc4b9517-2616-4cfb-82f7-8379f4619962" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:22 user nova-compute[75378]: DEBUG nova.compute.manager [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:47:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:47:22 user nova-compute[75378]: INFO nova.compute.claims [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Claim successful on node user
Nov 09 03:47:23 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:47:23 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:47:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:47:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:47:23 user nova-compute[75378]: DEBUG nova.network.neutron [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:47:23 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:47:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:47:23 user nova-compute[75378]: DEBUG nova.policy [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f3368d90833948c7b883be82d579610a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be12d540705f40b1a28a40589eabfec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:47:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:47:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:47:23 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Creating image(s)
Nov 09 03:47:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "/opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "/opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.234s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.224s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk 1073741824" returned: 0 in 0.053s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:24 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:47:24 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:47:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.208s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:24 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:47:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:24 user nova-compute[75378]: DEBUG nova.network.neutron [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Successfully created port: 1960394a-38fa-4977-95b7-6a057246f84f {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:47:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:24 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Cannot resize image /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:47:24 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:47:24 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Ensure instance console log exists: /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:47:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.network.neutron [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Successfully updated port: 1960394a-38fa-4977-95b7-6a057246f84f {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Acquiring lock "refresh_cache-cc4b9517-2616-4cfb-82f7-8379f4619962" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Acquired lock "refresh_cache-cc4b9517-2616-4cfb-82f7-8379f4619962" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.network.neutron [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-60a64488-e844-4089-a5ec-20f1156f9579 req-cf73be70-eea1-4198-8979-659e41029205 service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Received event network-changed-1960394a-38fa-4977-95b7-6a057246f84f {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-60a64488-e844-4089-a5ec-20f1156f9579 req-cf73be70-eea1-4198-8979-659e41029205 service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Refreshing instance network info cache due to event network-changed-1960394a-38fa-4977-95b7-6a057246f84f. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-60a64488-e844-4089-a5ec-20f1156f9579 req-cf73be70-eea1-4198-8979-659e41029205 service nova] Acquiring lock "refresh_cache-cc4b9517-2616-4cfb-82f7-8379f4619962" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.network.neutron [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.network.neutron [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Updating instance_info_cache with network_info: [{"id": "1960394a-38fa-4977-95b7-6a057246f84f", "address": "fa:16:3e:99:9a:c5", "network": {"id": "5d4c731b-c253-46b1-98de-427ee670e8e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1331924378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be12d540705f40b1a28a40589eabfec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1960394a-38", "ovs_interfaceid": "1960394a-38fa-4977-95b7-6a057246f84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Releasing lock "refresh_cache-cc4b9517-2616-4cfb-82f7-8379f4619962" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.compute.manager [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Instance network_info: |[{"id": "1960394a-38fa-4977-95b7-6a057246f84f", "address": "fa:16:3e:99:9a:c5", "network": {"id": "5d4c731b-c253-46b1-98de-427ee670e8e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1331924378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be12d540705f40b1a28a40589eabfec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1960394a-38", "ovs_interfaceid": "1960394a-38fa-4977-95b7-6a057246f84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-60a64488-e844-4089-a5ec-20f1156f9579 req-cf73be70-eea1-4198-8979-659e41029205 service nova] Acquired lock "refresh_cache-cc4b9517-2616-4cfb-82f7-8379f4619962" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.network.neutron [req-60a64488-e844-4089-a5ec-20f1156f9579 req-cf73be70-eea1-4198-8979-659e41029205 service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Refreshing network info cache for port 1960394a-38fa-4977-95b7-6a057246f84f {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Start _get_guest_xml network_info=[{"id": "1960394a-38fa-4977-95b7-6a057246f84f", "address": "fa:16:3e:99:9a:c5", "network": {"id": "5d4c731b-c253-46b1-98de-427ee670e8e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1331924378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be12d540705f40b1a28a40589eabfec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1960394a-38", "ovs_interfaceid": "1960394a-38fa-4977-95b7-6a057246f84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:47:25 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:47:25 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:47:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2126959549',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2126959549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2126959',id=25,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkGWvCaGvY0egT1Segn6rf5V7clzMwFXDFUGqwyV0rIGCv9YFI6V5GW9SGtuSCoGJkB6KUhL7jHx85AdosJEBUkYsGpuAcH/Lbu5whwsJxlionhKU1MVYNSbPgny88W7g==',key_name='tempest-keypair-1883075483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be12d540705f40b1a28a40589eabfec4',ramdisk_id='',reservation_id='r-k08flwuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1828344835',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:47:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3368d90833948c7b883be82d579610a',uuid=cc4b9517-2616-4cfb-82f7-8379f4619962,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1960394a-38fa-4977-95b7-6a057246f84f", "address": "fa:16:3e:99:9a:c5", "network": {"id": "5d4c731b-c253-46b1-98de-427ee670e8e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1331924378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be12d540705f40b1a28a40589eabfec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1960394a-38", "ovs_interfaceid": "1960394a-38fa-4977-95b7-6a057246f84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Converting VIF {"id": "1960394a-38fa-4977-95b7-6a057246f84f", "address": "fa:16:3e:99:9a:c5", "network": {"id": "5d4c731b-c253-46b1-98de-427ee670e8e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1331924378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be12d540705f40b1a28a40589eabfec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1960394a-38", "ovs_interfaceid": "1960394a-38fa-4977-95b7-6a057246f84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:9a:c5,bridge_name='br-int',has_traffic_filtering=True,id=1960394a-38fa-4977-95b7-6a057246f84f,network=Network(5d4c731b-c253-46b1-98de-427ee670e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1960394a-38') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.objects.instance [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lazy-loading 'pci_devices' on Instance uuid cc4b9517-2616-4cfb-82f7-8379f4619962 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:47:25 user nova-compute[75378]:   <uuid>cc4b9517-2616-4cfb-82f7-8379f4619962</uuid>
Nov 09 03:47:25 user nova-compute[75378]:   <name>instance-00000019</name>
Nov 09 03:47:25 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:47:25 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:47:25 user nova-compute[75378]:   <metadata>
Nov 09 03:47:25 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:47:25 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:47:25 user nova-compute[75378]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-2126959549</nova:name>
Nov 09 03:47:25 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:47:25</nova:creationTime>
Nov 09 03:47:25 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:47:25 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:47:25 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:47:25 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:47:25 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:47:25 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:47:25 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:47:25 user nova-compute[75378]:       <nova:owner>
Nov 09 03:47:25 user nova-compute[75378]:         <nova:user uuid="f3368d90833948c7b883be82d579610a">tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member</nova:user>
Nov 09 03:47:25 user nova-compute[75378]:         <nova:project uuid="be12d540705f40b1a28a40589eabfec4">tempest-TestServerVolumeAttachScenarioOldVersion-1828344835</nova:project>
Nov 09 03:47:25 user nova-compute[75378]:       </nova:owner>
Nov 09 03:47:25 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:47:25 user nova-compute[75378]:       <nova:ports>
Nov 09 03:47:25 user nova-compute[75378]:         <nova:port uuid="1960394a-38fa-4977-95b7-6a057246f84f">
Nov 09 03:47:25 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 09 03:47:25 user nova-compute[75378]:         </nova:port>
Nov 09 03:47:25 user nova-compute[75378]:       </nova:ports>
Nov 09 03:47:25 user nova-compute[75378]:     </nova:instance>
Nov 09 03:47:25 user nova-compute[75378]:   </metadata>
Nov 09 03:47:25 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:47:25 user nova-compute[75378]:     <system>
Nov 09 03:47:25 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:47:25 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:47:25 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:47:25 user nova-compute[75378]:       <entry name="serial">cc4b9517-2616-4cfb-82f7-8379f4619962</entry>
Nov 09 03:47:25 user nova-compute[75378]:       <entry name="uuid">cc4b9517-2616-4cfb-82f7-8379f4619962</entry>
Nov 09 03:47:25 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:47:25 user nova-compute[75378]:     </system>
Nov 09 03:47:25 user nova-compute[75378]:   </sysinfo>
Nov 09 03:47:25 user nova-compute[75378]:   <os>
Nov 09 03:47:25 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:47:25 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:47:25 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:47:25 user nova-compute[75378]:   </os>
Nov 09 03:47:25 user nova-compute[75378]:   <features>
Nov 09 03:47:25 user nova-compute[75378]:     <acpi/>
Nov 09 03:47:25 user nova-compute[75378]:     <apic/>
Nov 09 03:47:25 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:47:25 user nova-compute[75378]:   </features>
Nov 09 03:47:25 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:47:25 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:47:25 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:47:25 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:47:25 user nova-compute[75378]:   </clock>
Nov 09 03:47:25 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:47:25 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:47:25 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:47:25 user nova-compute[75378]:   </cpu>
Nov 09 03:47:25 user nova-compute[75378]:   <devices>
Nov 09 03:47:25 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:47:25 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:47:25 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk"/>
Nov 09 03:47:25 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:47:25 user nova-compute[75378]:     </disk>
Nov 09 03:47:25 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:47:25 user nova-compute[75378]:       <mac address="fa:16:3e:99:9a:c5"/>
Nov 09 03:47:25 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:47:25 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:47:25 user nova-compute[75378]:       <target dev="tap1960394a-38"/>
Nov 09 03:47:25 user nova-compute[75378]:     </interface>
Nov 09 03:47:25 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:47:25 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/console.log" append="off"/>
Nov 09 03:47:25 user nova-compute[75378]:     </serial>
Nov 09 03:47:25 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:47:25 user nova-compute[75378]:     <video>
Nov 09 03:47:25 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:47:25 user nova-compute[75378]:     </video>
Nov 09 03:47:25 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:47:25 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:47:25 user nova-compute[75378]:     </rng>
Nov 09 03:47:25 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:47:25 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:47:25 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:47:25 user nova-compute[75378]:     </memballoon>
Nov 09 03:47:25 user nova-compute[75378]:   </devices>
Nov 09 03:47:25 user nova-compute[75378]: </domain>
Nov 09 03:47:25 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:47:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2126959549',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2126959549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2126959',id=25,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkGWvCaGvY0egT1Segn6rf5V7clzMwFXDFUGqwyV0rIGCv9YFI6V5GW9SGtuSCoGJkB6KUhL7jHx85AdosJEBUkYsGpuAcH/Lbu5whwsJxlionhKU1MVYNSbPgny88W7g==',key_name='tempest-keypair-1883075483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be12d540705f40b1a28a40589eabfec4',ramdisk_id='',reservation_id='r-k08flwuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1828344835',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:47:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3368d90833948c7b883be82d579610a',uuid=cc4b9517-2616-4cfb-82f7-8379f4619962,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1960394a-38fa-4977-95b7-6a057246f84f", "address": "fa:16:3e:99:9a:c5", "network": {"id": "5d4c731b-c253-46b1-98de-427ee670e8e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1331924378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be12d540705f40b1a28a40589eabfec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1960394a-38", "ovs_interfaceid": "1960394a-38fa-4977-95b7-6a057246f84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Converting VIF {"id": "1960394a-38fa-4977-95b7-6a057246f84f", "address": "fa:16:3e:99:9a:c5", "network": {"id": "5d4c731b-c253-46b1-98de-427ee670e8e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1331924378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be12d540705f40b1a28a40589eabfec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1960394a-38", "ovs_interfaceid": "1960394a-38fa-4977-95b7-6a057246f84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:9a:c5,bridge_name='br-int',has_traffic_filtering=True,id=1960394a-38fa-4977-95b7-6a057246f84f,network=Network(5d4c731b-c253-46b1-98de-427ee670e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1960394a-38') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG os_vif [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:9a:c5,bridge_name='br-int',has_traffic_filtering=True,id=1960394a-38fa-4977-95b7-6a057246f84f,network=Network(5d4c731b-c253-46b1-98de-427ee670e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1960394a-38') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4f3c36b-e6f2-599d-ace8-4494bc05d6c7', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1960394a-38, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1960394a-38, col_values=(('qos', UUID('3276ab9a-3b77-463e-aa5a-bfffd84b0063')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1960394a-38, col_values=(('external_ids', {'iface-id': '1960394a-38fa-4977-95b7-6a057246f84f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:9a:c5', 'vm-uuid': 'cc4b9517-2616-4cfb-82f7-8379f4619962'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:25 user nova-compute[75378]: INFO os_vif [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:9a:c5,bridge_name='br-int',has_traffic_filtering=True,id=1960394a-38fa-4977-95b7-6a057246f84f,network=Network(5d4c731b-c253-46b1-98de-427ee670e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1960394a-38')
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:47:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] No VIF found with MAC fa:16:3e:99:9a:c5, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:47:26 user nova-compute[75378]: DEBUG nova.network.neutron [req-60a64488-e844-4089-a5ec-20f1156f9579 req-cf73be70-eea1-4198-8979-659e41029205 service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Updated VIF entry in instance network info cache for port 1960394a-38fa-4977-95b7-6a057246f84f. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:47:26 user nova-compute[75378]: DEBUG nova.network.neutron [req-60a64488-e844-4089-a5ec-20f1156f9579 req-cf73be70-eea1-4198-8979-659e41029205 service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Updating instance_info_cache with network_info: [{"id": "1960394a-38fa-4977-95b7-6a057246f84f", "address": "fa:16:3e:99:9a:c5", "network": {"id": "5d4c731b-c253-46b1-98de-427ee670e8e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1331924378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be12d540705f40b1a28a40589eabfec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1960394a-38", "ovs_interfaceid": "1960394a-38fa-4977-95b7-6a057246f84f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:47:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-60a64488-e844-4089-a5ec-20f1156f9579 req-cf73be70-eea1-4198-8979-659e41029205 service nova] Releasing lock "refresh_cache-cc4b9517-2616-4cfb-82f7-8379f4619962" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:47:26 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:47:26 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:47:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:27 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:47:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-6f29e0ed-a101-4d4d-8336-7f85739bb72e req-3c7f9679-35a7-4a06-befd-56b4422eb9c2 service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Received event network-vif-plugged-1960394a-38fa-4977-95b7-6a057246f84f {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6f29e0ed-a101-4d4d-8336-7f85739bb72e req-3c7f9679-35a7-4a06-befd-56b4422eb9c2 service nova] Acquiring lock "cc4b9517-2616-4cfb-82f7-8379f4619962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6f29e0ed-a101-4d4d-8336-7f85739bb72e req-3c7f9679-35a7-4a06-befd-56b4422eb9c2 service nova] Lock "cc4b9517-2616-4cfb-82f7-8379f4619962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6f29e0ed-a101-4d4d-8336-7f85739bb72e req-3c7f9679-35a7-4a06-befd-56b4422eb9c2 service nova] Lock "cc4b9517-2616-4cfb-82f7-8379f4619962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-6f29e0ed-a101-4d4d-8336-7f85739bb72e req-3c7f9679-35a7-4a06-befd-56b4422eb9c2 service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] No waiting events found dispatching network-vif-plugged-1960394a-38fa-4977-95b7-6a057246f84f {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:27 user nova-compute[75378]: WARNING nova.compute.manager [req-6f29e0ed-a101-4d4d-8336-7f85739bb72e req-3c7f9679-35a7-4a06-befd-56b4422eb9c2 service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Received unexpected event network-vif-plugged-1960394a-38fa-4977-95b7-6a057246f84f for instance with vm_state building and task_state spawning.
Nov 09 03:47:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:28 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:47:28 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:47:28 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Didn't find any instances for network info cache update. {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 03:47:28 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:47:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-10f379a7-7c35-4b9b-8927-3e0836256bea req-d6826589-365f-4d41-b8ef-3de421b2293d service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Received event network-vif-plugged-1960394a-38fa-4977-95b7-6a057246f84f {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-10f379a7-7c35-4b9b-8927-3e0836256bea req-d6826589-365f-4d41-b8ef-3de421b2293d service nova] Acquiring lock "cc4b9517-2616-4cfb-82f7-8379f4619962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-10f379a7-7c35-4b9b-8927-3e0836256bea req-d6826589-365f-4d41-b8ef-3de421b2293d service nova] Lock "cc4b9517-2616-4cfb-82f7-8379f4619962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-10f379a7-7c35-4b9b-8927-3e0836256bea req-d6826589-365f-4d41-b8ef-3de421b2293d service nova] Lock "cc4b9517-2616-4cfb-82f7-8379f4619962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-10f379a7-7c35-4b9b-8927-3e0836256bea req-d6826589-365f-4d41-b8ef-3de421b2293d service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] No waiting events found dispatching network-vif-plugged-1960394a-38fa-4977-95b7-6a057246f84f {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:29 user nova-compute[75378]: WARNING nova.compute.manager [req-10f379a7-7c35-4b9b-8927-3e0836256bea req-d6826589-365f-4d41-b8ef-3de421b2293d service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Received unexpected event network-vif-plugged-1960394a-38fa-4977-95b7-6a057246f84f for instance with vm_state building and task_state spawning.
Nov 09 03:47:29 user nova-compute[75378]: DEBUG nova.compute.manager [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:47:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:47:29 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Instance spawned successfully.
Nov 09 03:47:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:47:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:47:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:47:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:47:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:47:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:47:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:47:30 user nova-compute[75378]: INFO nova.compute.manager [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Took 6.53 seconds to spawn the instance on the hypervisor.
Nov 09 03:47:30 user nova-compute[75378]: DEBUG nova.compute.manager [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:47:30 user nova-compute[75378]: INFO nova.compute.manager [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Took 7.58 seconds to build instance.
Nov 09 03:47:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9388a10-e101-4fa3-8ef2-e7583be1b932 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "cc4b9517-2616-4cfb-82f7-8379f4619962" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.721s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:31 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:47:31 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:47:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:32 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:47:32 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:47:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:32 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:47:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:47:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:47:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:47:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:47:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:47:37 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:47:37 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:47:37 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7239MB free_disk=25.413970947265625GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:47:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7d051405-6b57-4db2-9533-c2f4e87134d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 883490f1-6a9f-4ad6-83c4-44b78e681de6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c4ef6623-863b-40a8-b9ec-720c25ee3484 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2c2acb48-972a-41d7-987e-48e79b3bef93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7e12539b-36a3-4691-89fd-e3d155de38d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 013db901-fbee-4593-a14f-95a03e79fad0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 06216917-d7d1-4fd4-a311-e054437e84a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2abe50f8-3c9b-417e-889f-1d565089d678 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance cc4b9517-2616-4cfb-82f7-8379f4619962 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing inventories for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Updating ProviderTree inventory for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Updating inventory in ProviderTree for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing aggregate associations for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8, aggregates: None {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing trait associations for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8, traits: HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.149s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:47:38 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75378) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 03:47:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-b3855909-6664-4d6b-afca-a5ffa2e54be1 req-3c51c45d-fdcc-43fb-b325-6cf951235ef2 service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Received event network-changed-70d7d7ee-d1e8-4b8c-981b-26394c1b1edc {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-b3855909-6664-4d6b-afca-a5ffa2e54be1 req-3c51c45d-fdcc-43fb-b325-6cf951235ef2 service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Refreshing instance network info cache due to event network-changed-70d7d7ee-d1e8-4b8c-981b-26394c1b1edc. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:47:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b3855909-6664-4d6b-afca-a5ffa2e54be1 req-3c51c45d-fdcc-43fb-b325-6cf951235ef2 service nova] Acquiring lock "refresh_cache-2c2acb48-972a-41d7-987e-48e79b3bef93" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:47:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b3855909-6664-4d6b-afca-a5ffa2e54be1 req-3c51c45d-fdcc-43fb-b325-6cf951235ef2 service nova] Acquired lock "refresh_cache-2c2acb48-972a-41d7-987e-48e79b3bef93" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:47:43 user nova-compute[75378]: DEBUG nova.network.neutron [req-b3855909-6664-4d6b-afca-a5ffa2e54be1 req-3c51c45d-fdcc-43fb-b325-6cf951235ef2 service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Refreshing network info cache for port 70d7d7ee-d1e8-4b8c-981b-26394c1b1edc {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:47:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-03fece4a-3bb6-4eec-aa50-194dd6c3aa25 req-28957c9a-2082-4147-b288-31a2aefb89fc service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Received event network-changed-d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-03fece4a-3bb6-4eec-aa50-194dd6c3aa25 req-28957c9a-2082-4147-b288-31a2aefb89fc service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Refreshing instance network info cache due to event network-changed-d0ea7419-ed5d-43af-86c6-57db8d9382e0. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:47:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-03fece4a-3bb6-4eec-aa50-194dd6c3aa25 req-28957c9a-2082-4147-b288-31a2aefb89fc service nova] Acquiring lock "refresh_cache-7e12539b-36a3-4691-89fd-e3d155de38d7" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:47:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-03fece4a-3bb6-4eec-aa50-194dd6c3aa25 req-28957c9a-2082-4147-b288-31a2aefb89fc service nova] Acquired lock "refresh_cache-7e12539b-36a3-4691-89fd-e3d155de38d7" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:47:43 user nova-compute[75378]: DEBUG nova.network.neutron [req-03fece4a-3bb6-4eec-aa50-194dd6c3aa25 req-28957c9a-2082-4147-b288-31a2aefb89fc service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Refreshing network info cache for port d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:47:44 user nova-compute[75378]: DEBUG nova.network.neutron [req-03fece4a-3bb6-4eec-aa50-194dd6c3aa25 req-28957c9a-2082-4147-b288-31a2aefb89fc service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Updated VIF entry in instance network info cache for port d0ea7419-ed5d-43af-86c6-57db8d9382e0. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:47:44 user nova-compute[75378]: DEBUG nova.network.neutron [req-03fece4a-3bb6-4eec-aa50-194dd6c3aa25 req-28957c9a-2082-4147-b288-31a2aefb89fc service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Updating instance_info_cache with network_info: [{"id": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "address": "fa:16:3e:3e:8c:6a", "network": {"id": "ba3f17d0-18fb-4a96-a48a-ea93768ee358", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1139879701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21784a1d205749fd9a4459fe6605a481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7419-ed", "ovs_interfaceid": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:47:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-03fece4a-3bb6-4eec-aa50-194dd6c3aa25 req-28957c9a-2082-4147-b288-31a2aefb89fc service nova] Releasing lock "refresh_cache-7e12539b-36a3-4691-89fd-e3d155de38d7" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:47:44 user nova-compute[75378]: DEBUG nova.network.neutron [req-b3855909-6664-4d6b-afca-a5ffa2e54be1 req-3c51c45d-fdcc-43fb-b325-6cf951235ef2 service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Updated VIF entry in instance network info cache for port 70d7d7ee-d1e8-4b8c-981b-26394c1b1edc. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:47:44 user nova-compute[75378]: DEBUG nova.network.neutron [req-b3855909-6664-4d6b-afca-a5ffa2e54be1 req-3c51c45d-fdcc-43fb-b325-6cf951235ef2 service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Updating instance_info_cache with network_info: [{"id": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "address": "fa:16:3e:02:bc:fb", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d7d7ee-d1", "ovs_interfaceid": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:47:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b3855909-6664-4d6b-afca-a5ffa2e54be1 req-3c51c45d-fdcc-43fb-b325-6cf951235ef2 service nova] Releasing lock "refresh_cache-2c2acb48-972a-41d7-987e-48e79b3bef93" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:47:45 user nova-compute[75378]: INFO nova.compute.manager [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Rebuilding instance
Nov 09 03:47:45 user nova-compute[75378]: DEBUG nova.compute.manager [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:47:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-ab004336-dd35-47fb-9a9d-fc2362fdd209 req-5f007db2-bf8c-47af-9a8b-4f853f336ac6 service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Received event network-vif-unplugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ab004336-dd35-47fb-9a9d-fc2362fdd209 req-5f007db2-bf8c-47af-9a8b-4f853f336ac6 service nova] Acquiring lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ab004336-dd35-47fb-9a9d-fc2362fdd209 req-5f007db2-bf8c-47af-9a8b-4f853f336ac6 service nova] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ab004336-dd35-47fb-9a9d-fc2362fdd209 req-5f007db2-bf8c-47af-9a8b-4f853f336ac6 service nova] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-ab004336-dd35-47fb-9a9d-fc2362fdd209 req-5f007db2-bf8c-47af-9a8b-4f853f336ac6 service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] No waiting events found dispatching network-vif-unplugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:45 user nova-compute[75378]: WARNING nova.compute.manager [req-ab004336-dd35-47fb-9a9d-fc2362fdd209 req-5f007db2-bf8c-47af-9a8b-4f853f336ac6 service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Received unexpected event network-vif-unplugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 for instance with vm_state active and task_state rebuilding.
Nov 09 03:47:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:46 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Instance destroyed successfully.
Nov 09 03:47:46 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Instance destroyed successfully.
Nov 09 03:47:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1744791017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-630224360',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOf5txPg6ouZaGGPli9fXk7MU4joWJGx02BisK3zQA1UKJLHy2CmfWE/XCnKG3U7ArzcfKvhfDz+mZTrfgm201boyTYwnA7PPwqn4OBn8OrHRJiyu0bpUTMNWI1J7qAdA==',key_name='tempest-keypair-1307438617',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:46:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='21784a1d205749fd9a4459fe6605a481',ramdisk_id='',reservation_id='r-6evkz0hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1531549411',owner_user_name='tempest-ServerActionsV293TestJSON-1531549411-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:47:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9e8d4eb00ea4ae5878183644245516f',uuid=7e12539b-36a3-4691-89fd-e3d155de38d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "address": "fa:16:3e:3e:8c:6a", "network": {"id": "ba3f17d0-18fb-4a96-a48a-ea93768ee358", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1139879701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21784a1d205749fd9a4459fe6605a481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7419-ed", "ovs_interfaceid": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Converting VIF {"id": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "address": "fa:16:3e:3e:8c:6a", "network": {"id": "ba3f17d0-18fb-4a96-a48a-ea93768ee358", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1139879701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21784a1d205749fd9a4459fe6605a481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7419-ed", "ovs_interfaceid": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:8c:6a,bridge_name='br-int',has_traffic_filtering=True,id=d0ea7419-ed5d-43af-86c6-57db8d9382e0,network=Network(ba3f17d0-18fb-4a96-a48a-ea93768ee358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea7419-ed') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_vif [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:8c:6a,bridge_name='br-int',has_traffic_filtering=True,id=d0ea7419-ed5d-43af-86c6-57db8d9382e0,network=Network(ba3f17d0-18fb-4a96-a48a-ea93768ee358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea7419-ed') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0ea7419-ed, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b772c363-a5b2-495d-a6c4-95f157685387) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:46 user nova-compute[75378]: INFO os_vif [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:8c:6a,bridge_name='br-int',has_traffic_filtering=True,id=d0ea7419-ed5d-43af-86c6-57db8d9382e0,network=Network(ba3f17d0-18fb-4a96-a48a-ea93768ee358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea7419-ed')
Nov 09 03:47:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpOStwFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:47:46 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a88aac-5c22-41cc-a086-58fae2fd527b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:47:46 user nova-compute[75378]: No targets found.
Nov 09 03:47:46 user nova-compute[75378]: iSNS:
Nov 09 03:47:46 user nova-compute[75378]: No targets found.
Nov 09 03:47:46 user nova-compute[75378]: STATIC:
Nov 09 03:47:46 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a
Nov 09 03:47:46 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:47:46 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:47:46 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 03:47:46 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:47:46 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:47:46 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d
Nov 09 03:47:46 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:47:46 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:47:46 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09
Nov 09 03:47:46 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:47:46 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:47:46 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8
Nov 09 03:47:46 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:47:46 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:47:46 user nova-compute[75378]: FIRMWARE:
Nov 09 03:47:46 user nova-compute[75378]: No targets found.
Nov 09 03:47:46 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:47:46 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:47:46 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b8a435-b19a-4486-bfd4-cc919f28afc7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a080a4-2ada-491d-b17a-ff309de6d5d8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:47:46 user nova-compute[75378]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:47:46 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:47:46 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:47:46 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:47:46 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:47:46 user nova-compute[75378]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:47:46 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:47:46 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:47:46 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:47:46 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c7cbc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09'): ({'sdb'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Removing single pathed devices sdb {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85d4fdd-16ca-4fed-86a5-f30e5bd0b107]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f9bdbc-2ef1-43bb-b1ff-27c475beb6fe]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Flushing IO for device /dev/sdb {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d399093-a05e-40b9-b375-5645563e8405]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[28586a9c-19cf-4cc3-8f1d-477a9e90ac09]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26430646635353133', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_68a8c284', '/dev/disk/by-id/scsi-1SCST_BIO68a8c284-d0df55136b36c040') {{(pid=87049) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 09 03:47:46 user nova-compute[75378]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26430646635353133
Nov 09 03:47:46 user nova-compute[75378]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_68a8c284
Nov 09 03:47:46 user nova-compute[75378]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO68a8c284-d0df55136b36c040
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ed1516-d51a-4eb1-a4d0-66b1504c8d09]: (4, None) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdb8be1-0caa-45d5-811d-dcf338530f65]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a393a3a-4bcd-4b6e-a392-3175e253f11a]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09, portal: 172.16.0.220,3260]
Nov 09 03:47:46 user nova-compute[75378]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09, portal: 172.16.0.220,3260] successful.
Nov 09 03:47:46 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[42719980-1a9e-4aa1-8b12-92d4814b92f2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] <== disconnect_volume: return (343ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:47:46 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Deleting instance files /opt/stack/data/nova/instances/7e12539b-36a3-4691-89fd-e3d155de38d7_del
Nov 09 03:47:46 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Deletion of /opt/stack/data/nova/instances/7e12539b-36a3-4691-89fd-e3d155de38d7_del complete
Nov 09 03:47:46 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 7e12539b-36a3-4691-89fd-e3d155de38d7 could not be found.
Nov 09 03:47:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpOStwFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:47:46 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c61ddb7-9fa2-4def-bc80-9ab62b1fb21a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:47:46 user nova-compute[75378]: No targets found.
Nov 09 03:47:46 user nova-compute[75378]: iSNS:
Nov 09 03:47:46 user nova-compute[75378]: No targets found.
Nov 09 03:47:46 user nova-compute[75378]: STATIC:
Nov 09 03:47:46 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a
Nov 09 03:47:46 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:47:46 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:47:46 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 03:47:46 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:47:46 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:47:46 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d
Nov 09 03:47:46 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:47:46 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:47:46 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8
Nov 09 03:47:46 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:47:46 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:47:46 user nova-compute[75378]: FIRMWARE:
Nov 09 03:47:46 user nova-compute[75378]: No targets found.
Nov 09 03:47:46 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:47:46 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:47:46 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e647e5-3868-4f0e-b94b-e4ef7b03fd35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[174dde16-794f-48ed-beab-85369552cf4b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:47:46 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:47:46 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:47:46 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:47:46 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:47:46 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:47:46 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:47:46 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:47:46 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3b053d1b0>, {}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Disconnecting from: [] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] <== disconnect_volume: return (84ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:47:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:47:47 user nova-compute[75378]: DEBUG nova.compute.manager [req-81272fca-00cf-48d8-a758-c21566284b88 req-1485ca47-b855-4fe0-9ffa-6b121c131620 service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Received event network-vif-plugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-81272fca-00cf-48d8-a758-c21566284b88 req-1485ca47-b855-4fe0-9ffa-6b121c131620 service nova] Acquiring lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-81272fca-00cf-48d8-a758-c21566284b88 req-1485ca47-b855-4fe0-9ffa-6b121c131620 service nova] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-81272fca-00cf-48d8-a758-c21566284b88 req-1485ca47-b855-4fe0-9ffa-6b121c131620 service nova] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:47 user nova-compute[75378]: DEBUG nova.compute.manager [req-81272fca-00cf-48d8-a758-c21566284b88 req-1485ca47-b855-4fe0-9ffa-6b121c131620 service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] No waiting events found dispatching network-vif-plugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:47 user nova-compute[75378]: WARNING nova.compute.manager [req-81272fca-00cf-48d8-a758-c21566284b88 req-1485ca47-b855-4fe0-9ffa-6b121c131620 service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Received unexpected event network-vif-plugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 for instance with vm_state active and task_state rebuilding.
Nov 09 03:47:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Preparing to wait for external event volume-reimaged-b3426aa0-910f-4c33-80c6-b74e104bbb09 {{(pid=75378) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 09 03:47:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Acquiring lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.volume.cinder [None req-319b2a3c-1f52-4db9-87f2-ffc3a21a212c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Update attachment failed for attachment 203ddceb-8c77-4676-95c7-aa255b270147. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2773902c-54ae-49b5-a0b9-655c36f07a4d) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2773902c-54ae-49b5-a0b9-655c36f07a4d)
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [None req-319b2a3c-1f52-4db9-87f2-ffc3a21a212c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Failed to attach 0480d20b-8103-4ca6-b760-d81d2031366d at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2773902c-54ae-49b5-a0b9-655c36f07a4d)
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Traceback (most recent call last):
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]     ret_val = method(obj, context, *args, **kwargs)
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]     self._do_attach(context, instance, volume, volume_api,
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]     self._volume_attach(context, volume, connector, instance,
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]     connection_info = volume_api.attachment_update(
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]     res = method(self, ctx, *args, **kwargs)
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]     with excutils.save_and_reraise_exception():
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]     self.force_reraise()
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]     raise self.value
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]     context, '3.44', skip_version_check=True).attachments.update(
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]     return method.func(obj, *args, **kwargs)
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]     resp = self._update('/attachments/%s' % id, body)
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]     return self._cs_request(url, 'PUT', **kwargs)
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]     return self.request(url, method, **kwargs)
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6]     raise exceptions.from_response(resp, body)
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2773902c-54ae-49b5-a0b9-655c36f07a4d)
Nov 09 03:47:48 user nova-compute[75378]: ERROR nova.compute.manager [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] 
Nov 09 03:47:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-319b2a3c-1f52-4db9-87f2-ffc3a21a212c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "883490f1-6a9f-4ad6-83c4-44b78e681de6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.562s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server [None req-319b2a3c-1f52-4db9-87f2-ffc3a21a212c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2773902c-54ae-49b5-a0b9-655c36f07a4d)
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2773902c-54ae-49b5-a0b9-655c36f07a4d)
Nov 09 03:47:48 user nova-compute[75378]: ERROR oslo_messaging.rpc.server 
Nov 09 03:47:49 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RJIcuhgv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:47:49 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:47:49 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:47:49 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a575318f-13ab-4ffe-b99f-45d777658d17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:47:49 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[af516063-1037-41ed-9ce0-90216ec18f08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f] added
Nov 09 03:47:49 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd97fc2-bafc-48bd-9c50-1dae0767b19f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[551238ee-d41e-40ae-a305-47db567ed9c1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RJIcuhgv {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RJIcuhgv" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae61a62e-76c3-4091-a17c-8d9a2512fd14]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RJIcuhgv'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[67803f12-16f2-43e8-9caa-a6a7c097fc72]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7847bd-edec-4a08-a6e5-8ec80917aa7a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:47:49 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:47:49 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:47:49 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:47:49 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:47:49 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:47:49 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:47:49 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:47:49 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb43f15-9b2f-4b33-a0a1-2396a8c64bf9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f, portal: 172.16.0.220,3260]
Nov 09 03:47:49 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f, portal: 172.16.0.220,3260] successful.
Nov 09 03:47:49 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3cc351-5992-48e3-aee6-8787389ea359]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cbc57b-6abe-41f5-85ba-2c4d07d5b14f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:47:49 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:47:49 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:47:49 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:47:49 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:47:49 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:47:49 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:47:49 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:47:49 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:47:49 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:47:49 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1af04d2-51f7-4f42-9ac7-2eeff13053c1]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:47:49 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:47:50 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:47:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RJIcuhgv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:47:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:47:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23434343463366638', 'path': '/dev/sdb'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:47:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434343463366638', 'path': '/dev/sdb'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:47:50 user nova-compute[75378]: DEBUG nova.objects.instance [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'flavor' on Instance uuid 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:47:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 03:47:50 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:47:50 user nova-compute[75378]:   <source dev="/dev/sdb"/>
Nov 09 03:47:50 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:47:50 user nova-compute[75378]:   <serial>49c0abde-7447-477d-8cff-0a805a87bf0f</serial>
Nov 09 03:47:50 user nova-compute[75378]: </disk>
Nov 09 03:47:50 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 03:47:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:47:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:47:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] No VIF found with MAC fa:16:3e:89:f8:61, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:47:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55e19298-39e5-4c41-be10-5704b752d3e5 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.543s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:53 user nova-compute[75378]: INFO nova.compute.manager [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Rescuing
Nov 09 03:47:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:47:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquired lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:47:53 user nova-compute[75378]: DEBUG nova.network.neutron [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:47:53 user nova-compute[75378]: DEBUG nova.network.neutron [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Updating instance_info_cache with network_info: [{"id": "e4725ee0-c613-48af-8163-eafad2605fff", "address": "fa:16:3e:89:f8:61", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4725ee0-c6", "ovs_interfaceid": "e4725ee0-c613-48af-8163-eafad2605fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:47:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Releasing lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:47:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-4822a1e8-6e5e-4ccf-af47-84c1b68ddd08 req-6562cf63-6363-4e32-8e7a-e71d47198710 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received event network-vif-unplugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4822a1e8-6e5e-4ccf-af47-84c1b68ddd08 req-6562cf63-6363-4e32-8e7a-e71d47198710 service nova] Acquiring lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4822a1e8-6e5e-4ccf-af47-84c1b68ddd08 req-6562cf63-6363-4e32-8e7a-e71d47198710 service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4822a1e8-6e5e-4ccf-af47-84c1b68ddd08 req-6562cf63-6363-4e32-8e7a-e71d47198710 service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-4822a1e8-6e5e-4ccf-af47-84c1b68ddd08 req-6562cf63-6363-4e32-8e7a-e71d47198710 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] No waiting events found dispatching network-vif-unplugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:53 user nova-compute[75378]: WARNING nova.compute.manager [req-4822a1e8-6e5e-4ccf-af47-84c1b68ddd08 req-6562cf63-6363-4e32-8e7a-e71d47198710 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received unexpected event network-vif-unplugged-e4725ee0-c613-48af-8163-eafad2605fff for instance with vm_state active and task_state rescuing.
Nov 09 03:47:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:54 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Instance destroyed successfully.
Nov 09 03:47:54 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Attempting rescue
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75378) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Instance directory exists: not creating {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 03:47:54 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Creating image(s)
Nov 09 03:47:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "/opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "/opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "/opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.objects.instance [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'trusted_certs' on Instance uuid 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.212s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk.rescue {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk.rescue" returned: 0 in 0.056s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.objects.instance [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'migration_context' on Instance uuid 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.objects.base [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Object Instance<89cb3e6d-1b20-4c45-aa0b-a64c92d893c3> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Start _get_guest_xml network_info=[{"id": "e4725ee0-c613-48af-8163-eafad2605fff", "address": "fa:16:3e:89:f8:61", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "vif_mac": "fa:16:3e:89:f8:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4725ee0-c6", "ovs_interfaceid": "e4725ee0-c613-48af-8163-eafad2605fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.objects.instance [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'resources' on Instance uuid 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.objects.base [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Object Instance<89cb3e6d-1b20-4c45-aa0b-a64c92d893c3> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.objects.instance [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'numa_topology' on Instance uuid 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.objects.base [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Object Instance<89cb3e6d-1b20-4c45-aa0b-a64c92d893c3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:47:54 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:47:54 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.objects.instance [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'vcpu_model' on Instance uuid 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.objects.base [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Object Instance<89cb3e6d-1b20-4c45-aa0b-a64c92d893c3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-846627937',display_name='tempest-ServerRescueNegativeTestJSON-server-846627937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-846627937',id=18,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBC3j8XalFsnv+ohCWJaFMOzhebiKVhwDqjVSbRzER5tSDvpTJuoMZ9QtIikxGF9BqxV9wk5YQgyNlPsJFGp6zlCYonssIWXLzu36PmDp5LDOUw0qUWi4uNuNyeb3voJCw==',key_name='tempest-keypair-880565104',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:45:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87cddc7aab3e44cf82391eebc6a167b1',ramdisk_id='',reservation_id='r-ww0mhtjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1449314788',owner_user_name='tempest-ServerRescueNegativeTestJSON-1449314788-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab29d2c2dda547aeb386aa641f4acd24',uuid=89cb3e6d-1b20-4c45-aa0b-a64c92d893c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4725ee0-c613-48af-8163-eafad2605fff", "address": "fa:16:3e:89:f8:61", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "vif_mac": "fa:16:3e:89:f8:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4725ee0-c6", "ovs_interfaceid": "e4725ee0-c613-48af-8163-eafad2605fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converting VIF {"id": "e4725ee0-c613-48af-8163-eafad2605fff", "address": "fa:16:3e:89:f8:61", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "vif_mac": "fa:16:3e:89:f8:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4725ee0-c6", "ovs_interfaceid": "e4725ee0-c613-48af-8163-eafad2605fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:f8:61,bridge_name='br-int',has_traffic_filtering=True,id=e4725ee0-c613-48af-8163-eafad2605fff,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4725ee0-c6') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.objects.instance [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'pci_devices' on Instance uuid 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.objects.base [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Object Instance<89cb3e6d-1b20-4c45-aa0b-a64c92d893c3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:47:54 user nova-compute[75378]:   <uuid>89cb3e6d-1b20-4c45-aa0b-a64c92d893c3</uuid>
Nov 09 03:47:54 user nova-compute[75378]:   <name>instance-00000012</name>
Nov 09 03:47:54 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:47:54 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:47:54 user nova-compute[75378]:   <metadata>
Nov 09 03:47:54 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:47:54 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:47:54 user nova-compute[75378]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-846627937</nova:name>
Nov 09 03:47:54 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:47:54</nova:creationTime>
Nov 09 03:47:54 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:47:54 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:47:54 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:47:54 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:47:54 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:47:54 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:47:54 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:47:54 user nova-compute[75378]:       <nova:owner>
Nov 09 03:47:54 user nova-compute[75378]:         <nova:user uuid="ab29d2c2dda547aeb386aa641f4acd24">tempest-ServerRescueNegativeTestJSON-1449314788-project-member</nova:user>
Nov 09 03:47:54 user nova-compute[75378]:         <nova:project uuid="87cddc7aab3e44cf82391eebc6a167b1">tempest-ServerRescueNegativeTestJSON-1449314788</nova:project>
Nov 09 03:47:54 user nova-compute[75378]:       </nova:owner>
Nov 09 03:47:54 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:47:54 user nova-compute[75378]:       <nova:ports>
Nov 09 03:47:54 user nova-compute[75378]:         <nova:port uuid="e4725ee0-c613-48af-8163-eafad2605fff">
Nov 09 03:47:54 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 09 03:47:54 user nova-compute[75378]:         </nova:port>
Nov 09 03:47:54 user nova-compute[75378]:       </nova:ports>
Nov 09 03:47:54 user nova-compute[75378]:     </nova:instance>
Nov 09 03:47:54 user nova-compute[75378]:   </metadata>
Nov 09 03:47:54 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:47:54 user nova-compute[75378]:     <system>
Nov 09 03:47:54 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:47:54 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:47:54 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:47:54 user nova-compute[75378]:       <entry name="serial">89cb3e6d-1b20-4c45-aa0b-a64c92d893c3</entry>
Nov 09 03:47:54 user nova-compute[75378]:       <entry name="uuid">89cb3e6d-1b20-4c45-aa0b-a64c92d893c3</entry>
Nov 09 03:47:54 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:47:54 user nova-compute[75378]:     </system>
Nov 09 03:47:54 user nova-compute[75378]:   </sysinfo>
Nov 09 03:47:54 user nova-compute[75378]:   <os>
Nov 09 03:47:54 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:47:54 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:47:54 user nova-compute[75378]:   </os>
Nov 09 03:47:54 user nova-compute[75378]:   <features>
Nov 09 03:47:54 user nova-compute[75378]:     <acpi/>
Nov 09 03:47:54 user nova-compute[75378]:     <apic/>
Nov 09 03:47:54 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:47:54 user nova-compute[75378]:   </features>
Nov 09 03:47:54 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:47:54 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:47:54 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:47:54 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:47:54 user nova-compute[75378]:   </clock>
Nov 09 03:47:54 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:47:54 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:47:54 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:47:54 user nova-compute[75378]:   </cpu>
Nov 09 03:47:54 user nova-compute[75378]:   <devices>
Nov 09 03:47:54 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:47:54 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:47:54 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk.rescue"/>
Nov 09 03:47:54 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:47:54 user nova-compute[75378]:     </disk>
Nov 09 03:47:54 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:47:54 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:47:54 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk"/>
Nov 09 03:47:54 user nova-compute[75378]:       <target dev="vdb" bus="virtio"/>
Nov 09 03:47:54 user nova-compute[75378]:     </disk>
Nov 09 03:47:54 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:47:54 user nova-compute[75378]:       <mac address="fa:16:3e:89:f8:61"/>
Nov 09 03:47:54 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:47:54 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:47:54 user nova-compute[75378]:       <target dev="tape4725ee0-c6"/>
Nov 09 03:47:54 user nova-compute[75378]:     </interface>
Nov 09 03:47:54 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:47:54 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/console.log" append="off"/>
Nov 09 03:47:54 user nova-compute[75378]:     </serial>
Nov 09 03:47:54 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:47:54 user nova-compute[75378]:     <video>
Nov 09 03:47:54 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:47:54 user nova-compute[75378]:     </video>
Nov 09 03:47:54 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:47:54 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:47:54 user nova-compute[75378]:     </rng>
Nov 09 03:47:54 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:47:54 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:47:54 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:47:54 user nova-compute[75378]:     </memballoon>
Nov 09 03:47:54 user nova-compute[75378]:   </devices>
Nov 09 03:47:54 user nova-compute[75378]: </domain>
Nov 09 03:47:54 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:47:54 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Instance destroyed successfully.
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:47:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] No VIF found with MAC fa:16:3e:89:f8:61, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:47:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-39f4eb25-bd06-4615-bec9-5f885ac83110 req-831b6843-0fcc-4f3c-9731-872590956fcb service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received event network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-39f4eb25-bd06-4615-bec9-5f885ac83110 req-831b6843-0fcc-4f3c-9731-872590956fcb service nova] Acquiring lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-39f4eb25-bd06-4615-bec9-5f885ac83110 req-831b6843-0fcc-4f3c-9731-872590956fcb service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-39f4eb25-bd06-4615-bec9-5f885ac83110 req-831b6843-0fcc-4f3c-9731-872590956fcb service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-39f4eb25-bd06-4615-bec9-5f885ac83110 req-831b6843-0fcc-4f3c-9731-872590956fcb service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] No waiting events found dispatching network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:55 user nova-compute[75378]: WARNING nova.compute.manager [req-39f4eb25-bd06-4615-bec9-5f885ac83110 req-831b6843-0fcc-4f3c-9731-872590956fcb service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received unexpected event network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff for instance with vm_state active and task_state rescuing.
Nov 09 03:47:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:47:57 user nova-compute[75378]: DEBUG nova.compute.manager [req-646314b3-0c87-4ae7-bc74-9636b28abb64 req-aef88ee0-f9cc-4284-8095-6e00cd93c0ca service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received event network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-646314b3-0c87-4ae7-bc74-9636b28abb64 req-aef88ee0-f9cc-4284-8095-6e00cd93c0ca service nova] Acquiring lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-646314b3-0c87-4ae7-bc74-9636b28abb64 req-aef88ee0-f9cc-4284-8095-6e00cd93c0ca service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-646314b3-0c87-4ae7-bc74-9636b28abb64 req-aef88ee0-f9cc-4284-8095-6e00cd93c0ca service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:58 user nova-compute[75378]: DEBUG nova.compute.manager [req-646314b3-0c87-4ae7-bc74-9636b28abb64 req-aef88ee0-f9cc-4284-8095-6e00cd93c0ca service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] No waiting events found dispatching network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:58 user nova-compute[75378]: WARNING nova.compute.manager [req-646314b3-0c87-4ae7-bc74-9636b28abb64 req-aef88ee0-f9cc-4284-8095-6e00cd93c0ca service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received unexpected event network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff for instance with vm_state active and task_state rescuing.
Nov 09 03:47:58 user nova-compute[75378]: DEBUG nova.compute.manager [req-646314b3-0c87-4ae7-bc74-9636b28abb64 req-aef88ee0-f9cc-4284-8095-6e00cd93c0ca service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received event network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:47:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-646314b3-0c87-4ae7-bc74-9636b28abb64 req-aef88ee0-f9cc-4284-8095-6e00cd93c0ca service nova] Acquiring lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:47:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-646314b3-0c87-4ae7-bc74-9636b28abb64 req-aef88ee0-f9cc-4284-8095-6e00cd93c0ca service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:47:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-646314b3-0c87-4ae7-bc74-9636b28abb64 req-aef88ee0-f9cc-4284-8095-6e00cd93c0ca service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:47:58 user nova-compute[75378]: DEBUG nova.compute.manager [req-646314b3-0c87-4ae7-bc74-9636b28abb64 req-aef88ee0-f9cc-4284-8095-6e00cd93c0ca service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] No waiting events found dispatching network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:47:58 user nova-compute[75378]: WARNING nova.compute.manager [req-646314b3-0c87-4ae7-bc74-9636b28abb64 req-aef88ee0-f9cc-4284-8095-6e00cd93c0ca service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received unexpected event network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff for instance with vm_state active and task_state rescuing.
Nov 09 03:47:58 user nova-compute[75378]: DEBUG nova.compute.manager [None req-7c776f41-29e0-42fb-8f3f-9497fab4e9ce tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:48:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:04 user nova-compute[75378]: INFO nova.compute.manager [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Rescuing
Nov 09 03:48:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "refresh_cache-013db901-fbee-4593-a14f-95a03e79fad0" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:48:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquired lock "refresh_cache-013db901-fbee-4593-a14f-95a03e79fad0" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:48:04 user nova-compute[75378]: DEBUG nova.network.neutron [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:48:04 user nova-compute[75378]: DEBUG nova.network.neutron [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Updating instance_info_cache with network_info: [{"id": "5650a4a6-f99d-42e2-8b94-f18562892154", "address": "fa:16:3e:7f:95:df", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5650a4a6-f9", "ovs_interfaceid": "5650a4a6-f99d-42e2-8b94-f18562892154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:48:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Releasing lock "refresh_cache-013db901-fbee-4593-a14f-95a03e79fad0" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:48:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:05 user nova-compute[75378]: DEBUG nova.compute.manager [req-48e06ca7-210b-4a9c-a586-d1aec735412a req-69a4ac30-a8cc-4a75-be31-dfcc8b44858e service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received event network-vif-unplugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:48:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-48e06ca7-210b-4a9c-a586-d1aec735412a req-69a4ac30-a8cc-4a75-be31-dfcc8b44858e service nova] Acquiring lock "013db901-fbee-4593-a14f-95a03e79fad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:48:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-48e06ca7-210b-4a9c-a586-d1aec735412a req-69a4ac30-a8cc-4a75-be31-dfcc8b44858e service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:48:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-48e06ca7-210b-4a9c-a586-d1aec735412a req-69a4ac30-a8cc-4a75-be31-dfcc8b44858e service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:48:05 user nova-compute[75378]: DEBUG nova.compute.manager [req-48e06ca7-210b-4a9c-a586-d1aec735412a req-69a4ac30-a8cc-4a75-be31-dfcc8b44858e service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] No waiting events found dispatching network-vif-unplugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:48:05 user nova-compute[75378]: WARNING nova.compute.manager [req-48e06ca7-210b-4a9c-a586-d1aec735412a req-69a4ac30-a8cc-4a75-be31-dfcc8b44858e service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received unexpected event network-vif-unplugged-5650a4a6-f99d-42e2-8b94-f18562892154 for instance with vm_state active and task_state rescuing.
Nov 09 03:48:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:05 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Instance destroyed successfully.
Nov 09 03:48:05 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Attempting a stable device rescue
Nov 09 03:48:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75378) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 09 03:48:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Instance directory exists: not creating {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 03:48:05 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Creating image(s)
Nov 09 03:48:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "/opt/stack/data/nova/instances/013db901-fbee-4593-a14f-95a03e79fad0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:48:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "/opt/stack/data/nova/instances/013db901-fbee-4593-a14f-95a03e79fad0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:48:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "/opt/stack/data/nova/instances/013db901-fbee-4593-a14f-95a03e79fad0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:48:05 user nova-compute[75378]: DEBUG nova.objects.instance [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'trusted_certs' on Instance uuid 013db901-fbee-4593-a14f-95a03e79fad0 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:48:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "0704b21fa53749ea6370e6b8523fc27c4e3153c0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:48:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "0704b21fa53749ea6370e6b8523fc27c4e3153c0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:48:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0704b21fa53749ea6370e6b8523fc27c4e3153c0.part --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0704b21fa53749ea6370e6b8523fc27c4e3153c0.part --force-share --output=json" returned: 0 in 0.177s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:06 user nova-compute[75378]: DEBUG nova.virt.images [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] fbfc0b66-5015-49a5-b6ee-4b604e6ffc8b was qcow2, converting to raw {{(pid=75378) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 03:48:06 user nova-compute[75378]: DEBUG nova.privsep.utils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75378) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 03:48:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0704b21fa53749ea6370e6b8523fc27c4e3153c0.part /opt/stack/data/nova/instances/_base/0704b21fa53749ea6370e6b8523fc27c4e3153c0.converted {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0704b21fa53749ea6370e6b8523fc27c4e3153c0.part /opt/stack/data/nova/instances/_base/0704b21fa53749ea6370e6b8523fc27c4e3153c0.converted" returned: 0 in 0.301s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0704b21fa53749ea6370e6b8523fc27c4e3153c0.converted --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-a5d098fa-146a-4f1d-a214-b4d8289e2bbd req-ad483e94-cd8f-48b0-94c4-545fb4b9752e service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received event network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a5d098fa-146a-4f1d-a214-b4d8289e2bbd req-ad483e94-cd8f-48b0-94c4-545fb4b9752e service nova] Acquiring lock "013db901-fbee-4593-a14f-95a03e79fad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a5d098fa-146a-4f1d-a214-b4d8289e2bbd req-ad483e94-cd8f-48b0-94c4-545fb4b9752e service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a5d098fa-146a-4f1d-a214-b4d8289e2bbd req-ad483e94-cd8f-48b0-94c4-545fb4b9752e service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-a5d098fa-146a-4f1d-a214-b4d8289e2bbd req-ad483e94-cd8f-48b0-94c4-545fb4b9752e service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] No waiting events found dispatching network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:48:07 user nova-compute[75378]: WARNING nova.compute.manager [req-a5d098fa-146a-4f1d-a214-b4d8289e2bbd req-ad483e94-cd8f-48b0-94c4-545fb4b9752e service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received unexpected event network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 for instance with vm_state active and task_state rescuing.
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0704b21fa53749ea6370e6b8523fc27c4e3153c0.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "0704b21fa53749ea6370e6b8523fc27c4e3153c0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.515s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "0704b21fa53749ea6370e6b8523fc27c4e3153c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "0704b21fa53749ea6370e6b8523fc27c4e3153c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0704b21fa53749ea6370e6b8523fc27c4e3153c0 --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0704b21fa53749ea6370e6b8523fc27c4e3153c0 --force-share --output=json" returned: 0 in 0.171s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0704b21fa53749ea6370e6b8523fc27c4e3153c0,backing_fmt=raw /opt/stack/data/nova/instances/013db901-fbee-4593-a14f-95a03e79fad0/disk.rescue {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0704b21fa53749ea6370e6b8523fc27c4e3153c0,backing_fmt=raw /opt/stack/data/nova/instances/013db901-fbee-4593-a14f-95a03e79fad0/disk.rescue" returned: 0 in 0.049s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "0704b21fa53749ea6370e6b8523fc27c4e3153c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.objects.instance [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'migration_context' on Instance uuid 013db901-fbee-4593-a14f-95a03e79fad0 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.objects.base [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Object Instance<013db901-fbee-4593-a14f-95a03e79fad0> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Start _get_guest_xml network_info=[{"id": "5650a4a6-f99d-42e2-8b94-f18562892154", "address": "fa:16:3e:7f:95:df", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "vif_mac": "fa:16:3e:7f:95:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5650a4a6-f9", "ovs_interfaceid": "5650a4a6-f99d-42e2-8b94-f18562892154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fbfc0b66-5015-49a5-b6ee-4b604e6ffc8b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aSeGHxRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '013db901-fbee-4593-a14f-95a03e79fad0', 'attached_at': '', 'detached_at': '', 'volume_id': '35d5d634-9dbe-4a80-b298-47934fd627dc', 'serial': '35d5d634-9dbe-4a80-b298-47934fd627dc'}, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'e906c831-cd64-4184-8b39-76da3dcf8563', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.objects.instance [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'resources' on Instance uuid 013db901-fbee-4593-a14f-95a03e79fad0 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.objects.base [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Object Instance<013db901-fbee-4593-a14f-95a03e79fad0> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.objects.instance [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'numa_topology' on Instance uuid 013db901-fbee-4593-a14f-95a03e79fad0 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.objects.base [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Object Instance<013db901-fbee-4593-a14f-95a03e79fad0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:48:07 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:48:07 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.objects.instance [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'vcpu_model' on Instance uuid 013db901-fbee-4593-a14f-95a03e79fad0 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.objects.base [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Object Instance<013db901-fbee-4593-a14f-95a03e79fad0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aSeGHxRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:48:07 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:48:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:48:07 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:48:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:48:07 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b62956-52ac-4c7e-972b-af0b4254bf41]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = aSeGHxRK\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 09 03:48:07 user nova-compute[75378]: node.name = iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 03:48:07 user nova-compute[75378]: node.tpgt = -1
Nov 09 03:48:07 user nova-compute[75378]: node.startup = automatic
Nov 09 03:48:07 user nova-compute[75378]: node.leading_login = No
Nov 09 03:48:07 user nova-compute[75378]: iface.iscsi_ifacename = default
Nov 09 03:48:07 user nova-compute[75378]: iface.net_ifacename = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.ipaddress = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.prefix_len = 0
Nov 09 03:48:07 user nova-compute[75378]: iface.hwaddress = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.transport_name = tcp
Nov 09 03:48:07 user nova-compute[75378]: iface.initiatorname = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.state = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.vlan_id = 0
Nov 09 03:48:07 user nova-compute[75378]: iface.vlan_priority = 0
Nov 09 03:48:07 user nova-compute[75378]: iface.vlan_state = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.iface_num = 0
Nov 09 03:48:07 user nova-compute[75378]: iface.mtu = 0
Nov 09 03:48:07 user nova-compute[75378]: iface.port = 0
Nov 09 03:48:07 user nova-compute[75378]: iface.bootproto = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.subnet_mask = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.gateway = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.dhcp_alt_client_id_state = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.dhcp_alt_client_id = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.dhcp_dns = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.dhcp_learn_iqn = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.dhcp_req_vendor_id_state = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.dhcp_vendor_id_state = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.dhcp_vendor_id = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.dhcp_slp_da = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.fragmentation = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.gratuitous_arp = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.incoming_forwarding = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.tos_state = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.tos = 0
Nov 09 03:48:07 user nova-compute[75378]: iface.ttl = 0
Nov 09 03:48:07 user nova-compute[75378]: iface.delayed_ack = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.tcp_nagle = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.tcp_wsf_state = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.tcp_wsf = 0
Nov 09 03:48:07 user nova-compute[75378]: iface.tcp_timer_scale = 0
Nov 09 03:48:07 user nova-compute[75378]: iface.tcp_timestamp = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.redirect = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.def_task_mgmt_timeout = 0
Nov 09 03:48:07 user nova-compute[75378]: iface.header_digest = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.data_digest = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.immediate_data = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.initial_r2t = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.data_seq_inorder = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.data_pdu_inorder = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.erl = 0
Nov 09 03:48:07 user nova-compute[75378]: iface.max_receive_data_len = 0
Nov 09 03:48:07 user nova-compute[75378]: iface.first_burst_len = 0
Nov 09 03:48:07 user nova-compute[75378]: iface.max_outstanding_r2t = 0
Nov 09 03:48:07 user nova-compute[75378]: iface.max_burst_len = 0
Nov 09 03:48:07 user nova-compute[75378]: iface.chap_auth = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.bidi_chap = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.strict_login_compliance = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.discovery_auth = <empty>
Nov 09 03:48:07 user nova-compute[75378]: iface.discovery_logout = <empty>
Nov 09 03:48:07 user nova-compute[75378]: node.discovery_address = <empty>
Nov 09 03:48:07 user nova-compute[75378]: node.discovery_port = 0
Nov 09 03:48:07 user nova-compute[75378]: node.discovery_type = static
Nov 09 03:48:07 user nova-compute[75378]: node.session.initial_cmdsn = 0
Nov 09 03:48:07 user nova-compute[75378]: node.session.initial_login_retry_max = 8
Nov 09 03:48:07 user nova-compute[75378]: node.session.xmit_thread_priority = -20
Nov 09 03:48:07 user nova-compute[75378]: node.session.cmds_max = 128
Nov 09 03:48:07 user nova-compute[75378]: node.session.queue_depth = 32
Nov 09 03:48:07 user nova-compute[75378]: node.session.nr_sessions = 1
Nov 09 03:48:07 user nova-compute[75378]: node.session.auth.authmethod = CHAP
Nov 09 03:48:07 user nova-compute[75378]: node.session.auth.username = aSeGHxRK
Nov 09 03:48:07 user nova-compute[75378]: node.session.auth.password = ***
Nov 09 03:48:07 user nova-compute[75378]: node.session.auth.username_in = <empty>
Nov 09 03:48:07 user nova-compute[75378]: node.session.auth.password_in = <empty>
Nov 09 03:48:07 user nova-compute[75378]: node.session.auth.chap_algs = MD5
Nov 09 03:48:07 user nova-compute[75378]: node.session.timeo.replacement_timeout = 120
Nov 09 03:48:07 user nova-compute[75378]: node.session.err_timeo.abort_timeout = 15
Nov 09 03:48:07 user nova-compute[75378]: node.session.err_timeo.lu_reset_timeout = 30
Nov 09 03:48:07 user nova-compute[75378]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 09 03:48:07 user nova-compute[75378]: node.session.err_timeo.host_reset_timeout = 60
Nov 09 03:48:07 user nova-compute[75378]: node.session.iscsi.FastAbort = Yes
Nov 09 03:48:07 user nova-compute[75378]: node.session.iscsi.InitialR2T = No
Nov 09 03:48:07 user nova-compute[75378]: node.session.iscsi.ImmediateData = Yes
Nov 09 03:48:07 user nova-compute[75378]: node.session.iscsi.FirstBurstLength = 262144
Nov 09 03:48:07 user nova-compute[75378]: node.session.iscsi.MaxBurstLength = 16776192
Nov 09 03:48:07 user nova-compute[75378]: node.session.iscsi.DefaultTime2Retain = 0
Nov 09 03:48:07 user nova-compute[75378]: node.session.iscsi.DefaultTime2Wait = 2
Nov 09 03:48:07 user nova-compute[75378]: node.session.iscsi.MaxConnections = 1
Nov 09 03:48:07 user nova-compute[75378]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 09 03:48:07 user nova-compute[75378]: node.session.iscsi.ERL = 0
Nov 09 03:48:07 user nova-compute[75378]: node.session.scan = manual
Nov 09 03:48:07 user nova-compute[75378]: node.session.reopen_max = 0
Nov 09 03:48:07 user nova-compute[75378]: node.conn[0].address = 172.16.0.220
Nov 09 03:48:07 user nova-compute[75378]: node.conn[0].port = 3260
Nov 09 03:48:07 user nova-compute[75378]: node.conn[0].startup = manual
Nov 09 03:48:07 user nova-compute[75378]: node.conn[0].tcp.window_size = 524288
Nov 09 03:48:07 user nova-compute[75378]: node.conn[0].tcp.type_of_service = 0
Nov 09 03:48:07 user nova-compute[75378]: node.conn[0].timeo.logout_timeout = 15
Nov 09 03:48:07 user nova-compute[75378]: node.conn[0].timeo.login_timeout = 15
Nov 09 03:48:07 user nova-compute[75378]: node.conn[0].timeo.auth_timeout = 45
Nov 09 03:48:07 user nova-compute[75378]: node.conn[0].timeo.noop_out_interval = 5
Nov 09 03:48:07 user nova-compute[75378]: node.conn[0].timeo.noop_out_timeout = 5
Nov 09 03:48:07 user nova-compute[75378]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 09 03:48:07 user nova-compute[75378]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 09 03:48:07 user nova-compute[75378]: node.conn[0].iscsi.HeaderDigest = None
Nov 09 03:48:07 user nova-compute[75378]: node.conn[0].iscsi.DataDigest = None
Nov 09 03:48:07 user nova-compute[75378]: node.conn[0].iscsi.IFMarker = No
Nov 09 03:48:07 user nova-compute[75378]: node.conn[0].iscsi.OFMarker = No
Nov 09 03:48:07 user nova-compute[75378]: # END RECORD
Nov 09 03:48:07 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de5a703-30df-4538-964f-73f55050b5a0]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd9b406-f541-43e5-97ad-699402b04d6a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aSeGHxRK {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aSeGHxRK" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cff484-804a-4032-adbe-53cca533d5d6]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aSeGHxRK'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9e102c-b42d-4474-b5c3-1f404d169210]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c62620-843e-41e5-9f0b-b96e9aa9c317]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:48:07 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:48:07 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:48:07 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:48:07 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:48:07 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:48:07 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:48:07 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:48:07 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:48:07 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:48:07 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.170s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] HCTL ('34', '0', '0', 0) found on session 16 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[482daa96-3338-4f8c-90ba-f648cc7e2421]: (4, ('0 0 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Searching for a device in session 16 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aSeGHxRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.196s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] <== connect_volume: return (197ms) {'type': 'block', 'scsi_wwn': '26135666632663735', 'path': '/dev/sdc'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135666632663735', 'path': '/dev/sdc'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-51079469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-51079469',id=22,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:46:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c2176531ffa4cf7bec818309e39ab8d',ramdisk_id='',reservation_id='r-v7do5wzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:46:59Z,user_data=None,user_id='57efcfeacd7f4daf916e7dd04e11d8f2',uuid=013db901-fbee-4593-a14f-95a03e79fad0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5650a4a6-f99d-42e2-8b94-f18562892154", "address": "fa:16:3e:7f:95:df", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "vif_mac": "fa:16:3e:7f:95:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5650a4a6-f9", "ovs_interfaceid": "5650a4a6-f99d-42e2-8b94-f18562892154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converting VIF {"id": "5650a4a6-f99d-42e2-8b94-f18562892154", "address": "fa:16:3e:7f:95:df", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "vif_mac": "fa:16:3e:7f:95:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5650a4a6-f9", "ovs_interfaceid": "5650a4a6-f99d-42e2-8b94-f18562892154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:95:df,bridge_name='br-int',has_traffic_filtering=True,id=5650a4a6-f99d-42e2-8b94-f18562892154,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5650a4a6-f9') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.objects.instance [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'pci_devices' on Instance uuid 013db901-fbee-4593-a14f-95a03e79fad0 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.objects.base [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Object Instance<013db901-fbee-4593-a14f-95a03e79fad0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:48:07 user nova-compute[75378]:   <uuid>013db901-fbee-4593-a14f-95a03e79fad0</uuid>
Nov 09 03:48:07 user nova-compute[75378]:   <name>instance-00000016</name>
Nov 09 03:48:07 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:48:07 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:48:07 user nova-compute[75378]:   <metadata>
Nov 09 03:48:07 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:48:07 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:48:07 user nova-compute[75378]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-51079469</nova:name>
Nov 09 03:48:07 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:48:07</nova:creationTime>
Nov 09 03:48:07 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:48:07 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:48:07 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:48:07 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:48:07 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:48:07 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:48:07 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:48:07 user nova-compute[75378]:       <nova:owner>
Nov 09 03:48:07 user nova-compute[75378]:         <nova:user uuid="57efcfeacd7f4daf916e7dd04e11d8f2">tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member</nova:user>
Nov 09 03:48:07 user nova-compute[75378]:         <nova:project uuid="4c2176531ffa4cf7bec818309e39ab8d">tempest-ServerBootFromVolumeStableRescueTest-1679422577</nova:project>
Nov 09 03:48:07 user nova-compute[75378]:       </nova:owner>
Nov 09 03:48:07 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:48:07 user nova-compute[75378]:       <nova:ports>
Nov 09 03:48:07 user nova-compute[75378]:         <nova:port uuid="5650a4a6-f99d-42e2-8b94-f18562892154">
Nov 09 03:48:07 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 09 03:48:07 user nova-compute[75378]:         </nova:port>
Nov 09 03:48:07 user nova-compute[75378]:       </nova:ports>
Nov 09 03:48:07 user nova-compute[75378]:     </nova:instance>
Nov 09 03:48:07 user nova-compute[75378]:   </metadata>
Nov 09 03:48:07 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:48:07 user nova-compute[75378]:     <system>
Nov 09 03:48:07 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:48:07 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:48:07 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:48:07 user nova-compute[75378]:       <entry name="serial">013db901-fbee-4593-a14f-95a03e79fad0</entry>
Nov 09 03:48:07 user nova-compute[75378]:       <entry name="uuid">013db901-fbee-4593-a14f-95a03e79fad0</entry>
Nov 09 03:48:07 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:48:07 user nova-compute[75378]:     </system>
Nov 09 03:48:07 user nova-compute[75378]:   </sysinfo>
Nov 09 03:48:07 user nova-compute[75378]:   <os>
Nov 09 03:48:07 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:48:07 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:48:07 user nova-compute[75378]:   </os>
Nov 09 03:48:07 user nova-compute[75378]:   <features>
Nov 09 03:48:07 user nova-compute[75378]:     <acpi/>
Nov 09 03:48:07 user nova-compute[75378]:     <apic/>
Nov 09 03:48:07 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:48:07 user nova-compute[75378]:   </features>
Nov 09 03:48:07 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:48:07 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:48:07 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:48:07 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:48:07 user nova-compute[75378]:   </clock>
Nov 09 03:48:07 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:48:07 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:48:07 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:48:07 user nova-compute[75378]:   </cpu>
Nov 09 03:48:07 user nova-compute[75378]:   <devices>
Nov 09 03:48:07 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 03:48:07 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:48:07 user nova-compute[75378]:       <source dev="/dev/sdc"/>
Nov 09 03:48:07 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:48:07 user nova-compute[75378]:       <serial>35d5d634-9dbe-4a80-b298-47934fd627dc</serial>
Nov 09 03:48:07 user nova-compute[75378]:     </disk>
Nov 09 03:48:07 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:48:07 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:48:07 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/013db901-fbee-4593-a14f-95a03e79fad0/disk.rescue"/>
Nov 09 03:48:07 user nova-compute[75378]:       <target dev="vdb" bus="virtio"/>
Nov 09 03:48:07 user nova-compute[75378]:       <boot order="1"/>
Nov 09 03:48:07 user nova-compute[75378]:     </disk>
Nov 09 03:48:07 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:48:07 user nova-compute[75378]:       <mac address="fa:16:3e:7f:95:df"/>
Nov 09 03:48:07 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:48:07 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:48:07 user nova-compute[75378]:       <target dev="tap5650a4a6-f9"/>
Nov 09 03:48:07 user nova-compute[75378]:     </interface>
Nov 09 03:48:07 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:48:07 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/013db901-fbee-4593-a14f-95a03e79fad0/console.log" append="off"/>
Nov 09 03:48:07 user nova-compute[75378]:     </serial>
Nov 09 03:48:07 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:48:07 user nova-compute[75378]:     <video>
Nov 09 03:48:07 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:48:07 user nova-compute[75378]:     </video>
Nov 09 03:48:07 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:48:07 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:48:07 user nova-compute[75378]:     </rng>
Nov 09 03:48:07 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:48:07 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:48:07 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:48:07 user nova-compute[75378]:     </memballoon>
Nov 09 03:48:07 user nova-compute[75378]:   </devices>
Nov 09 03:48:07 user nova-compute[75378]: </domain>
Nov 09 03:48:07 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:48:07 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Instance destroyed successfully.
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:48:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] No VIF found with MAC fa:16:3e:7f:95:df, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:48:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-689a7a20-92ce-4d79-8332-623c9212a34c req-f82350fe-37de-454a-8ce7-d34c9c7dffe2 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received event network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:48:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-689a7a20-92ce-4d79-8332-623c9212a34c req-f82350fe-37de-454a-8ce7-d34c9c7dffe2 service nova] Acquiring lock "013db901-fbee-4593-a14f-95a03e79fad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:48:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-689a7a20-92ce-4d79-8332-623c9212a34c req-f82350fe-37de-454a-8ce7-d34c9c7dffe2 service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:48:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-689a7a20-92ce-4d79-8332-623c9212a34c req-f82350fe-37de-454a-8ce7-d34c9c7dffe2 service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:48:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-689a7a20-92ce-4d79-8332-623c9212a34c req-f82350fe-37de-454a-8ce7-d34c9c7dffe2 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] No waiting events found dispatching network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:48:09 user nova-compute[75378]: WARNING nova.compute.manager [req-689a7a20-92ce-4d79-8332-623c9212a34c req-f82350fe-37de-454a-8ce7-d34c9c7dffe2 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received unexpected event network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 for instance with vm_state active and task_state rescuing.
Nov 09 03:48:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:11 user nova-compute[75378]: DEBUG nova.compute.manager [None req-8dd0bb57-c067-40cd-b936-4e4b9cdcae79 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:48:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:11 user nova-compute[75378]: DEBUG nova.compute.manager [req-2c1bd277-d55f-49d4-874d-388ee1e15fcc req-3c08033e-edc0-4139-b66b-42243f9c2e92 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received event network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:48:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2c1bd277-d55f-49d4-874d-388ee1e15fcc req-3c08033e-edc0-4139-b66b-42243f9c2e92 service nova] Acquiring lock "013db901-fbee-4593-a14f-95a03e79fad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:48:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2c1bd277-d55f-49d4-874d-388ee1e15fcc req-3c08033e-edc0-4139-b66b-42243f9c2e92 service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:48:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2c1bd277-d55f-49d4-874d-388ee1e15fcc req-3c08033e-edc0-4139-b66b-42243f9c2e92 service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:48:11 user nova-compute[75378]: DEBUG nova.compute.manager [req-2c1bd277-d55f-49d4-874d-388ee1e15fcc req-3c08033e-edc0-4139-b66b-42243f9c2e92 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] No waiting events found dispatching network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:48:11 user nova-compute[75378]: WARNING nova.compute.manager [req-2c1bd277-d55f-49d4-874d-388ee1e15fcc req-3c08033e-edc0-4139-b66b-42243f9c2e92 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received unexpected event network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 for instance with vm_state rescued and task_state None.
Nov 09 03:48:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:24 user nova-compute[75378]: DEBUG nova.compute.manager [req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea req-5cf09518-071f-4c83-ab77-d6d87104d43b service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Received event volume-reimaged-b3426aa0-910f-4c33-80c6-b74e104bbb09 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:48:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea req-5cf09518-071f-4c83-ab77-d6d87104d43b service nova] Acquiring lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:48:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea req-5cf09518-071f-4c83-ab77-d6d87104d43b service nova] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:48:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea req-5cf09518-071f-4c83-ab77-d6d87104d43b service nova] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:48:24 user nova-compute[75378]: DEBUG nova.compute.manager [req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea req-5cf09518-071f-4c83-ab77-d6d87104d43b service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Processing event volume-reimaged-b3426aa0-910f-4c33-80c6-b74e104bbb09 {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 09 03:48:24 user nova-compute[75378]: DEBUG nova.compute.manager [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Instance event wait completed in 36 seconds for volume-reimaged {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:48:24 user nova-compute[75378]: INFO nova.virt.block_device [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Booting with volume b3426aa0-910f-4c33-80c6-b74e104bbb09 at /dev/vda
Nov 09 03:48:24 user nova-compute[75378]: DEBUG os_brick.utils [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:48:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:24 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[20352851-b4c9-4e3a-95ea-bfa5dec61100]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:24 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fceb13ad-08ca-4797-995d-157578f9e3ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:24 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a00ee7-0122-494e-95dc-5cc6a51d8d3e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:24 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[016ea45c-e1e5-4237-9b5e-b102dd8b4da7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:48:24 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:48:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:48:25 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:48:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ff95df-bca6-4b92-8fb0-1bdaaa73628f]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:48:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:48:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:48:25 user nova-compute[75378]: DEBUG os_brick.utils [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:48:25 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Updating existing volume attachment record: 94a7baf1-c33c-47d9-9e20-032125a85373 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:48:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "06216917-d7d1-4fd4-a311-e054437e84a6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:48:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "06216917-d7d1-4fd4-a311-e054437e84a6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:48:27 user nova-compute[75378]: DEBUG nova.objects.instance [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lazy-loading 'flavor' on Instance uuid 06216917-d7d1-4fd4-a311-e054437e84a6 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "06216917-d7d1-4fd4-a311-e054437e84a6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "06216917-d7d1-4fd4-a311-e054437e84a6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "06216917-d7d1-4fd4-a311-e054437e84a6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:48:28 user nova-compute[75378]: INFO nova.compute.manager [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Attaching volume 2fdd9b92-de5f-4df9-9994-444624a88b75 to /dev/vdb
Nov 09 03:48:28 user nova-compute[75378]: DEBUG os_brick.utils [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c53736c-8efa-41b6-ada2-f8931f35caf1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfdc028-69d1-49a4-9348-f9b4509267d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef24cefb-27a0-4bd4-93b0-5eb306be26e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0309959f-6f30-45d6-ab78-dbb9866cb4d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:48:28 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:48:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e816af-b523-4ac8-9181-44545547b284]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG os_brick.utils [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:48:28 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Updating existing volume attachment record: bd7a54c5-744f-4cd7-a39f-5c440cd6d23b {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:48:30 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:48:30 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:48:30 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:48:30 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Rebuilding the list of instances to heal {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 03:48:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:48:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:48:30 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 03:48:30 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lazy-loading 'info_cache' on Instance uuid c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:48:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:31 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Updating instance_info_cache with network_info: [{"id": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "address": "fa:16:3e:a6:f3:49", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d42515-fd", "ovs_interfaceid": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:48:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:48:31 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 03:48:31 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:48:31 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:48:31 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:48:31 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:48:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:32 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:48:33 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:48:33 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:48:34 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:48:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:48:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:48:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:48:34 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:48:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:48:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:48:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/013db901-fbee-4593-a14f-95a03e79fad0/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/013db901-fbee-4593-a14f-95a03e79fad0/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/013db901-fbee-4593-a14f-95a03e79fad0/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/013db901-fbee-4593-a14f-95a03e79fad0/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:48:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:48:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:48:39 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:48:39 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:48:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7147MB free_disk=25.25720977783203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:48:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:48:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:48:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:48:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:48:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7d051405-6b57-4db2-9533-c2f4e87134d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:48:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 883490f1-6a9f-4ad6-83c4-44b78e681de6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:48:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:48:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c4ef6623-863b-40a8-b9ec-720c25ee3484 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:48:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2c2acb48-972a-41d7-987e-48e79b3bef93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:48:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7e12539b-36a3-4691-89fd-e3d155de38d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:48:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 013db901-fbee-4593-a14f-95a03e79fad0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:48:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 06216917-d7d1-4fd4-a311-e054437e84a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:48:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2abe50f8-3c9b-417e-889f-1d565089d678 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:48:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance cc4b9517-2616-4cfb-82f7-8379f4619962 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:48:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:48:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:48:39 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:48:39 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:48:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:48:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:48:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:47 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:48:50 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Creating image(s)
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Did not create local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Ensure instance console log exists: /opt/stack/data/nova/instances/7e12539b-36a3-4691-89fd-e3d155de38d7/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Start _get_guest_xml network_info=[{"id": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "address": "fa:16:3e:3e:8c:6a", "network": {"id": "ba3f17d0-18fb-4a96-a48a-ea93768ee358", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1139879701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21784a1d205749fd9a4459fe6605a481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7419-ed", "ovs_interfaceid": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpOStwFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7e12539b-36a3-4691-89fd-e3d155de38d7', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3426aa0-910f-4c33-80c6-b74e104bbb09', 'serial': 'b3426aa0-910f-4c33-80c6-b74e104bbb09'}, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': '94a7baf1-c33c-47d9-9e20-032125a85373', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:48:50 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 09 03:48:50 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.objects.instance [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7e12539b-36a3-4691-89fd-e3d155de38d7 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpOStwFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:48:50 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 03:48:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:48:50 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 03:48:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:48:50 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[079ec9b1-18c7-4dcf-a6f0-50eef4dfc725]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:48:50 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[de61b8fe-6f90-4ece-8d57-19a66c5ef864]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09] added
Nov 09 03:48:50 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e189b03-03c0-4c4c-8a2a-fecea22a8ed9]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d73f3ae-bbe0-4b27-9d6c-39e3bf237235]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BpOStwFd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BpOStwFd" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[737f928f-986d-4134-a3dc-d4391857834b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BpOStwFd'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb5df4e-7534-4afc-a21e-183abfbbedf8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d31621-8008-48d2-b78e-b7f92529788f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:48:50 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:48:50 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:48:50 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:48:50 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:48:50 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:48:50 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:48:50 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:48:50 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:48:50 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:48:50 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:48:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de9f855-4144-4ea5-8354-4c5a38d30d95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09, portal: 172.16.0.220,3260]
Nov 09 03:48:51 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09, portal: 172.16.0.220,3260] successful.
Nov 09 03:48:51 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cad235-a6bb-4699-9271-8a38a11c24ff]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b925da78-a343-4bad-b10f-2fc8e83ca798]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:48:51 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:48:51 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:48:51 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:48:51 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:48:51 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:48:51 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:48:51 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:48:51 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:48:51 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:48:51 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:48:51 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:48:51 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] HCTL ('38', '-', '-', 0) found on session 22 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[254f64c7-439e-45aa-8831-90ea1564b13e]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Searching for a device in session 22 and hctl ['38', '*', '*', 0] yield: None {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Searching for a device in session 22 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpOStwFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26430646635353133', 'path': '/dev/sdg'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430646635353133', 'path': '/dev/sdg'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T03:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1744791017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-630224360',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOf5txPg6ouZaGGPli9fXk7MU4joWJGx02BisK3zQA1UKJLHy2CmfWE/XCnKG3U7ArzcfKvhfDz+mZTrfgm201boyTYwnA7PPwqn4OBn8OrHRJiyu0bpUTMNWI1J7qAdA==',key_name='tempest-keypair-1307438617',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:46:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='21784a1d205749fd9a4459fe6605a481',ramdisk_id='',reservation_id='r-6evkz0hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1531549411',owner_user_name='tempest-ServerActionsV293TestJSON-1531549411-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:48:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9e8d4eb00ea4ae5878183644245516f',uuid=7e12539b-36a3-4691-89fd-e3d155de38d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "address": "fa:16:3e:3e:8c:6a", "network": {"id": "ba3f17d0-18fb-4a96-a48a-ea93768ee358", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1139879701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21784a1d205749fd9a4459fe6605a481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7419-ed", "ovs_interfaceid": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Converting VIF {"id": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "address": "fa:16:3e:3e:8c:6a", "network": {"id": "ba3f17d0-18fb-4a96-a48a-ea93768ee358", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1139879701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21784a1d205749fd9a4459fe6605a481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7419-ed", "ovs_interfaceid": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:8c:6a,bridge_name='br-int',has_traffic_filtering=True,id=d0ea7419-ed5d-43af-86c6-57db8d9382e0,network=Network(ba3f17d0-18fb-4a96-a48a-ea93768ee358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea7419-ed') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:48:52 user nova-compute[75378]:   <uuid>7e12539b-36a3-4691-89fd-e3d155de38d7</uuid>
Nov 09 03:48:52 user nova-compute[75378]:   <name>instance-00000015</name>
Nov 09 03:48:52 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:48:52 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:48:52 user nova-compute[75378]:   <metadata>
Nov 09 03:48:52 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:48:52 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:48:52 user nova-compute[75378]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1744791017</nova:name>
Nov 09 03:48:52 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:48:50</nova:creationTime>
Nov 09 03:48:52 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:48:52 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:48:52 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:48:52 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:48:52 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:48:52 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:48:52 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:48:52 user nova-compute[75378]:       <nova:owner>
Nov 09 03:48:52 user nova-compute[75378]:         <nova:user uuid="d9e8d4eb00ea4ae5878183644245516f">tempest-ServerActionsV293TestJSON-1531549411-project-member</nova:user>
Nov 09 03:48:52 user nova-compute[75378]:         <nova:project uuid="21784a1d205749fd9a4459fe6605a481">tempest-ServerActionsV293TestJSON-1531549411</nova:project>
Nov 09 03:48:52 user nova-compute[75378]:       </nova:owner>
Nov 09 03:48:52 user nova-compute[75378]:       <nova:ports>
Nov 09 03:48:52 user nova-compute[75378]:         <nova:port uuid="d0ea7419-ed5d-43af-86c6-57db8d9382e0">
Nov 09 03:48:52 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 09 03:48:52 user nova-compute[75378]:         </nova:port>
Nov 09 03:48:52 user nova-compute[75378]:       </nova:ports>
Nov 09 03:48:52 user nova-compute[75378]:     </nova:instance>
Nov 09 03:48:52 user nova-compute[75378]:   </metadata>
Nov 09 03:48:52 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:48:52 user nova-compute[75378]:     <system>
Nov 09 03:48:52 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:48:52 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:48:52 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:48:52 user nova-compute[75378]:       <entry name="serial">7e12539b-36a3-4691-89fd-e3d155de38d7</entry>
Nov 09 03:48:52 user nova-compute[75378]:       <entry name="uuid">7e12539b-36a3-4691-89fd-e3d155de38d7</entry>
Nov 09 03:48:52 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:48:52 user nova-compute[75378]:     </system>
Nov 09 03:48:52 user nova-compute[75378]:   </sysinfo>
Nov 09 03:48:52 user nova-compute[75378]:   <os>
Nov 09 03:48:52 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:48:52 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:48:52 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:48:52 user nova-compute[75378]:   </os>
Nov 09 03:48:52 user nova-compute[75378]:   <features>
Nov 09 03:48:52 user nova-compute[75378]:     <acpi/>
Nov 09 03:48:52 user nova-compute[75378]:     <apic/>
Nov 09 03:48:52 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:48:52 user nova-compute[75378]:   </features>
Nov 09 03:48:52 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:48:52 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:48:52 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:48:52 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:48:52 user nova-compute[75378]:   </clock>
Nov 09 03:48:52 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:48:52 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:48:52 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:48:52 user nova-compute[75378]:   </cpu>
Nov 09 03:48:52 user nova-compute[75378]:   <devices>
Nov 09 03:48:52 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 03:48:52 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:48:52 user nova-compute[75378]:       <source dev="/dev/sdg"/>
Nov 09 03:48:52 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:48:52 user nova-compute[75378]:       <serial>b3426aa0-910f-4c33-80c6-b74e104bbb09</serial>
Nov 09 03:48:52 user nova-compute[75378]:     </disk>
Nov 09 03:48:52 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:48:52 user nova-compute[75378]:       <mac address="fa:16:3e:3e:8c:6a"/>
Nov 09 03:48:52 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:48:52 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:48:52 user nova-compute[75378]:       <target dev="tapd0ea7419-ed"/>
Nov 09 03:48:52 user nova-compute[75378]:     </interface>
Nov 09 03:48:52 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:48:52 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/7e12539b-36a3-4691-89fd-e3d155de38d7/console.log" append="off"/>
Nov 09 03:48:52 user nova-compute[75378]:     </serial>
Nov 09 03:48:52 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:48:52 user nova-compute[75378]:     <video>
Nov 09 03:48:52 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:48:52 user nova-compute[75378]:     </video>
Nov 09 03:48:52 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:48:52 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:48:52 user nova-compute[75378]:     </rng>
Nov 09 03:48:52 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:48:52 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:48:52 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:48:52 user nova-compute[75378]:     </memballoon>
Nov 09 03:48:52 user nova-compute[75378]:   </devices>
Nov 09 03:48:52 user nova-compute[75378]: </domain>
Nov 09 03:48:52 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T03:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1744791017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-630224360',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOf5txPg6ouZaGGPli9fXk7MU4joWJGx02BisK3zQA1UKJLHy2CmfWE/XCnKG3U7ArzcfKvhfDz+mZTrfgm201boyTYwnA7PPwqn4OBn8OrHRJiyu0bpUTMNWI1J7qAdA==',key_name='tempest-keypair-1307438617',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:46:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='21784a1d205749fd9a4459fe6605a481',ramdisk_id='',reservation_id='r-6evkz0hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1531549411',owner_user_name='tempest-ServerActionsV293TestJSON-1531549411-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:48:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9e8d4eb00ea4ae5878183644245516f',uuid=7e12539b-36a3-4691-89fd-e3d155de38d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "address": "fa:16:3e:3e:8c:6a", "network": {"id": "ba3f17d0-18fb-4a96-a48a-ea93768ee358", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1139879701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21784a1d205749fd9a4459fe6605a481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7419-ed", "ovs_interfaceid": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Converting VIF {"id": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "address": "fa:16:3e:3e:8c:6a", "network": {"id": "ba3f17d0-18fb-4a96-a48a-ea93768ee358", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1139879701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21784a1d205749fd9a4459fe6605a481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7419-ed", "ovs_interfaceid": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:8c:6a,bridge_name='br-int',has_traffic_filtering=True,id=d0ea7419-ed5d-43af-86c6-57db8d9382e0,network=Network(ba3f17d0-18fb-4a96-a48a-ea93768ee358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea7419-ed') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG os_vif [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:8c:6a,bridge_name='br-int',has_traffic_filtering=True,id=d0ea7419-ed5d-43af-86c6-57db8d9382e0,network=Network(ba3f17d0-18fb-4a96-a48a-ea93768ee358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea7419-ed') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5cb004b1-632b-5792-b533-83b63688ae7f', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0ea7419-ed, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0ea7419-ed, col_values=(('qos', UUID('66199568-908b-48be-a564-c6171bcd982f')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0ea7419-ed, col_values=(('external_ids', {'iface-id': 'd0ea7419-ed5d-43af-86c6-57db8d9382e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:8c:6a', 'vm-uuid': '7e12539b-36a3-4691-89fd-e3d155de38d7'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:52 user nova-compute[75378]: INFO os_vif [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:8c:6a,bridge_name='br-int',has_traffic_filtering=True,id=d0ea7419-ed5d-43af-86c6-57db8d9382e0,network=Network(ba3f17d0-18fb-4a96-a48a-ea93768ee358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea7419-ed')
Nov 09 03:48:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:48:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] No VIF found with MAC fa:16:3e:3e:8c:6a, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:48:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-cc909427-528f-4f26-8510-89ea0e872bb3 req-5ca39152-ca82-4420-a180-0f17df0b706c service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Received event network-vif-plugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:48:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cc909427-528f-4f26-8510-89ea0e872bb3 req-5ca39152-ca82-4420-a180-0f17df0b706c service nova] Acquiring lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:48:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cc909427-528f-4f26-8510-89ea0e872bb3 req-5ca39152-ca82-4420-a180-0f17df0b706c service nova] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:48:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cc909427-528f-4f26-8510-89ea0e872bb3 req-5ca39152-ca82-4420-a180-0f17df0b706c service nova] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:48:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-cc909427-528f-4f26-8510-89ea0e872bb3 req-5ca39152-ca82-4420-a180-0f17df0b706c service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] No waiting events found dispatching network-vif-plugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:48:53 user nova-compute[75378]: WARNING nova.compute.manager [req-cc909427-528f-4f26-8510-89ea0e872bb3 req-5ca39152-ca82-4420-a180-0f17df0b706c service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Received unexpected event network-vif-plugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 for instance with vm_state active and task_state rebuild_spawning.
Nov 09 03:48:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:55 user nova-compute[75378]: DEBUG nova.compute.manager [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:48:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:48:55 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Instance spawned successfully.
Nov 09 03:48:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:48:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:48:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:48:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:48:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:48:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:48:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:48:55 user nova-compute[75378]: DEBUG nova.compute.manager [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:48:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-b4eb764e-bc59-417b-8fcd-67ce19cfc821 req-0467d89e-5059-44b3-b883-a253d38c5348 service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Received event network-vif-plugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:48:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b4eb764e-bc59-417b-8fcd-67ce19cfc821 req-0467d89e-5059-44b3-b883-a253d38c5348 service nova] Acquiring lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:48:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b4eb764e-bc59-417b-8fcd-67ce19cfc821 req-0467d89e-5059-44b3-b883-a253d38c5348 service nova] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:48:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b4eb764e-bc59-417b-8fcd-67ce19cfc821 req-0467d89e-5059-44b3-b883-a253d38c5348 service nova] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:48:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-b4eb764e-bc59-417b-8fcd-67ce19cfc821 req-0467d89e-5059-44b3-b883-a253d38c5348 service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] No waiting events found dispatching network-vif-plugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:48:55 user nova-compute[75378]: WARNING nova.compute.manager [req-b4eb764e-bc59-417b-8fcd-67ce19cfc821 req-0467d89e-5059-44b3-b883-a253d38c5348 service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Received unexpected event network-vif-plugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 for instance with vm_state active and task_state rebuild_spawning.
Nov 09 03:48:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:48:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:48:55 user nova-compute[75378]: DEBUG nova.objects.instance [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75378) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 09 03:48:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-458d44ca-3aa8-4cc1-a9b7-5ab459b06cea tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.075s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:48:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:48:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:01 user nova-compute[75378]: DEBUG nova.compute.manager [req-b858f372-be5c-49aa-a71f-7082dad796a8 req-79148906-a799-4284-a178-8954b8a7c7b1 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received event network-changed-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:01 user nova-compute[75378]: DEBUG nova.compute.manager [req-b858f372-be5c-49aa-a71f-7082dad796a8 req-79148906-a799-4284-a178-8954b8a7c7b1 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Refreshing instance network info cache due to event network-changed-f3d1103d-bcfc-4db6-b227-e1448c56f689. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:49:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b858f372-be5c-49aa-a71f-7082dad796a8 req-79148906-a799-4284-a178-8954b8a7c7b1 service nova] Acquiring lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:49:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b858f372-be5c-49aa-a71f-7082dad796a8 req-79148906-a799-4284-a178-8954b8a7c7b1 service nova] Acquired lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:49:01 user nova-compute[75378]: DEBUG nova.network.neutron [req-b858f372-be5c-49aa-a71f-7082dad796a8 req-79148906-a799-4284-a178-8954b8a7c7b1 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Refreshing network info cache for port f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:49:01 user nova-compute[75378]: DEBUG nova.network.neutron [req-b858f372-be5c-49aa-a71f-7082dad796a8 req-79148906-a799-4284-a178-8954b8a7c7b1 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Updated VIF entry in instance network info cache for port f3d1103d-bcfc-4db6-b227-e1448c56f689. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:49:01 user nova-compute[75378]: DEBUG nova.network.neutron [req-b858f372-be5c-49aa-a71f-7082dad796a8 req-79148906-a799-4284-a178-8954b8a7c7b1 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Updating instance_info_cache with network_info: [{"id": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "address": "fa:16:3e:76:38:86", "network": {"id": "99b3e8be-7102-4b9a-aeae-3151b634d431", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6633f406337a45599d107946b7d4dfdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d1103d-bc", "ovs_interfaceid": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:49:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b858f372-be5c-49aa-a71f-7082dad796a8 req-79148906-a799-4284-a178-8954b8a7c7b1 service nova] Releasing lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:49:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:02 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffb9b85c-69b5-484a-a65e-1afd4bb13f6b tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:49:02 user nova-compute[75378]: INFO nova.compute.manager [None req-ffb9b85c-69b5-484a-a65e-1afd4bb13f6b tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] instance snapshotting
Nov 09 03:49:02 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-ffb9b85c-69b5-484a-a65e-1afd4bb13f6b tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Beginning live snapshot process
Nov 09 03:49:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffb9b85c-69b5-484a-a65e-1afd4bb13f6b tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json -f qcow2 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffb9b85c-69b5-484a-a65e-1afd4bb13f6b tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffb9b85c-69b5-484a-a65e-1afd4bb13f6b tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json -f qcow2 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffb9b85c-69b5-484a-a65e-1afd4bb13f6b tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffb9b85c-69b5-484a-a65e-1afd4bb13f6b tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffb9b85c-69b5-484a-a65e-1afd4bb13f6b tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffb9b85c-69b5-484a-a65e-1afd4bb13f6b tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpaojab0qa/b1ad788b629e41af80abe36456512d0b.delta 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffb9b85c-69b5-484a-a65e-1afd4bb13f6b tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpaojab0qa/b1ad788b629e41af80abe36456512d0b.delta 1073741824" returned: 0 in 0.055s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:03 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-ffb9b85c-69b5-484a-a65e-1afd4bb13f6b tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 09 03:49:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-ffb9b85c-69b5-484a-a65e-1afd4bb13f6b tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75378) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 03:49:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-29ea045f-133b-4ebd-9154-c2579c490bec req-bf2b752f-e334-47c3-8683-ca95293bb6dd service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-changed-37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-29ea045f-133b-4ebd-9154-c2579c490bec req-bf2b752f-e334-47c3-8683-ca95293bb6dd service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Refreshing instance network info cache due to event network-changed-37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:49:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-29ea045f-133b-4ebd-9154-c2579c490bec req-bf2b752f-e334-47c3-8683-ca95293bb6dd service nova] Acquiring lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:49:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-29ea045f-133b-4ebd-9154-c2579c490bec req-bf2b752f-e334-47c3-8683-ca95293bb6dd service nova] Acquired lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:49:04 user nova-compute[75378]: DEBUG nova.network.neutron [req-29ea045f-133b-4ebd-9154-c2579c490bec req-bf2b752f-e334-47c3-8683-ca95293bb6dd service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Refreshing network info cache for port 37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:49:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-ffb9b85c-69b5-484a-a65e-1afd4bb13f6b tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75378) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 03:49:04 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-ffb9b85c-69b5-484a-a65e-1afd4bb13f6b tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 09 03:49:04 user nova-compute[75378]: DEBUG nova.privsep.utils [None req-ffb9b85c-69b5-484a-a65e-1afd4bb13f6b tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75378) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 03:49:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffb9b85c-69b5-484a-a65e-1afd4bb13f6b tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpaojab0qa/b1ad788b629e41af80abe36456512d0b.delta /opt/stack/data/nova/instances/snapshots/tmpaojab0qa/b1ad788b629e41af80abe36456512d0b {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffb9b85c-69b5-484a-a65e-1afd4bb13f6b tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpaojab0qa/b1ad788b629e41af80abe36456512d0b.delta /opt/stack/data/nova/instances/snapshots/tmpaojab0qa/b1ad788b629e41af80abe36456512d0b" returned: 0 in 0.373s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:05 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-ffb9b85c-69b5-484a-a65e-1afd4bb13f6b tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Snapshot extracted, beginning image upload
Nov 09 03:49:05 user nova-compute[75378]: DEBUG nova.network.neutron [req-29ea045f-133b-4ebd-9154-c2579c490bec req-bf2b752f-e334-47c3-8683-ca95293bb6dd service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Updated VIF entry in instance network info cache for port 37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:49:05 user nova-compute[75378]: DEBUG nova.network.neutron [req-29ea045f-133b-4ebd-9154-c2579c490bec req-bf2b752f-e334-47c3-8683-ca95293bb6dd service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Updating instance_info_cache with network_info: [{"id": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "address": "fa:16:3e:bc:91:1f", "network": {"id": "1c13e251-154e-4521-9b3c-443bb29cc577", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071356817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ed92ed-0e", "ovs_interfaceid": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "address": "fa:16:3e:0d:b1:a6", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95465b85-15", "ovs_interfaceid": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "address": "fa:16:3e:b7:e8:0e", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd2d935-db", "ovs_interfaceid": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "address": "fa:16:3e:35:0f:09", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ba1a1-d2", "ovs_interfaceid": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2bab297-674f-41e7-baac-73eb91483899", "address": "fa:16:3e:b4:02:cf", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bab297-67", "ovs_interfaceid": "e2bab297-674f-41e7-baac-73eb91483899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2195503e-d6da-4598-9478-2956f48d2b8e", "address": "fa:16:3e:9c:68:a7", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2195503e-d6", "ovs_interfaceid": "2195503e-d6da-4598-9478-2956f48d2b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "address": "fa:16:3e:1f:60:09", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe16ed0-6d", "ovs_interfaceid": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:49:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-29ea045f-133b-4ebd-9154-c2579c490bec req-bf2b752f-e334-47c3-8683-ca95293bb6dd service nova] Releasing lock "refresh_cache-c4ef6623-863b-40a8-b9ec-720c25ee3484" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:49:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:07 user nova-compute[75378]: INFO nova.compute.manager [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Terminating instance
Nov 09 03:49:07 user nova-compute[75378]: DEBUG nova.compute.manager [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-3e8e619c-b56b-4159-81a4-69d2c11afc58 req-aed03b7e-1ce4-4de1-a82b-62115f250f11 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-unplugged-37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3e8e619c-b56b-4159-81a4-69d2c11afc58 req-aed03b7e-1ce4-4de1-a82b-62115f250f11 service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3e8e619c-b56b-4159-81a4-69d2c11afc58 req-aed03b7e-1ce4-4de1-a82b-62115f250f11 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3e8e619c-b56b-4159-81a4-69d2c11afc58 req-aed03b7e-1ce4-4de1-a82b-62115f250f11 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-3e8e619c-b56b-4159-81a4-69d2c11afc58 req-aed03b7e-1ce4-4de1-a82b-62115f250f11 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-unplugged-37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-3e8e619c-b56b-4159-81a4-69d2c11afc58 req-aed03b7e-1ce4-4de1-a82b-62115f250f11 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-unplugged-37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:08 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-ffb9b85c-69b5-484a-a65e-1afd4bb13f6b tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Snapshot image upload complete
Nov 09 03:49:08 user nova-compute[75378]: INFO nova.compute.manager [None req-ffb9b85c-69b5-484a-a65e-1afd4bb13f6b tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Took 5.57 seconds to snapshot the instance on the hypervisor.
Nov 09 03:49:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG nova.compute.manager [req-32cc5b5c-5fda-47bc-a0ba-15e5ba592f7f req-73b47ac7-71f6-4c42-bacf-2ec6e876b06b service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-unplugged-427ba1a1-d2a8-431b-aeea-d455e8908e7a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-32cc5b5c-5fda-47bc-a0ba-15e5ba592f7f req-73b47ac7-71f6-4c42-bacf-2ec6e876b06b service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-32cc5b5c-5fda-47bc-a0ba-15e5ba592f7f req-73b47ac7-71f6-4c42-bacf-2ec6e876b06b service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-32cc5b5c-5fda-47bc-a0ba-15e5ba592f7f req-73b47ac7-71f6-4c42-bacf-2ec6e876b06b service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG nova.compute.manager [req-32cc5b5c-5fda-47bc-a0ba-15e5ba592f7f req-73b47ac7-71f6-4c42-bacf-2ec6e876b06b service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-unplugged-427ba1a1-d2a8-431b-aeea-d455e8908e7a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG nova.compute.manager [req-32cc5b5c-5fda-47bc-a0ba-15e5ba592f7f req-73b47ac7-71f6-4c42-bacf-2ec6e876b06b service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-unplugged-427ba1a1-d2a8-431b-aeea-d455e8908e7a for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG nova.compute.manager [req-3eaa6aea-6e32-40e2-9b72-ced8be921ed4 req-8fce7fe9-8638-4125-ae6d-ebb11a2b0787 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-unplugged-e2bab297-674f-41e7-baac-73eb91483899 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3eaa6aea-6e32-40e2-9b72-ced8be921ed4 req-8fce7fe9-8638-4125-ae6d-ebb11a2b0787 service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3eaa6aea-6e32-40e2-9b72-ced8be921ed4 req-8fce7fe9-8638-4125-ae6d-ebb11a2b0787 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3eaa6aea-6e32-40e2-9b72-ced8be921ed4 req-8fce7fe9-8638-4125-ae6d-ebb11a2b0787 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG nova.compute.manager [req-3eaa6aea-6e32-40e2-9b72-ced8be921ed4 req-8fce7fe9-8638-4125-ae6d-ebb11a2b0787 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-unplugged-e2bab297-674f-41e7-baac-73eb91483899 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG nova.compute.manager [req-3eaa6aea-6e32-40e2-9b72-ced8be921ed4 req-8fce7fe9-8638-4125-ae6d-ebb11a2b0787 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-unplugged-e2bab297-674f-41e7-baac-73eb91483899 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Instance destroyed successfully.
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.objects.instance [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lazy-loading 'resources' on Instance uuid c4ef6623-863b-40a8-b9ec-720c25ee3484 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237131222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237131222',id=19,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH/xMJVpGaoZZKT5yOQG9YEsZHK0qinmMJc/4GspFhdUxnsc9HXa+tGmNHJBRf9ENKRejYCxxtWI6LtFW1RAoW6wOuC43TGFdsh0nVlz83OuXmFj2lwOBO1pGyFNwxCfA==',key_name='tempest-keypair-1130216547',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:47:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9b7a5a29e104b60ae779f864d5c202f',ramdisk_id='',reservation_id='r-xxkikjoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1739662256',owner_user_name='tempest-TaggedBootDevicesTest_v242-1739662256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:47:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd895f640a78436cb439a4d0e82fe36f',uuid=c4ef6623-863b-40a8-b9ec-720c25ee3484,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "address": "fa:16:3e:bc:91:1f", "network": {"id": "1c13e251-154e-4521-9b3c-443bb29cc577", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071356817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ed92ed-0e", "ovs_interfaceid": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converting VIF {"id": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "address": "fa:16:3e:bc:91:1f", "network": {"id": "1c13e251-154e-4521-9b3c-443bb29cc577", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071356817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ed92ed-0e", "ovs_interfaceid": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:91:1f,bridge_name='br-int',has_traffic_filtering=True,id=37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d,network=Network(1c13e251-154e-4521-9b3c-443bb29cc577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ed92ed-0e') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG os_vif [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:91:1f,bridge_name='br-int',has_traffic_filtering=True,id=37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d,network=Network(1c13e251-154e-4521-9b3c-443bb29cc577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ed92ed-0e') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37ed92ed-0e, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ae27179-ad46-49aa-ad3f-55f4c354ef0a) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: INFO os_vif [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:91:1f,bridge_name='br-int',has_traffic_filtering=True,id=37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d,network=Network(1c13e251-154e-4521-9b3c-443bb29cc577),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37ed92ed-0e')
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237131222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237131222',id=19,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH/xMJVpGaoZZKT5yOQG9YEsZHK0qinmMJc/4GspFhdUxnsc9HXa+tGmNHJBRf9ENKRejYCxxtWI6LtFW1RAoW6wOuC43TGFdsh0nVlz83OuXmFj2lwOBO1pGyFNwxCfA==',key_name='tempest-keypair-1130216547',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:47:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9b7a5a29e104b60ae779f864d5c202f',ramdisk_id='',reservation_id='r-xxkikjoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1739662256',owner_user_name='tempest-TaggedBootDevicesTest_v242-1739662256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:47:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd895f640a78436cb439a4d0e82fe36f',uuid=c4ef6623-863b-40a8-b9ec-720c25ee3484,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "address": "fa:16:3e:0d:b1:a6", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95465b85-15", "ovs_interfaceid": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converting VIF {"id": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "address": "fa:16:3e:0d:b1:a6", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95465b85-15", "ovs_interfaceid": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b1:a6,bridge_name='br-int',has_traffic_filtering=True,id=95465b85-15fb-4cf7-9db9-23c5e4a755c8,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap95465b85-15') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG os_vif [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b1:a6,bridge_name='br-int',has_traffic_filtering=True,id=95465b85-15fb-4cf7-9db9-23c5e4a755c8,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap95465b85-15') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95465b85-15, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0f8186a-7fa4-46bf-b3c9-b6f020e552df) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: INFO os_vif [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b1:a6,bridge_name='br-int',has_traffic_filtering=True,id=95465b85-15fb-4cf7-9db9-23c5e4a755c8,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap95465b85-15')
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237131222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237131222',id=19,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH/xMJVpGaoZZKT5yOQG9YEsZHK0qinmMJc/4GspFhdUxnsc9HXa+tGmNHJBRf9ENKRejYCxxtWI6LtFW1RAoW6wOuC43TGFdsh0nVlz83OuXmFj2lwOBO1pGyFNwxCfA==',key_name='tempest-keypair-1130216547',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:47:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9b7a5a29e104b60ae779f864d5c202f',ramdisk_id='',reservation_id='r-xxkikjoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1739662256',owner_user_name='tempest-TaggedBootDevicesTest_v242-1739662256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:47:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd895f640a78436cb439a4d0e82fe36f',uuid=c4ef6623-863b-40a8-b9ec-720c25ee3484,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "address": "fa:16:3e:b7:e8:0e", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd2d935-db", "ovs_interfaceid": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converting VIF {"id": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "address": "fa:16:3e:b7:e8:0e", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd2d935-db", "ovs_interfaceid": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e8:0e,bridge_name='br-int',has_traffic_filtering=True,id=4dd2d935-dbaf-445e-aa45-30114c1df2a8,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4dd2d935-db') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG os_vif [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e8:0e,bridge_name='br-int',has_traffic_filtering=True,id=4dd2d935-dbaf-445e-aa45-30114c1df2a8,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4dd2d935-db') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4dd2d935-db, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c23b5e0-f05a-4822-9040-b21153cc739d) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: INFO os_vif [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e8:0e,bridge_name='br-int',has_traffic_filtering=True,id=4dd2d935-dbaf-445e-aa45-30114c1df2a8,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4dd2d935-db')
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237131222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237131222',id=19,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH/xMJVpGaoZZKT5yOQG9YEsZHK0qinmMJc/4GspFhdUxnsc9HXa+tGmNHJBRf9ENKRejYCxxtWI6LtFW1RAoW6wOuC43TGFdsh0nVlz83OuXmFj2lwOBO1pGyFNwxCfA==',key_name='tempest-keypair-1130216547',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:47:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9b7a5a29e104b60ae779f864d5c202f',ramdisk_id='',reservation_id='r-xxkikjoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1739662256',owner_user_name='tempest-TaggedBootDevicesTest_v242-1739662256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:47:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd895f640a78436cb439a4d0e82fe36f',uuid=c4ef6623-863b-40a8-b9ec-720c25ee3484,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "address": "fa:16:3e:35:0f:09", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ba1a1-d2", "ovs_interfaceid": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converting VIF {"id": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "address": "fa:16:3e:35:0f:09", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ba1a1-d2", "ovs_interfaceid": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=427ba1a1-d2a8-431b-aeea-d455e8908e7a,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427ba1a1-d2') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG os_vif [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=427ba1a1-d2a8-431b-aeea-d455e8908e7a,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427ba1a1-d2') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap427ba1a1-d2, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be2e1fd0-726f-4f0b-987b-85cfbfdb4f3b) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: INFO os_vif [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=427ba1a1-d2a8-431b-aeea-d455e8908e7a,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427ba1a1-d2')
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237131222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237131222',id=19,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH/xMJVpGaoZZKT5yOQG9YEsZHK0qinmMJc/4GspFhdUxnsc9HXa+tGmNHJBRf9ENKRejYCxxtWI6LtFW1RAoW6wOuC43TGFdsh0nVlz83OuXmFj2lwOBO1pGyFNwxCfA==',key_name='tempest-keypair-1130216547',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:47:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9b7a5a29e104b60ae779f864d5c202f',ramdisk_id='',reservation_id='r-xxkikjoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1739662256',owner_user_name='tempest-TaggedBootDevicesTest_v242-1739662256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:47:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd895f640a78436cb439a4d0e82fe36f',uuid=c4ef6623-863b-40a8-b9ec-720c25ee3484,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2bab297-674f-41e7-baac-73eb91483899", "address": "fa:16:3e:b4:02:cf", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bab297-67", "ovs_interfaceid": "e2bab297-674f-41e7-baac-73eb91483899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converting VIF {"id": "e2bab297-674f-41e7-baac-73eb91483899", "address": "fa:16:3e:b4:02:cf", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2bab297-67", "ovs_interfaceid": "e2bab297-674f-41e7-baac-73eb91483899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:02:cf,bridge_name='br-int',has_traffic_filtering=True,id=e2bab297-674f-41e7-baac-73eb91483899,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2bab297-67') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG os_vif [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:02:cf,bridge_name='br-int',has_traffic_filtering=True,id=e2bab297-674f-41e7-baac-73eb91483899,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2bab297-67') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2bab297-67, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-plugged-37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-plugged-37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:09 user nova-compute[75378]: WARNING nova.compute.manager [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received unexpected event network-vif-plugged-37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d for instance with vm_state active and task_state deleting.
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-unplugged-95465b85-15fb-4cf7-9db9-23c5e4a755c8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-unplugged-95465b85-15fb-4cf7-9db9-23c5e4a755c8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-unplugged-95465b85-15fb-4cf7-9db9-23c5e4a755c8 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-plugged-95465b85-15fb-4cf7-9db9-23c5e4a755c8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-plugged-95465b85-15fb-4cf7-9db9-23c5e4a755c8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:09 user nova-compute[75378]: WARNING nova.compute.manager [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received unexpected event network-vif-plugged-95465b85-15fb-4cf7-9db9-23c5e4a755c8 for instance with vm_state active and task_state deleting.
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-unplugged-4dd2d935-dbaf-445e-aa45-30114c1df2a8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-unplugged-4dd2d935-dbaf-445e-aa45-30114c1df2a8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-unplugged-4dd2d935-dbaf-445e-aa45-30114c1df2a8 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-plugged-4dd2d935-dbaf-445e-aa45-30114c1df2a8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-plugged-4dd2d935-dbaf-445e-aa45-30114c1df2a8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:09 user nova-compute[75378]: WARNING nova.compute.manager [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received unexpected event network-vif-plugged-4dd2d935-dbaf-445e-aa45-30114c1df2a8 for instance with vm_state active and task_state deleting.
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-unplugged-abe16ed0-6d62-41c1-8bfd-da97d9908143 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-unplugged-abe16ed0-6d62-41c1-8bfd-da97d9908143 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-unplugged-abe16ed0-6d62-41c1-8bfd-da97d9908143 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-plugged-abe16ed0-6d62-41c1-8bfd-da97d9908143 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-plugged-abe16ed0-6d62-41c1-8bfd-da97d9908143 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:09 user nova-compute[75378]: WARNING nova.compute.manager [req-d71341a0-5d48-486c-a01b-0f2cbaca005e req-7202cf56-34b6-4e68-8ac8-66d5bdc09309 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received unexpected event network-vif-plugged-abe16ed0-6d62-41c1-8bfd-da97d9908143 for instance with vm_state active and task_state deleting.
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59889eb2-c093-4b7b-922b-d0017124285f) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: INFO os_vif [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:02:cf,bridge_name='br-int',has_traffic_filtering=True,id=e2bab297-674f-41e7-baac-73eb91483899,network=Network(330bad01-9253-4e8e-a0bf-896d3735d79a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2bab297-67')
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237131222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237131222',id=19,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH/xMJVpGaoZZKT5yOQG9YEsZHK0qinmMJc/4GspFhdUxnsc9HXa+tGmNHJBRf9ENKRejYCxxtWI6LtFW1RAoW6wOuC43TGFdsh0nVlz83OuXmFj2lwOBO1pGyFNwxCfA==',key_name='tempest-keypair-1130216547',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:47:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9b7a5a29e104b60ae779f864d5c202f',ramdisk_id='',reservation_id='r-xxkikjoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1739662256',owner_user_name='tempest-TaggedBootDevicesTest_v242-1739662256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:47:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd895f640a78436cb439a4d0e82fe36f',uuid=c4ef6623-863b-40a8-b9ec-720c25ee3484,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2195503e-d6da-4598-9478-2956f48d2b8e", "address": "fa:16:3e:9c:68:a7", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2195503e-d6", "ovs_interfaceid": "2195503e-d6da-4598-9478-2956f48d2b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converting VIF {"id": "2195503e-d6da-4598-9478-2956f48d2b8e", "address": "fa:16:3e:9c:68:a7", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2195503e-d6", "ovs_interfaceid": "2195503e-d6da-4598-9478-2956f48d2b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:68:a7,bridge_name='br-int',has_traffic_filtering=True,id=2195503e-d6da-4598-9478-2956f48d2b8e,network=Network(36b4d72f-7b08-4926-b623-bcc9260201a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2195503e-d6') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG os_vif [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:68:a7,bridge_name='br-int',has_traffic_filtering=True,id=2195503e-d6da-4598-9478-2956f48d2b8e,network=Network(36b4d72f-7b08-4926-b623-bcc9260201a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2195503e-d6') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2195503e-d6, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=362d7277-fa48-440d-a8b9-b146223f6c26) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: INFO os_vif [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:68:a7,bridge_name='br-int',has_traffic_filtering=True,id=2195503e-d6da-4598-9478-2956f48d2b8e,network=Network(36b4d72f-7b08-4926-b623-bcc9260201a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2195503e-d6')
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T03:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1237131222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1237131222',id=19,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH/xMJVpGaoZZKT5yOQG9YEsZHK0qinmMJc/4GspFhdUxnsc9HXa+tGmNHJBRf9ENKRejYCxxtWI6LtFW1RAoW6wOuC43TGFdsh0nVlz83OuXmFj2lwOBO1pGyFNwxCfA==',key_name='tempest-keypair-1130216547',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:47:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9b7a5a29e104b60ae779f864d5c202f',ramdisk_id='',reservation_id='r-xxkikjoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1739662256',owner_user_name='tempest-TaggedBootDevicesTest_v242-1739662256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:47:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd895f640a78436cb439a4d0e82fe36f',uuid=c4ef6623-863b-40a8-b9ec-720c25ee3484,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "address": "fa:16:3e:1f:60:09", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe16ed0-6d", "ovs_interfaceid": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converting VIF {"id": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "address": "fa:16:3e:1f:60:09", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe16ed0-6d", "ovs_interfaceid": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:60:09,bridge_name='br-int',has_traffic_filtering=True,id=abe16ed0-6d62-41c1-8bfd-da97d9908143,network=Network(36b4d72f-7b08-4926-b623-bcc9260201a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe16ed0-6d') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG os_vif [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:60:09,bridge_name='br-int',has_traffic_filtering=True,id=abe16ed0-6d62-41c1-8bfd-da97d9908143,network=Network(36b4d72f-7b08-4926-b623-bcc9260201a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe16ed0-6d') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabe16ed0-6d, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af05a216-c7bb-4b28-88ae-b3f93fb517b5) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:09 user nova-compute[75378]: INFO os_vif [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:60:09,bridge_name='br-int',has_traffic_filtering=True,id=abe16ed0-6d62-41c1-8bfd-da97d9908143,network=Network(36b4d72f-7b08-4926-b623-bcc9260201a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe16ed0-6d')
Nov 09 03:49:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoAjFXsO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:49:09 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:49:09 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:49:09 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[226249f7-2a15-45cb-835b-6b09d8984853]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:49:10 user nova-compute[75378]: No targets found.
Nov 09 03:49:10 user nova-compute[75378]: iSNS:
Nov 09 03:49:10 user nova-compute[75378]: No targets found.
Nov 09 03:49:10 user nova-compute[75378]: STATIC:
Nov 09 03:49:10 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f
Nov 09 03:49:10 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:49:10 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:49:10 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a
Nov 09 03:49:10 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:49:10 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:49:10 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 03:49:10 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:49:10 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:49:10 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d
Nov 09 03:49:10 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:49:10 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:49:10 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09
Nov 09 03:49:10 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:49:10 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:49:10 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8
Nov 09 03:49:10 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:49:10 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:49:10 user nova-compute[75378]: FIRMWARE:
Nov 09 03:49:10 user nova-compute[75378]: No targets found.
Nov 09 03:49:10 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:49:10 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:49:10 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfd669d-dd05-4412-b083-e147474958e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[443886ec-b1f9-4bd4-9131-bd3eb0b125ea]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:49:10 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:49:10 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c629fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a'): ({'sdd'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Removing single pathed devices sdd {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb088f03-d688-4821-8969-3227cb5410f2]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a30833-bf35-4491-b0b8-2b3ab8058b43]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Flushing IO for device /dev/sdd {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79b224e-f130-47d1-b927-9ceaad33e6e6]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[113401ae-a985-4bbe-afa9-143d4394500f]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] SCSI volumes sdd have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6711b074-0b15-4311-b0d3-c443052ca475]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-6266df2c-1679-468e-93ec-18462804e81c req-72daa223-e731-46a1-839a-05ebdd6d2ebd service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-plugged-427ba1a1-d2a8-431b-aeea-d455e8908e7a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6266df2c-1679-468e-93ec-18462804e81c req-72daa223-e731-46a1-839a-05ebdd6d2ebd service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6266df2c-1679-468e-93ec-18462804e81c req-72daa223-e731-46a1-839a-05ebdd6d2ebd service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6266df2c-1679-468e-93ec-18462804e81c req-72daa223-e731-46a1-839a-05ebdd6d2ebd service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-6266df2c-1679-468e-93ec-18462804e81c req-72daa223-e731-46a1-839a-05ebdd6d2ebd service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-plugged-427ba1a1-d2a8-431b-aeea-d455e8908e7a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:10 user nova-compute[75378]: WARNING nova.compute.manager [req-6266df2c-1679-468e-93ec-18462804e81c req-72daa223-e731-46a1-839a-05ebdd6d2ebd service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received unexpected event network-vif-plugged-427ba1a1-d2a8-431b-aeea-d455e8908e7a for instance with vm_state active and task_state deleting.
Nov 09 03:49:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-6266df2c-1679-468e-93ec-18462804e81c req-72daa223-e731-46a1-839a-05ebdd6d2ebd service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-unplugged-2195503e-d6da-4598-9478-2956f48d2b8e {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6266df2c-1679-468e-93ec-18462804e81c req-72daa223-e731-46a1-839a-05ebdd6d2ebd service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6266df2c-1679-468e-93ec-18462804e81c req-72daa223-e731-46a1-839a-05ebdd6d2ebd service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6266df2c-1679-468e-93ec-18462804e81c req-72daa223-e731-46a1-839a-05ebdd6d2ebd service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-6266df2c-1679-468e-93ec-18462804e81c req-72daa223-e731-46a1-839a-05ebdd6d2ebd service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-unplugged-2195503e-d6da-4598-9478-2956f48d2b8e {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-6266df2c-1679-468e-93ec-18462804e81c req-72daa223-e731-46a1-839a-05ebdd6d2ebd service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-unplugged-2195503e-d6da-4598-9478-2956f48d2b8e for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-6266df2c-1679-468e-93ec-18462804e81c req-72daa223-e731-46a1-839a-05ebdd6d2ebd service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-plugged-2195503e-d6da-4598-9478-2956f48d2b8e {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6266df2c-1679-468e-93ec-18462804e81c req-72daa223-e731-46a1-839a-05ebdd6d2ebd service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6266df2c-1679-468e-93ec-18462804e81c req-72daa223-e731-46a1-839a-05ebdd6d2ebd service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6266df2c-1679-468e-93ec-18462804e81c req-72daa223-e731-46a1-839a-05ebdd6d2ebd service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-6266df2c-1679-468e-93ec-18462804e81c req-72daa223-e731-46a1-839a-05ebdd6d2ebd service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-plugged-2195503e-d6da-4598-9478-2956f48d2b8e {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:10 user nova-compute[75378]: WARNING nova.compute.manager [req-6266df2c-1679-468e-93ec-18462804e81c req-72daa223-e731-46a1-839a-05ebdd6d2ebd service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received unexpected event network-vif-plugged-2195503e-d6da-4598-9478-2956f48d2b8e for instance with vm_state active and task_state deleting.
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb2d10a-2ee3-4f03-b701-7dec27e485e8]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a, portal: 172.16.0.220,3260]
Nov 09 03:49:10 user nova-compute[75378]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a, portal: 172.16.0.220,3260] successful.
Nov 09 03:49:10 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981920d2-9809-4a1c-917b-fb19ca23724a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf7625d-32c5-4fd2-891d-ec808199f2a5]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] <== disconnect_volume: return (376ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaDJhmpG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:49:10 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-a0b62022-bc3c-4f89-b67f-cc2694eb9bc7 req-b80947c2-07b4-4a4d-b42d-efa0b14347db service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-plugged-e2bab297-674f-41e7-baac-73eb91483899 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a0b62022-bc3c-4f89-b67f-cc2694eb9bc7 req-b80947c2-07b4-4a4d-b42d-efa0b14347db service nova] Acquiring lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a0b62022-bc3c-4f89-b67f-cc2694eb9bc7 req-b80947c2-07b4-4a4d-b42d-efa0b14347db service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a0b62022-bc3c-4f89-b67f-cc2694eb9bc7 req-b80947c2-07b4-4a4d-b42d-efa0b14347db service nova] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-a0b62022-bc3c-4f89-b67f-cc2694eb9bc7 req-b80947c2-07b4-4a4d-b42d-efa0b14347db service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] No waiting events found dispatching network-vif-plugged-e2bab297-674f-41e7-baac-73eb91483899 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:10 user nova-compute[75378]: WARNING nova.compute.manager [req-a0b62022-bc3c-4f89-b67f-cc2694eb9bc7 req-b80947c2-07b4-4a4d-b42d-efa0b14347db service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received unexpected event network-vif-plugged-e2bab297-674f-41e7-baac-73eb91483899 for instance with vm_state active and task_state deleting.
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8af1615-9e83-4619-af1d-07836d44ca76]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:49:10 user nova-compute[75378]: No targets found.
Nov 09 03:49:10 user nova-compute[75378]: iSNS:
Nov 09 03:49:10 user nova-compute[75378]: No targets found.
Nov 09 03:49:10 user nova-compute[75378]: STATIC:
Nov 09 03:49:10 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f
Nov 09 03:49:10 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:49:10 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:49:10 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 03:49:10 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:49:10 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:49:10 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d
Nov 09 03:49:10 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:49:10 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:49:10 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09
Nov 09 03:49:10 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:49:10 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:49:10 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8
Nov 09 03:49:10 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:49:10 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:49:10 user nova-compute[75378]: FIRMWARE:
Nov 09 03:49:10 user nova-compute[75378]: No targets found.
Nov 09 03:49:10 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:49:10 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:49:10 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9933aee3-df08-41e7-a0fa-76c272e926cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[22341371-2872-414e-a71a-a819676c6937]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:49:10 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:49:10 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3b049cf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8'): ({'sde'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Removing single pathed devices sde {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce1163f-2c42-4079-9832-2d892668aef8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[620c1877-2cd2-47ef-be0e-3d4e6a149fb8]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Flushing IO for device /dev/sde {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[019842c4-255e-4bac-b5a2-acd7feb53afa]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfa793b-c94c-44f0-bf0b-831a1306fb07]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] SCSI volumes sde have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9327a9b-3ecb-41a9-a23e-ea7e71bb3a78]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62a2d4c-9c33-46f2-81e7-b2b8c09935de]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8, portal: 172.16.0.220,3260]
Nov 09 03:49:10 user nova-compute[75378]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8, portal: 172.16.0.220,3260] successful.
Nov 09 03:49:10 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:272d88bd-3b32-432e-b625-96fb7c66f6a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74cb978-9c98-419d-b1b8-50c111352139]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] <== disconnect_volume: return (312ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nwbRzDso', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:49:10 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[27287332-c9c7-45d4-85c2-db3b25d5d24f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:49:10 user nova-compute[75378]: No targets found.
Nov 09 03:49:10 user nova-compute[75378]: iSNS:
Nov 09 03:49:10 user nova-compute[75378]: No targets found.
Nov 09 03:49:10 user nova-compute[75378]: STATIC:
Nov 09 03:49:10 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f
Nov 09 03:49:10 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:49:10 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:49:10 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 03:49:10 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:49:10 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:49:10 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d
Nov 09 03:49:10 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:49:10 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:49:10 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09
Nov 09 03:49:10 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:49:10 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:49:10 user nova-compute[75378]: FIRMWARE:
Nov 09 03:49:10 user nova-compute[75378]: No targets found.
Nov 09 03:49:10 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:49:10 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:49:10 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52f9457-36f2-48bc-8168-a34ad7dc6d0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c325966-3471-4f9a-9aa8-13b1cd816174]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:49:10 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:49:10 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:49:10 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c717010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d'): ({'sdf'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Removing single pathed devices sdf {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[109d8af0-3759-40f3-9f29-5a7f8ed7043b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b3952e-e1f7-4200-88d2-c2b894c265a2]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Flushing IO for device /dev/sdf {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df51e52-a434-4e96-b681-3e720b06b2af]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dabbcb-ab26-4918-84be-4ab9b92220ce]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] SCSI volumes sdf have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccee257-d079-48c7-8648-360f5461f246]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c28eeb-20e1-4996-85a3-49b6dab715ef]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d, portal: 172.16.0.220,3260]
Nov 09 03:49:10 user nova-compute[75378]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d, portal: 172.16.0.220,3260] successful.
Nov 09 03:49:10 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb2e5acb-e73c-45dc-9cb5-31e6489d682d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb4dbee-c863-4e18-9b29-6fd0407c0246]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] <== disconnect_volume: return (312ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:49:10 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:49:10 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Deleting instance files /opt/stack/data/nova/instances/c4ef6623-863b-40a8-b9ec-720c25ee3484_del
Nov 09 03:49:10 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Deletion of /opt/stack/data/nova/instances/c4ef6623-863b-40a8-b9ec-720c25ee3484_del complete
Nov 09 03:49:11 user nova-compute[75378]: INFO nova.compute.manager [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Took 3.58 seconds to destroy the instance on the hypervisor.
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrnGeLFz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:49:11 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:49:11 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:49:11 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a391f53-3814-46f4-929a-8aaec1e50012]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:49:11 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed34f409-6fde-4ced-ab58-8e0152f32f7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75] added
Nov 09 03:49:11 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fc5c41-35de-4569-afcf-eac5f4f19ff3]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e5696b-97e2-428e-a87c-517283072d41]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DrnGeLFz {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DrnGeLFz" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae721d40-1171-47f7-8c02-91f957c1129c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DrnGeLFz'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86bd783-7c0f-4a38-9f39-ef2adb7fea97]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[adba77ff-248f-4079-9366-2055fca95ccf]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:49:11 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:49:11 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:49:11 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:49:11 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:49:11 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:49:11 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7907c6-e665-44c2-a345-f9939e9303ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75, portal: 172.16.0.220,3260]
Nov 09 03:49:11 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75, portal: 172.16.0.220,3260] successful.
Nov 09 03:49:11 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[690d3139-e036-4096-b1c7-0fc2e17d294e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65ee1f9-813a-4e67-a228-048b0c114f51]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:49:11 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:49:11 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:49:11 user nova-compute[75378]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:49:11 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:49:11 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:49:11 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:49:11 user nova-compute[75378]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:49:11 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0745bc3c-6855-4a33-845d-a221b2cffe67]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:49:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrnGeLFz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:49:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-ff138964-75de-4ec3-80ed-fbd6a63cda88 req-443ba578-75c1-462f-9b3b-407969091d29 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-deleted-e2bab297-674f-41e7-baac-73eb91483899 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:12 user nova-compute[75378]: INFO nova.compute.manager [req-ff138964-75de-4ec3-80ed-fbd6a63cda88 req-443ba578-75c1-462f-9b3b-407969091d29 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Neutron deleted interface e2bab297-674f-41e7-baac-73eb91483899; detaching it from the instance and deleting it from the info cache
Nov 09 03:49:12 user nova-compute[75378]: DEBUG nova.network.neutron [req-ff138964-75de-4ec3-80ed-fbd6a63cda88 req-443ba578-75c1-462f-9b3b-407969091d29 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Updating instance_info_cache with network_info: [{"id": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "address": "fa:16:3e:bc:91:1f", "network": {"id": "1c13e251-154e-4521-9b3c-443bb29cc577", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071356817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ed92ed-0e", "ovs_interfaceid": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "address": "fa:16:3e:0d:b1:a6", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95465b85-15", "ovs_interfaceid": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "address": "fa:16:3e:b7:e8:0e", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd2d935-db", "ovs_interfaceid": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "address": "fa:16:3e:35:0f:09", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap427ba1a1-d2", "ovs_interfaceid": "427ba1a1-d2a8-431b-aeea-d455e8908e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2195503e-d6da-4598-9478-2956f48d2b8e", "address": "fa:16:3e:9c:68:a7", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2195503e-d6", "ovs_interfaceid": "2195503e-d6da-4598-9478-2956f48d2b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "address": "fa:16:3e:1f:60:09", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe16ed0-6d", "ovs_interfaceid": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:49:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-ff138964-75de-4ec3-80ed-fbd6a63cda88 req-443ba578-75c1-462f-9b3b-407969091d29 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Detach interface failed, port_id=e2bab297-674f-41e7-baac-73eb91483899, reason: Instance c4ef6623-863b-40a8-b9ec-720c25ee3484 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 03:49:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:49:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23539613338323965', 'path': '/dev/sdd'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:49:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539613338323965', 'path': '/dev/sdd'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:49:12 user nova-compute[75378]: DEBUG nova.objects.instance [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lazy-loading 'flavor' on Instance uuid 06216917-d7d1-4fd4-a311-e054437e84a6 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:49:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 03:49:12 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:49:12 user nova-compute[75378]:   <source dev="/dev/sdd"/>
Nov 09 03:49:12 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:49:12 user nova-compute[75378]:   <serial>2fdd9b92-de5f-4df9-9994-444624a88b75</serial>
Nov 09 03:49:12 user nova-compute[75378]: </disk>
Nov 09 03:49:12 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 03:49:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:49:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:49:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] No VIF found with MAC fa:16:3e:a8:c1:72, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:49:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a19328f-0eca-4e0e-a6b1-5f073286f1d5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "06216917-d7d1-4fd4-a311-e054437e84a6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 45.067s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-f7caebf4-9174-4ed6-a200-e9ffa657949a req-735f9d2a-e4eb-4a5c-8e5b-fcd14dcb5122 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-deleted-427ba1a1-d2a8-431b-aeea-d455e8908e7a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:14 user nova-compute[75378]: INFO nova.compute.manager [req-f7caebf4-9174-4ed6-a200-e9ffa657949a req-735f9d2a-e4eb-4a5c-8e5b-fcd14dcb5122 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Neutron deleted interface 427ba1a1-d2a8-431b-aeea-d455e8908e7a; detaching it from the instance and deleting it from the info cache
Nov 09 03:49:14 user nova-compute[75378]: DEBUG nova.network.neutron [req-f7caebf4-9174-4ed6-a200-e9ffa657949a req-735f9d2a-e4eb-4a5c-8e5b-fcd14dcb5122 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Updating instance_info_cache with network_info: [{"id": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "address": "fa:16:3e:bc:91:1f", "network": {"id": "1c13e251-154e-4521-9b3c-443bb29cc577", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071356817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ed92ed-0e", "ovs_interfaceid": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "address": "fa:16:3e:0d:b1:a6", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95465b85-15", "ovs_interfaceid": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "address": "fa:16:3e:b7:e8:0e", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd2d935-db", "ovs_interfaceid": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2195503e-d6da-4598-9478-2956f48d2b8e", "address": "fa:16:3e:9c:68:a7", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2195503e-d6", "ovs_interfaceid": "2195503e-d6da-4598-9478-2956f48d2b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "address": "fa:16:3e:1f:60:09", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe16ed0-6d", "ovs_interfaceid": "abe16ed0-6d62-41c1-8bfd-da97d9908143", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:49:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-f7caebf4-9174-4ed6-a200-e9ffa657949a req-735f9d2a-e4eb-4a5c-8e5b-fcd14dcb5122 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Detach interface failed, port_id=427ba1a1-d2a8-431b-aeea-d455e8908e7a, reason: Instance c4ef6623-863b-40a8-b9ec-720c25ee3484 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 03:49:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-f7caebf4-9174-4ed6-a200-e9ffa657949a req-735f9d2a-e4eb-4a5c-8e5b-fcd14dcb5122 service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Received event network-changed-1960394a-38fa-4977-95b7-6a057246f84f {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-f7caebf4-9174-4ed6-a200-e9ffa657949a req-735f9d2a-e4eb-4a5c-8e5b-fcd14dcb5122 service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Refreshing instance network info cache due to event network-changed-1960394a-38fa-4977-95b7-6a057246f84f. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:49:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f7caebf4-9174-4ed6-a200-e9ffa657949a req-735f9d2a-e4eb-4a5c-8e5b-fcd14dcb5122 service nova] Acquiring lock "refresh_cache-cc4b9517-2616-4cfb-82f7-8379f4619962" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:49:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f7caebf4-9174-4ed6-a200-e9ffa657949a req-735f9d2a-e4eb-4a5c-8e5b-fcd14dcb5122 service nova] Acquired lock "refresh_cache-cc4b9517-2616-4cfb-82f7-8379f4619962" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:49:14 user nova-compute[75378]: DEBUG nova.network.neutron [req-f7caebf4-9174-4ed6-a200-e9ffa657949a req-735f9d2a-e4eb-4a5c-8e5b-fcd14dcb5122 service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Refreshing network info cache for port 1960394a-38fa-4977-95b7-6a057246f84f {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:49:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:15 user nova-compute[75378]: DEBUG nova.network.neutron [req-f7caebf4-9174-4ed6-a200-e9ffa657949a req-735f9d2a-e4eb-4a5c-8e5b-fcd14dcb5122 service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Updated VIF entry in instance network info cache for port 1960394a-38fa-4977-95b7-6a057246f84f. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:49:15 user nova-compute[75378]: DEBUG nova.network.neutron [req-f7caebf4-9174-4ed6-a200-e9ffa657949a req-735f9d2a-e4eb-4a5c-8e5b-fcd14dcb5122 service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Updating instance_info_cache with network_info: [{"id": "1960394a-38fa-4977-95b7-6a057246f84f", "address": "fa:16:3e:99:9a:c5", "network": {"id": "5d4c731b-c253-46b1-98de-427ee670e8e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1331924378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be12d540705f40b1a28a40589eabfec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1960394a-38", "ovs_interfaceid": "1960394a-38fa-4977-95b7-6a057246f84f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:49:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f7caebf4-9174-4ed6-a200-e9ffa657949a req-735f9d2a-e4eb-4a5c-8e5b-fcd14dcb5122 service nova] Releasing lock "refresh_cache-cc4b9517-2616-4cfb-82f7-8379f4619962" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:49:15 user nova-compute[75378]: DEBUG nova.compute.manager [req-f7caebf4-9174-4ed6-a200-e9ffa657949a req-735f9d2a-e4eb-4a5c-8e5b-fcd14dcb5122 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-deleted-abe16ed0-6d62-41c1-8bfd-da97d9908143 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:15 user nova-compute[75378]: INFO nova.compute.manager [req-f7caebf4-9174-4ed6-a200-e9ffa657949a req-735f9d2a-e4eb-4a5c-8e5b-fcd14dcb5122 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Neutron deleted interface abe16ed0-6d62-41c1-8bfd-da97d9908143; detaching it from the instance and deleting it from the info cache
Nov 09 03:49:15 user nova-compute[75378]: DEBUG nova.network.neutron [req-f7caebf4-9174-4ed6-a200-e9ffa657949a req-735f9d2a-e4eb-4a5c-8e5b-fcd14dcb5122 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Updating instance_info_cache with network_info: [{"id": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "address": "fa:16:3e:bc:91:1f", "network": {"id": "1c13e251-154e-4521-9b3c-443bb29cc577", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1071356817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37ed92ed-0e", "ovs_interfaceid": "37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "address": "fa:16:3e:0d:b1:a6", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95465b85-15", "ovs_interfaceid": "95465b85-15fb-4cf7-9db9-23c5e4a755c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "address": "fa:16:3e:b7:e8:0e", "network": {"id": "330bad01-9253-4e8e-a0bf-896d3735d79a", "bridge": "br-int", "label": "tempest-device-tagging-net1-466695406", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dd2d935-db", "ovs_interfaceid": "4dd2d935-dbaf-445e-aa45-30114c1df2a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2195503e-d6da-4598-9478-2956f48d2b8e", "address": "fa:16:3e:9c:68:a7", "network": {"id": "36b4d72f-7b08-4926-b623-bcc9260201a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-846848380", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a9b7a5a29e104b60ae779f864d5c202f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2195503e-d6", "ovs_interfaceid": "2195503e-d6da-4598-9478-2956f48d2b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:49:15 user nova-compute[75378]: DEBUG nova.compute.manager [req-f7caebf4-9174-4ed6-a200-e9ffa657949a req-735f9d2a-e4eb-4a5c-8e5b-fcd14dcb5122 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Detach interface failed, port_id=abe16ed0-6d62-41c1-8bfd-da97d9908143, reason: Instance c4ef6623-863b-40a8-b9ec-720c25ee3484 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 03:49:15 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:49:15 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Took 4.35 seconds to deallocate network for instance.
Nov 09 03:49:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:16 user nova-compute[75378]: DEBUG nova.compute.manager [req-4278504a-4588-4173-bce7-c30e109aa165 req-930199a3-715f-420d-9981-7dc37f3b4505 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-deleted-37ed92ed-0e0f-49ce-bb27-2e87f4c9ec1d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:16 user nova-compute[75378]: DEBUG nova.compute.manager [req-4278504a-4588-4173-bce7-c30e109aa165 req-930199a3-715f-420d-9981-7dc37f3b4505 service nova] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Received event network-vif-deleted-2195503e-d6da-4598-9478-2956f48d2b8e {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:18 user nova-compute[75378]: INFO nova.compute.manager [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] [instance: c4ef6623-863b-40a8-b9ec-720c25ee3484] Took 3.39 seconds to detach 3 volumes for instance.
Nov 09 03:49:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:19 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:49:19 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:49:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:19 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Deleted allocations for instance c4ef6623-863b-40a8-b9ec-720c25ee3484
Nov 09 03:49:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-895eb4ed-11eb-4eb6-bf4f-452cf26c37c4 tempest-TaggedBootDevicesTest_v242-1739662256 tempest-TaggedBootDevicesTest_v242-1739662256-project-member] Lock "c4ef6623-863b-40a8-b9ec-720c25ee3484" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.899s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Acquiring lock "cc4b9517-2616-4cfb-82f7-8379f4619962" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "cc4b9517-2616-4cfb-82f7-8379f4619962" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:20 user nova-compute[75378]: DEBUG nova.objects.instance [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lazy-loading 'flavor' on Instance uuid cc4b9517-2616-4cfb-82f7-8379f4619962 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:49:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "cc4b9517-2616-4cfb-82f7-8379f4619962" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Acquiring lock "cc4b9517-2616-4cfb-82f7-8379f4619962" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "cc4b9517-2616-4cfb-82f7-8379f4619962" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:20 user nova-compute[75378]: INFO nova.compute.manager [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Attaching volume b897f0d3-7b21-4726-a40d-3ce9849a386b to /dev/vdb
Nov 09 03:49:21 user nova-compute[75378]: DEBUG os_brick.utils [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:49:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:21 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b65f161-ef6a-4406-936b-fe41b8dd9fa3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:21 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b298a7-0496-4fc6-9eb9-ef7ec0bc9a82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.040s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:21 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[090cad22-b869-48fa-ba47-f5c7eeb22ea5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:21 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd15d4d0-49fc-43b1-99b5-ba73ccf00698]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:49:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:49:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:49:21 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:49:21 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[378adc88-c7e7-448f-a90b-e3d2adfaa840]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:49:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:49:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:49:21 user nova-compute[75378]: DEBUG os_brick.utils [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:49:21 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Updating existing volume attachment record: cb830304-4ae7-4c0f-92bf-9f35db97632e {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:49:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:25 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:49:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:28 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:49:29 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:49:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:30 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:49:30 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:49:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:49:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:49:30 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 03:49:30 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Updating instance_info_cache with network_info: [{"id": "4c53e537-1637-4f65-b393-a10e68383acb", "address": "fa:16:3e:d8:76:bf", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c53e537-16", "ovs_interfaceid": "4c53e537-1637-4f65-b393-a10e68383acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:49:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:49:30 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 03:49:31 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:49:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:32 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:49:33 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:49:33 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:49:34 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:49:34 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:49:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:34 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:49:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:49:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:49:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:49:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/013db901-fbee-4593-a14f-95a03e79fad0/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/013db901-fbee-4593-a14f-95a03e79fad0/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/013db901-fbee-4593-a14f-95a03e79fad0/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/013db901-fbee-4593-a14f-95a03e79fad0/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:38 user nova-compute[75378]: DEBUG nova.compute.manager [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:49:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:38 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:49:38 user nova-compute[75378]: INFO nova.compute.claims [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Claim successful on node user
Nov 09 03:49:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:49:39 user nova-compute[75378]: DEBUG nova.compute.manager [req-1d7179b6-8824-48e0-aa7e-056b2873c15c req-62208d5b-8fe3-4b25-b0e8-dc12cfa3bc64 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Received event network-changed-f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:39 user nova-compute[75378]: DEBUG nova.compute.manager [req-1d7179b6-8824-48e0-aa7e-056b2873c15c req-62208d5b-8fe3-4b25-b0e8-dc12cfa3bc64 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Refreshing instance network info cache due to event network-changed-f18d71ff-8728-41e9-82bf-3d66e09e552a. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:49:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1d7179b6-8824-48e0-aa7e-056b2873c15c req-62208d5b-8fe3-4b25-b0e8-dc12cfa3bc64 service nova] Acquiring lock "refresh_cache-06216917-d7d1-4fd4-a311-e054437e84a6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:49:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1d7179b6-8824-48e0-aa7e-056b2873c15c req-62208d5b-8fe3-4b25-b0e8-dc12cfa3bc64 service nova] Acquired lock "refresh_cache-06216917-d7d1-4fd4-a311-e054437e84a6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:49:39 user nova-compute[75378]: DEBUG nova.network.neutron [req-1d7179b6-8824-48e0-aa7e-056b2873c15c req-62208d5b-8fe3-4b25-b0e8-dc12cfa3bc64 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Refreshing network info cache for port f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:49:39 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:49:39 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:49:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7293MB free_disk=25.196311950683594GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:49:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:39 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:49:39 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:49:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.028s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:39 user nova-compute[75378]: DEBUG nova.compute.manager [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:49:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.455s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:39 user nova-compute[75378]: DEBUG nova.compute.manager [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:49:39 user nova-compute[75378]: DEBUG nova.network.neutron [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:49:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:39 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.compute.manager [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7d051405-6b57-4db2-9533-c2f4e87134d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 883490f1-6a9f-4ad6-83c4-44b78e681de6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2c2acb48-972a-41d7-987e-48e79b3bef93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7e12539b-36a3-4691-89fd-e3d155de38d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 013db901-fbee-4593-a14f-95a03e79fad0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 06216917-d7d1-4fd4-a311-e054437e84a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2abe50f8-3c9b-417e-889f-1d565089d678 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance cc4b9517-2616-4cfb-82f7-8379f4619962 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance ed92e04a-56ec-42f1-bed3-8b28a37d1475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.policy [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d4f0858695e4509a6b0ab99a8212571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548993d280024b60b3778b026177e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.network.neutron [req-1d7179b6-8824-48e0-aa7e-056b2873c15c req-62208d5b-8fe3-4b25-b0e8-dc12cfa3bc64 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Updated VIF entry in instance network info cache for port f18d71ff-8728-41e9-82bf-3d66e09e552a. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.network.neutron [req-1d7179b6-8824-48e0-aa7e-056b2873c15c req-62208d5b-8fe3-4b25-b0e8-dc12cfa3bc64 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Updating instance_info_cache with network_info: [{"id": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "address": "fa:16:3e:a8:c1:72", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d71ff-87", "ovs_interfaceid": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1d7179b6-8824-48e0-aa7e-056b2873c15c req-62208d5b-8fe3-4b25-b0e8-dc12cfa3bc64 service nova] Releasing lock "refresh_cache-06216917-d7d1-4fd4-a311-e054437e84a6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.compute.manager [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:49:40 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Creating image(s)
Nov 09 03:49:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "/opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "/opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.226s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.196s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk 1073741824" returned: 0 in 0.148s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.351s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.914s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.network.neutron [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Successfully created port: f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.212s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:49:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Cannot resize image /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Ensure instance console log exists: /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.network.neutron [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Successfully updated port: f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "refresh_cache-ed92e04a-56ec-42f1-bed3-8b28a37d1475" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquired lock "refresh_cache-ed92e04a-56ec-42f1-bed3-8b28a37d1475" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.network.neutron [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.compute.manager [req-4ea0772d-fe7a-4ff8-9faf-d27f4c75e1ff req-4e9c352d-8ed8-4e09-8856-64925ddbff3f service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Received event network-changed-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.compute.manager [req-4ea0772d-fe7a-4ff8-9faf-d27f4c75e1ff req-4e9c352d-8ed8-4e09-8856-64925ddbff3f service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Refreshing instance network info cache due to event network-changed-f0923686-86a8-4a1d-a8a9-f59a6aff0b13. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4ea0772d-fe7a-4ff8-9faf-d27f4c75e1ff req-4e9c352d-8ed8-4e09-8856-64925ddbff3f service nova] Acquiring lock "refresh_cache-ed92e04a-56ec-42f1-bed3-8b28a37d1475" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.network.neutron [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.network.neutron [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Updating instance_info_cache with network_info: [{"id": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "address": "fa:16:3e:08:70:32", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0923686-86", "ovs_interfaceid": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Releasing lock "refresh_cache-ed92e04a-56ec-42f1-bed3-8b28a37d1475" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.compute.manager [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Instance network_info: |[{"id": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "address": "fa:16:3e:08:70:32", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0923686-86", "ovs_interfaceid": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4ea0772d-fe7a-4ff8-9faf-d27f4c75e1ff req-4e9c352d-8ed8-4e09-8856-64925ddbff3f service nova] Acquired lock "refresh_cache-ed92e04a-56ec-42f1-bed3-8b28a37d1475" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.network.neutron [req-4ea0772d-fe7a-4ff8-9faf-d27f4c75e1ff req-4e9c352d-8ed8-4e09-8856-64925ddbff3f service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Refreshing network info cache for port f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Start _get_guest_xml network_info=[{"id": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "address": "fa:16:3e:08:70:32", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0923686-86", "ovs_interfaceid": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:49:41 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:49:41 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:49:41 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:49:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1692964339',display_name='tempest-tempest.common.compute-instance-1692964339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1692964339',id=26,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhe/OL3GXNicZULwBkt8Xad1DZCqYW1OnSvQiEJGYeRe8spVLTNCFMHzUuOG0YSKEEvn+VmZdKf+HgwcnEgeHc+Tl5vJDf5cNrLcH5ndE+P65ps69IZ1N9WZloB873P4Q==',key_name='tempest-keypair-1978093987',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548993d280024b60b3778b026177e356',ramdisk_id='',reservation_id='r-fcsl00x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2010465588',owner_user_name='tempest-ServerActionsTestOtherA-2010465588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:49:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d4f0858695e4509a6b0ab99a8212571',uuid=ed92e04a-56ec-42f1-bed3-8b28a37d1475,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "address": "fa:16:3e:08:70:32", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0923686-86", "ovs_interfaceid": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converting VIF {"id": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "address": "fa:16:3e:08:70:32", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0923686-86", "ovs_interfaceid": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:70:32,bridge_name='br-int',has_traffic_filtering=True,id=f0923686-86a8-4a1d-a8a9-f59a6aff0b13,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0923686-86') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG nova.objects.instance [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lazy-loading 'pci_devices' on Instance uuid ed92e04a-56ec-42f1-bed3-8b28a37d1475 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:49:42 user nova-compute[75378]:   <uuid>ed92e04a-56ec-42f1-bed3-8b28a37d1475</uuid>
Nov 09 03:49:42 user nova-compute[75378]:   <name>instance-0000001a</name>
Nov 09 03:49:42 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:49:42 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:49:42 user nova-compute[75378]:   <metadata>
Nov 09 03:49:42 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:49:42 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:49:42 user nova-compute[75378]:       <nova:name>tempest-tempest.common.compute-instance-1692964339</nova:name>
Nov 09 03:49:42 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:49:41</nova:creationTime>
Nov 09 03:49:42 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:49:42 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:49:42 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:49:42 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:49:42 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:49:42 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:49:42 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:49:42 user nova-compute[75378]:       <nova:owner>
Nov 09 03:49:42 user nova-compute[75378]:         <nova:user uuid="5d4f0858695e4509a6b0ab99a8212571">tempest-ServerActionsTestOtherA-2010465588-project-member</nova:user>
Nov 09 03:49:42 user nova-compute[75378]:         <nova:project uuid="548993d280024b60b3778b026177e356">tempest-ServerActionsTestOtherA-2010465588</nova:project>
Nov 09 03:49:42 user nova-compute[75378]:       </nova:owner>
Nov 09 03:49:42 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:49:42 user nova-compute[75378]:       <nova:ports>
Nov 09 03:49:42 user nova-compute[75378]:         <nova:port uuid="f0923686-86a8-4a1d-a8a9-f59a6aff0b13">
Nov 09 03:49:42 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 09 03:49:42 user nova-compute[75378]:         </nova:port>
Nov 09 03:49:42 user nova-compute[75378]:       </nova:ports>
Nov 09 03:49:42 user nova-compute[75378]:     </nova:instance>
Nov 09 03:49:42 user nova-compute[75378]:   </metadata>
Nov 09 03:49:42 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:49:42 user nova-compute[75378]:     <system>
Nov 09 03:49:42 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:49:42 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:49:42 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:49:42 user nova-compute[75378]:       <entry name="serial">ed92e04a-56ec-42f1-bed3-8b28a37d1475</entry>
Nov 09 03:49:42 user nova-compute[75378]:       <entry name="uuid">ed92e04a-56ec-42f1-bed3-8b28a37d1475</entry>
Nov 09 03:49:42 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:49:42 user nova-compute[75378]:     </system>
Nov 09 03:49:42 user nova-compute[75378]:   </sysinfo>
Nov 09 03:49:42 user nova-compute[75378]:   <os>
Nov 09 03:49:42 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:49:42 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:49:42 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:49:42 user nova-compute[75378]:   </os>
Nov 09 03:49:42 user nova-compute[75378]:   <features>
Nov 09 03:49:42 user nova-compute[75378]:     <acpi/>
Nov 09 03:49:42 user nova-compute[75378]:     <apic/>
Nov 09 03:49:42 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:49:42 user nova-compute[75378]:   </features>
Nov 09 03:49:42 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:49:42 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:49:42 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:49:42 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:49:42 user nova-compute[75378]:   </clock>
Nov 09 03:49:42 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:49:42 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:49:42 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:49:42 user nova-compute[75378]:   </cpu>
Nov 09 03:49:42 user nova-compute[75378]:   <devices>
Nov 09 03:49:42 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:49:42 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:49:42 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk"/>
Nov 09 03:49:42 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:49:42 user nova-compute[75378]:     </disk>
Nov 09 03:49:42 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:49:42 user nova-compute[75378]:       <mac address="fa:16:3e:08:70:32"/>
Nov 09 03:49:42 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:49:42 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:49:42 user nova-compute[75378]:       <target dev="tapf0923686-86"/>
Nov 09 03:49:42 user nova-compute[75378]:     </interface>
Nov 09 03:49:42 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:49:42 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/console.log" append="off"/>
Nov 09 03:49:42 user nova-compute[75378]:     </serial>
Nov 09 03:49:42 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:49:42 user nova-compute[75378]:     <video>
Nov 09 03:49:42 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:49:42 user nova-compute[75378]:     </video>
Nov 09 03:49:42 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:49:42 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:49:42 user nova-compute[75378]:     </rng>
Nov 09 03:49:42 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:49:42 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:49:42 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:49:42 user nova-compute[75378]:     </memballoon>
Nov 09 03:49:42 user nova-compute[75378]:   </devices>
Nov 09 03:49:42 user nova-compute[75378]: </domain>
Nov 09 03:49:42 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:49:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1692964339',display_name='tempest-tempest.common.compute-instance-1692964339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1692964339',id=26,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhe/OL3GXNicZULwBkt8Xad1DZCqYW1OnSvQiEJGYeRe8spVLTNCFMHzUuOG0YSKEEvn+VmZdKf+HgwcnEgeHc+Tl5vJDf5cNrLcH5ndE+P65ps69IZ1N9WZloB873P4Q==',key_name='tempest-keypair-1978093987',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548993d280024b60b3778b026177e356',ramdisk_id='',reservation_id='r-fcsl00x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2010465588',owner_user_name='tempest-ServerActionsTestOtherA-2010465588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:49:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d4f0858695e4509a6b0ab99a8212571',uuid=ed92e04a-56ec-42f1-bed3-8b28a37d1475,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "address": "fa:16:3e:08:70:32", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0923686-86", "ovs_interfaceid": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converting VIF {"id": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "address": "fa:16:3e:08:70:32", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0923686-86", "ovs_interfaceid": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:70:32,bridge_name='br-int',has_traffic_filtering=True,id=f0923686-86a8-4a1d-a8a9-f59a6aff0b13,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0923686-86') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG os_vif [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:70:32,bridge_name='br-int',has_traffic_filtering=True,id=f0923686-86a8-4a1d-a8a9-f59a6aff0b13,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0923686-86') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88a6755a-f739-5eaf-b05b-fead480ce8d2', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0923686-86, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0923686-86, col_values=(('qos', UUID('c1cf56b7-aa3f-4dce-ac4f-01f0c1b24df2')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0923686-86, col_values=(('external_ids', {'iface-id': 'f0923686-86a8-4a1d-a8a9-f59a6aff0b13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:70:32', 'vm-uuid': 'ed92e04a-56ec-42f1-bed3-8b28a37d1475'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:42 user nova-compute[75378]: INFO os_vif [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:70:32,bridge_name='br-int',has_traffic_filtering=True,id=f0923686-86a8-4a1d-a8a9-f59a6aff0b13,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0923686-86')
Nov 09 03:49:42 user nova-compute[75378]: DEBUG nova.compute.manager [req-d6855c3e-e236-4cc5-9763-cdc6213efb64 req-02b7cc9b-99d1-4401-a04f-0874836eb5e0 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Received event network-changed-f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG nova.compute.manager [req-d6855c3e-e236-4cc5-9763-cdc6213efb64 req-02b7cc9b-99d1-4401-a04f-0874836eb5e0 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Refreshing instance network info cache due to event network-changed-f18d71ff-8728-41e9-82bf-3d66e09e552a. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d6855c3e-e236-4cc5-9763-cdc6213efb64 req-02b7cc9b-99d1-4401-a04f-0874836eb5e0 service nova] Acquiring lock "refresh_cache-06216917-d7d1-4fd4-a311-e054437e84a6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d6855c3e-e236-4cc5-9763-cdc6213efb64 req-02b7cc9b-99d1-4401-a04f-0874836eb5e0 service nova] Acquired lock "refresh_cache-06216917-d7d1-4fd4-a311-e054437e84a6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG nova.network.neutron [req-d6855c3e-e236-4cc5-9763-cdc6213efb64 req-02b7cc9b-99d1-4401-a04f-0874836eb5e0 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Refreshing network info cache for port f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] No VIF found with MAC fa:16:3e:08:70:32, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG nova.network.neutron [req-4ea0772d-fe7a-4ff8-9faf-d27f4c75e1ff req-4e9c352d-8ed8-4e09-8856-64925ddbff3f service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Updated VIF entry in instance network info cache for port f0923686-86a8-4a1d-a8a9-f59a6aff0b13. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG nova.network.neutron [req-4ea0772d-fe7a-4ff8-9faf-d27f4c75e1ff req-4e9c352d-8ed8-4e09-8856-64925ddbff3f service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Updating instance_info_cache with network_info: [{"id": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "address": "fa:16:3e:08:70:32", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0923686-86", "ovs_interfaceid": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4ea0772d-fe7a-4ff8-9faf-d27f4c75e1ff req-4e9c352d-8ed8-4e09-8856-64925ddbff3f service nova] Releasing lock "refresh_cache-ed92e04a-56ec-42f1-bed3-8b28a37d1475" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG nova.network.neutron [req-d6855c3e-e236-4cc5-9763-cdc6213efb64 req-02b7cc9b-99d1-4401-a04f-0874836eb5e0 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Updated VIF entry in instance network info cache for port f18d71ff-8728-41e9-82bf-3d66e09e552a. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG nova.network.neutron [req-d6855c3e-e236-4cc5-9763-cdc6213efb64 req-02b7cc9b-99d1-4401-a04f-0874836eb5e0 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Updating instance_info_cache with network_info: [{"id": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "address": "fa:16:3e:a8:c1:72", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d71ff-87", "ovs_interfaceid": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:49:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d6855c3e-e236-4cc5-9763-cdc6213efb64 req-02b7cc9b-99d1-4401-a04f-0874836eb5e0 service nova] Releasing lock "refresh_cache-06216917-d7d1-4fd4-a311-e054437e84a6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:49:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-894d3cb4-b3ed-44eb-9b04-d7e3388bb5dd req-ce5f0e90-45c6-41fc-bcf0-1e90d59f5ae0 service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Received event network-vif-plugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-894d3cb4-b3ed-44eb-9b04-d7e3388bb5dd req-ce5f0e90-45c6-41fc-bcf0-1e90d59f5ae0 service nova] Acquiring lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-894d3cb4-b3ed-44eb-9b04-d7e3388bb5dd req-ce5f0e90-45c6-41fc-bcf0-1e90d59f5ae0 service nova] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-894d3cb4-b3ed-44eb-9b04-d7e3388bb5dd req-ce5f0e90-45c6-41fc-bcf0-1e90d59f5ae0 service nova] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-894d3cb4-b3ed-44eb-9b04-d7e3388bb5dd req-ce5f0e90-45c6-41fc-bcf0-1e90d59f5ae0 service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] No waiting events found dispatching network-vif-plugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:43 user nova-compute[75378]: WARNING nova.compute.manager [req-894d3cb4-b3ed-44eb-9b04-d7e3388bb5dd req-ce5f0e90-45c6-41fc-bcf0-1e90d59f5ae0 service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Received unexpected event network-vif-plugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 for instance with vm_state building and task_state spawning.
Nov 09 03:49:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:44 user nova-compute[75378]: INFO nova.compute.manager [None req-84335163-af13-474f-af7e-0f7406c1844e tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Unrescuing
Nov 09 03:49:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-84335163-af13-474f-af7e-0f7406c1844e tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:49:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-84335163-af13-474f-af7e-0f7406c1844e tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquired lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:49:44 user nova-compute[75378]: DEBUG nova.network.neutron [None req-84335163-af13-474f-af7e-0f7406c1844e tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:49:44 user nova-compute[75378]: DEBUG nova.network.neutron [None req-84335163-af13-474f-af7e-0f7406c1844e tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Updating instance_info_cache with network_info: [{"id": "e4725ee0-c613-48af-8163-eafad2605fff", "address": "fa:16:3e:89:f8:61", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4725ee0-c6", "ovs_interfaceid": "e4725ee0-c613-48af-8163-eafad2605fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:49:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-84335163-af13-474f-af7e-0f7406c1844e tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Releasing lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:49:44 user nova-compute[75378]: DEBUG nova.objects.instance [None req-84335163-af13-474f-af7e-0f7406c1844e tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'flavor' on Instance uuid 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:49:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:44 user nova-compute[75378]: DEBUG nova.compute.manager [req-dffc088e-6373-4c1a-a87a-0ba3138064cb req-a2291596-cd41-4b4c-8226-63f3a992bd81 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received event network-vif-unplugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-dffc088e-6373-4c1a-a87a-0ba3138064cb req-a2291596-cd41-4b4c-8226-63f3a992bd81 service nova] Acquiring lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-dffc088e-6373-4c1a-a87a-0ba3138064cb req-a2291596-cd41-4b4c-8226-63f3a992bd81 service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-dffc088e-6373-4c1a-a87a-0ba3138064cb req-a2291596-cd41-4b4c-8226-63f3a992bd81 service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:44 user nova-compute[75378]: DEBUG nova.compute.manager [req-dffc088e-6373-4c1a-a87a-0ba3138064cb req-a2291596-cd41-4b4c-8226-63f3a992bd81 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] No waiting events found dispatching network-vif-unplugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:44 user nova-compute[75378]: WARNING nova.compute.manager [req-dffc088e-6373-4c1a-a87a-0ba3138064cb req-a2291596-cd41-4b4c-8226-63f3a992bd81 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received unexpected event network-vif-unplugged-e4725ee0-c613-48af-8163-eafad2605fff for instance with vm_state rescued and task_state unrescuing.
Nov 09 03:49:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:45 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Instance destroyed successfully.
Nov 09 03:49:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-104f1234-6143-4e72-8162-dccab0a9703f req-0ddb1d54-789c-40b9-8392-c45c078be7df service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Received event network-vif-plugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-104f1234-6143-4e72-8162-dccab0a9703f req-0ddb1d54-789c-40b9-8392-c45c078be7df service nova] Acquiring lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-104f1234-6143-4e72-8162-dccab0a9703f req-0ddb1d54-789c-40b9-8392-c45c078be7df service nova] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-104f1234-6143-4e72-8162-dccab0a9703f req-0ddb1d54-789c-40b9-8392-c45c078be7df service nova] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-104f1234-6143-4e72-8162-dccab0a9703f req-0ddb1d54-789c-40b9-8392-c45c078be7df service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] No waiting events found dispatching network-vif-plugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:45 user nova-compute[75378]: WARNING nova.compute.manager [req-104f1234-6143-4e72-8162-dccab0a9703f req-0ddb1d54-789c-40b9-8392-c45c078be7df service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Received unexpected event network-vif-plugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 for instance with vm_state building and task_state spawning.
Nov 09 03:49:45 user nova-compute[75378]: DEBUG nova.compute.manager [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:49:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:49:45 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Instance spawned successfully.
Nov 09 03:49:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:49:46 user nova-compute[75378]: INFO nova.compute.manager [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 09 03:49:46 user nova-compute[75378]: DEBUG nova.compute.manager [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:49:46 user nova-compute[75378]: INFO nova.compute.manager [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Took 7.41 seconds to build instance.
Nov 09 03:49:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-571f943f-cd1e-4540-8719-05bb70657ab6 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.568s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-999961a6-d315-4729-a943-eeacfc20930a req-3b03c51f-506c-46ef-91a1-8436907733b8 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received event network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-999961a6-d315-4729-a943-eeacfc20930a req-3b03c51f-506c-46ef-91a1-8436907733b8 service nova] Acquiring lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-999961a6-d315-4729-a943-eeacfc20930a req-3b03c51f-506c-46ef-91a1-8436907733b8 service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-999961a6-d315-4729-a943-eeacfc20930a req-3b03c51f-506c-46ef-91a1-8436907733b8 service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-999961a6-d315-4729-a943-eeacfc20930a req-3b03c51f-506c-46ef-91a1-8436907733b8 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] No waiting events found dispatching network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:46 user nova-compute[75378]: WARNING nova.compute.manager [req-999961a6-d315-4729-a943-eeacfc20930a req-3b03c51f-506c-46ef-91a1-8436907733b8 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received unexpected event network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff for instance with vm_state rescued and task_state unrescuing.
Nov 09 03:49:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-999961a6-d315-4729-a943-eeacfc20930a req-3b03c51f-506c-46ef-91a1-8436907733b8 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received event network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-999961a6-d315-4729-a943-eeacfc20930a req-3b03c51f-506c-46ef-91a1-8436907733b8 service nova] Acquiring lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-999961a6-d315-4729-a943-eeacfc20930a req-3b03c51f-506c-46ef-91a1-8436907733b8 service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-999961a6-d315-4729-a943-eeacfc20930a req-3b03c51f-506c-46ef-91a1-8436907733b8 service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-999961a6-d315-4729-a943-eeacfc20930a req-3b03c51f-506c-46ef-91a1-8436907733b8 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] No waiting events found dispatching network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:46 user nova-compute[75378]: WARNING nova.compute.manager [req-999961a6-d315-4729-a943-eeacfc20930a req-3b03c51f-506c-46ef-91a1-8436907733b8 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received unexpected event network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff for instance with vm_state rescued and task_state unrescuing.
Nov 09 03:49:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaKxtveL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:49:48 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:49:48 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:49:48 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[821791bc-7343-4114-b085-1e34f84c269e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:49:48 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbef7a6-8934-48dc-94c5-1b014614944e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b] added
Nov 09 03:49:48 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2145d59f-505d-48c0-ac75-6dcab99bfdda]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[24902a8e-e2e6-4947-8fb2-892fd7bf94b0]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SaKxtveL {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SaKxtveL" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cd6995-0330-4667-9ee0-55c304d533c1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SaKxtveL'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[befa6c20-5915-4b12-a778-e2ede74deda1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85f3660-04c0-41f0-83a2-e7f06b2218ad]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:49:48 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:49:48 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:49:48 user nova-compute[75378]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:49:48 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:49:48 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:49:48 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:49:48 user nova-compute[75378]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:49:48 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12d0860-fa89-41a9-b35c-8ddb18be330d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b, portal: 172.16.0.220,3260]
Nov 09 03:49:48 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b, portal: 172.16.0.220,3260] successful.
Nov 09 03:49:48 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[236b2ae7-6163-4867-9d50-bb1082886ab6]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c06a85d-2d85-47ad-8606-5b849ea97fb7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:49:48 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:49:48 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:49:48 user nova-compute[75378]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:49:48 user nova-compute[75378]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b (non-flash)
Nov 09 03:49:48 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:49:48 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:49:48 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:49:48 user nova-compute[75378]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:49:48 user nova-compute[75378]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b (non-flash)
Nov 09 03:49:48 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[faab8562-65d7-48f0-9214-3c8bcf1e9e33]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: None {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG nova.compute.manager [req-0719bed6-21ac-486d-bc31-ae2eb5411dec req-3b6b673d-3800-4631-982c-81d99e226c54 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received event network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0719bed6-21ac-486d-bc31-ae2eb5411dec req-3b6b673d-3800-4631-982c-81d99e226c54 service nova] Acquiring lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0719bed6-21ac-486d-bc31-ae2eb5411dec req-3b6b673d-3800-4631-982c-81d99e226c54 service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0719bed6-21ac-486d-bc31-ae2eb5411dec req-3b6b673d-3800-4631-982c-81d99e226c54 service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:48 user nova-compute[75378]: DEBUG nova.compute.manager [req-0719bed6-21ac-486d-bc31-ae2eb5411dec req-3b6b673d-3800-4631-982c-81d99e226c54 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] No waiting events found dispatching network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:48 user nova-compute[75378]: WARNING nova.compute.manager [req-0719bed6-21ac-486d-bc31-ae2eb5411dec req-3b6b673d-3800-4631-982c-81d99e226c54 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received unexpected event network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff for instance with vm_state rescued and task_state unrescuing.
Nov 09 03:49:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-84335163-af13-474f-af7e-0f7406c1844e tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:49:49 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:49:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaKxtveL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:49:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:49:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23831643631656365', 'path': '/dev/sde'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:49:49 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831643631656365', 'path': '/dev/sde'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:49:49 user nova-compute[75378]: DEBUG nova.objects.instance [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lazy-loading 'flavor' on Instance uuid cc4b9517-2616-4cfb-82f7-8379f4619962 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:49:49 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 03:49:49 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:49:49 user nova-compute[75378]:   <source dev="/dev/sde"/>
Nov 09 03:49:49 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:49:49 user nova-compute[75378]:   <serial>b897f0d3-7b21-4726-a40d-3ce9849a386b</serial>
Nov 09 03:49:49 user nova-compute[75378]: </disk>
Nov 09 03:49:49 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 03:49:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:49:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:49:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] No VIF found with MAC fa:16:3e:99:9a:c5, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:49:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-10f101f6-0820-431d-94f6-32aacee26807 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "cc4b9517-2616-4cfb-82f7-8379f4619962" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.616s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Acquiring lock "cc4b9517-2616-4cfb-82f7-8379f4619962" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "cc4b9517-2616-4cfb-82f7-8379f4619962" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:52 user nova-compute[75378]: INFO nova.compute.manager [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Detaching volume b897f0d3-7b21-4726-a40d-3ce9849a386b
Nov 09 03:49:52 user nova-compute[75378]: INFO nova.virt.block_device [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Attempting to driver detach volume b897f0d3-7b21-4726-a40d-3ce9849a386b from mountpoint /dev/vdb
Nov 09 03:49:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Attempting to detach device vdb from instance cc4b9517-2616-4cfb-82f7-8379f4619962 from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 03:49:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:49:52 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:49:52 user nova-compute[75378]:   <source dev="/dev/sde"/>
Nov 09 03:49:52 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:49:52 user nova-compute[75378]:   <serial>b897f0d3-7b21-4726-a40d-3ce9849a386b</serial>
Nov 09 03:49:52 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 03:49:52 user nova-compute[75378]: </disk>
Nov 09 03:49:52 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:49:52 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Successfully detached device vdb from instance cc4b9517-2616-4cfb-82f7-8379f4619962 from the persistent domain config.
Nov 09 03:49:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc4b9517-2616-4cfb-82f7-8379f4619962 from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 03:49:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:49:52 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:49:52 user nova-compute[75378]:   <source dev="/dev/sde"/>
Nov 09 03:49:52 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:49:52 user nova-compute[75378]:   <serial>b897f0d3-7b21-4726-a40d-3ce9849a386b</serial>
Nov 09 03:49:52 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 03:49:52 user nova-compute[75378]: </disk>
Nov 09 03:49:52 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:49:53 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc4b9517-2616-4cfb-82f7-8379f4619962 {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 03:49:54 user nova-compute[75378]: INFO nova.compute.manager [None req-b8bbc61e-2a07-4224-99d4-04e6404f546d tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Unrescuing
Nov 09 03:49:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b8bbc61e-2a07-4224-99d4-04e6404f546d tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "refresh_cache-013db901-fbee-4593-a14f-95a03e79fad0" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:49:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b8bbc61e-2a07-4224-99d4-04e6404f546d tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquired lock "refresh_cache-013db901-fbee-4593-a14f-95a03e79fad0" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:49:54 user nova-compute[75378]: DEBUG nova.network.neutron [None req-b8bbc61e-2a07-4224-99d4-04e6404f546d tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:49:55 user nova-compute[75378]: DEBUG nova.network.neutron [None req-b8bbc61e-2a07-4224-99d4-04e6404f546d tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Updating instance_info_cache with network_info: [{"id": "5650a4a6-f99d-42e2-8b94-f18562892154", "address": "fa:16:3e:7f:95:df", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5650a4a6-f9", "ovs_interfaceid": "5650a4a6-f99d-42e2-8b94-f18562892154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:49:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b8bbc61e-2a07-4224-99d4-04e6404f546d tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Releasing lock "refresh_cache-013db901-fbee-4593-a14f-95a03e79fad0" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:49:55 user nova-compute[75378]: DEBUG nova.objects.instance [None req-b8bbc61e-2a07-4224-99d4-04e6404f546d tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'flavor' on Instance uuid 013db901-fbee-4593-a14f-95a03e79fad0 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:49:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-18abe6b1-02e5-49ec-973a-949ff72ba824 req-509fb7db-7242-42ab-ac95-32cd50d47df5 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received event network-vif-unplugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-18abe6b1-02e5-49ec-973a-949ff72ba824 req-509fb7db-7242-42ab-ac95-32cd50d47df5 service nova] Acquiring lock "013db901-fbee-4593-a14f-95a03e79fad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-18abe6b1-02e5-49ec-973a-949ff72ba824 req-509fb7db-7242-42ab-ac95-32cd50d47df5 service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-18abe6b1-02e5-49ec-973a-949ff72ba824 req-509fb7db-7242-42ab-ac95-32cd50d47df5 service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-18abe6b1-02e5-49ec-973a-949ff72ba824 req-509fb7db-7242-42ab-ac95-32cd50d47df5 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] No waiting events found dispatching network-vif-unplugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:55 user nova-compute[75378]: WARNING nova.compute.manager [req-18abe6b1-02e5-49ec-973a-949ff72ba824 req-509fb7db-7242-42ab-ac95-32cd50d47df5 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received unexpected event network-vif-unplugged-5650a4a6-f99d-42e2-8b94-f18562892154 for instance with vm_state rescued and task_state unrescuing.
Nov 09 03:49:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:56 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Instance destroyed successfully.
Nov 09 03:49:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "06216917-d7d1-4fd4-a311-e054437e84a6" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "06216917-d7d1-4fd4-a311-e054437e84a6" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:56 user nova-compute[75378]: INFO nova.compute.manager [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Rebooting instance
Nov 09 03:49:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "refresh_cache-06216917-d7d1-4fd4-a311-e054437e84a6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:49:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquired lock "refresh_cache-06216917-d7d1-4fd4-a311-e054437e84a6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:49:57 user nova-compute[75378]: DEBUG nova.network.neutron [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:49:57 user nova-compute[75378]: DEBUG nova.network.neutron [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Updating instance_info_cache with network_info: [{"id": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "address": "fa:16:3e:a8:c1:72", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d71ff-87", "ovs_interfaceid": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:49:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Releasing lock "refresh_cache-06216917-d7d1-4fd4-a311-e054437e84a6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:49:57 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:49:57 user nova-compute[75378]: DEBUG nova.compute.manager [req-a8f3873f-d004-48c7-9af7-1f5a2bc0b44f req-a737aaa6-8c37-4c55-8dab-329efd8034b0 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received event network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a8f3873f-d004-48c7-9af7-1f5a2bc0b44f req-a737aaa6-8c37-4c55-8dab-329efd8034b0 service nova] Acquiring lock "013db901-fbee-4593-a14f-95a03e79fad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a8f3873f-d004-48c7-9af7-1f5a2bc0b44f req-a737aaa6-8c37-4c55-8dab-329efd8034b0 service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a8f3873f-d004-48c7-9af7-1f5a2bc0b44f req-a737aaa6-8c37-4c55-8dab-329efd8034b0 service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:57 user nova-compute[75378]: DEBUG nova.compute.manager [req-a8f3873f-d004-48c7-9af7-1f5a2bc0b44f req-a737aaa6-8c37-4c55-8dab-329efd8034b0 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] No waiting events found dispatching network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:57 user nova-compute[75378]: WARNING nova.compute.manager [req-a8f3873f-d004-48c7-9af7-1f5a2bc0b44f req-a737aaa6-8c37-4c55-8dab-329efd8034b0 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received unexpected event network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 for instance with vm_state rescued and task_state unrescuing.
Nov 09 03:49:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:58 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Instance destroyed successfully.
Nov 09 03:49:58 user nova-compute[75378]: DEBUG nova.objects.instance [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lazy-loading 'resources' on Instance uuid 06216917-d7d1-4fd4-a311-e054437e84a6 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-268422201',display_name='tempest-TestMinimumBasicScenario-server-268422201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-268422201',id=23,image_ref='fe7e0145-3989-490e-8549-fd04c87b1bbf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5VUjQfePCJPThtosrWik/90Fev8SLx+lXghUWZ7Pux7J0g9Au910Z2/wthgd64k+5gb04TiVYNIeAHiEXl7UMhYOVayzfgzu7ZgyfjQfyON+xr+Xu4JclsIwlyTILmzA==',key_name='tempest-TestMinimumBasicScenario-2091302230',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:46:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a02ac142a06244ef9819e09b22e4a941',ramdisk_id='',reservation_id='r-kzrp4n1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe7e0145-3989-490e-8549-fd04c87b1bbf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-322168895',owner_user_name='tempest-TestMinimumBasicScenario-322168895-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:49:58Z,user_data=None,user_id='b74e4631d102431f83fe51fc39a3768a',uuid=06216917-d7d1-4fd4-a311-e054437e84a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "address": "fa:16:3e:a8:c1:72", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d71ff-87", "ovs_interfaceid": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Converting VIF {"id": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "address": "fa:16:3e:a8:c1:72", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d71ff-87", "ovs_interfaceid": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:c1:72,bridge_name='br-int',has_traffic_filtering=True,id=f18d71ff-8728-41e9-82bf-3d66e09e552a,network=Network(5fa0c6e5-0332-4a5f-b866-8f823ceaa13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d71ff-87') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG os_vif [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:c1:72,bridge_name='br-int',has_traffic_filtering=True,id=f18d71ff-8728-41e9-82bf-3d66e09e552a,network=Network(5fa0c6e5-0332-4a5f-b866-8f823ceaa13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d71ff-87') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf18d71ff-87, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f90cab8b-1728-4b2d-a125-749990dc77b9) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:49:58 user nova-compute[75378]: INFO os_vif [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:c1:72,bridge_name='br-int',has_traffic_filtering=True,id=f18d71ff-8728-41e9-82bf-3d66e09e552a,network=Network(5fa0c6e5-0332-4a5f-b866-8f823ceaa13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d71ff-87')
Nov 09 03:49:58 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrnGeLFz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:49:58 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:49:58 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b6abdb-9ef5-442e-a892-fe7381fcc549]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:49:58 user nova-compute[75378]: No targets found.
Nov 09 03:49:58 user nova-compute[75378]: iSNS:
Nov 09 03:49:58 user nova-compute[75378]: No targets found.
Nov 09 03:49:58 user nova-compute[75378]: STATIC:
Nov 09 03:49:58 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f
Nov 09 03:49:58 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:49:58 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:49:58 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 03:49:58 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:49:58 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:49:58 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75
Nov 09 03:49:58 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:49:58 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:49:58 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b
Nov 09 03:49:58 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:49:58 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:49:58 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09
Nov 09 03:49:58 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:49:58 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:49:58 user nova-compute[75378]: FIRMWARE:
Nov 09 03:49:58 user nova-compute[75378]: No targets found.
Nov 09 03:49:58 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:49:58 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:49:58 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f317c65-2986-464d-b341-d0cc7b1091ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bb2db4-101c-47f5-85da-6a17e12873aa]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:49:58 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:49:58 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:49:58 user nova-compute[75378]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:49:58 user nova-compute[75378]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b (non-flash)
Nov 09 03:49:58 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:49:58 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:49:58 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:49:58 user nova-compute[75378]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:49:58 user nova-compute[75378]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b (non-flash)
Nov 09 03:49:58 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c612170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75'): ({'sdd'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Removing single pathed devices sdd {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:49:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30a13fa-772e-4af8-9782-c2d3fcc08c65]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cad267-bc75-41cb-b276-25e7457a8556]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Flushing IO for device /dev/sdd {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0b3853-1a60-4387-9088-a3937e092eac]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[600380cd-0b3d-4eff-9beb-863169b143a1]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] SCSI volumes sdd have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f770177-a87b-4097-89e7-91926f210186]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02e4ea8-47d3-445e-8066-12173ad6cc6e]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75, portal: 172.16.0.220,3260]
Nov 09 03:49:59 user nova-compute[75378]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75, portal: 172.16.0.220,3260] successful.
Nov 09 03:49:59 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d3ac24-402f-4489-af7d-6c0aba51438a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.446s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] <== disconnect_volume: return (447ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Start _get_guest_xml network_info=[{"id": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "address": "fa:16:3e:a8:c1:72", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d71ff-87", "ovs_interfaceid": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fe7e0145-3989-490e-8549-fd04c87b1bbf,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'fe7e0145-3989-490e-8549-fd04c87b1bbf'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrnGeLFz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '06216917-d7d1-4fd4-a311-e054437e84a6', 'attached_at': '', 'detached_at': '', 'volume_id': '2fdd9b92-de5f-4df9-9994-444624a88b75', 'serial': '2fdd9b92-de5f-4df9-9994-444624a88b75'}, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'attachment_id': 'bd7a54c5-744f-4cd7-a39f-5c440cd6d23b', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:49:59 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:49:59 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fe7e0145-3989-490e-8549-fd04c87b1bbf,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.objects.instance [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lazy-loading 'vcpu_model' on Instance uuid 06216917-d7d1-4fd4-a311-e054437e84a6 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.objects.base [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Object Instance<06216917-d7d1-4fd4-a311-e054437e84a6> lazy-loaded attributes: resources,vcpu_model {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrnGeLFz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:49:59 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:49:59 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:49:59 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dde7ab-f9df-4e47-a0e5-c568487212c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:49:59 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c836c9be-da25-48d0-8054-7b10253dbd15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75] added
Nov 09 03:49:59 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0bdd11-8d65-4c30-a2ab-8d35a2a799c0]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00709a8-f282-480d-8c1b-e13d7ef517fb]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DrnGeLFz {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DrnGeLFz" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84a6550-1a60-4b43-b9d8-e14336f34d20]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DrnGeLFz'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[deccb2a9-bdab-4ed5-8395-c6fb50ddef58]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee59e325-2481-4f5a-a5bd-615330b40b6b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:49:59 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:49:59 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:49:59 user nova-compute[75378]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b (non-flash)
Nov 09 03:49:59 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:49:59 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:49:59 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:49:59 user nova-compute[75378]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b (non-flash)
Nov 09 03:49:59 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aeb5fdd-f618-4403-91ea-05873b81b74b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75, portal: 172.16.0.220,3260]
Nov 09 03:49:59 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75, portal: 172.16.0.220,3260] successful.
Nov 09 03:49:59 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c60e05-a1a4-4419-ada8-d040f8df7693]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bd13b6-6194-4808-bdb9-3888563deb2b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:49:59 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:49:59 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:49:59 user nova-compute[75378]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b (non-flash)
Nov 09 03:49:59 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:49:59 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:49:59 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:49:59 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:49:59 user nova-compute[75378]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b (non-flash)
Nov 09 03:49:59 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:49:59 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fb2bcf-0509-4fb4-b722-f50efa71437d]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrnGeLFz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Received event network-vif-unplugged-f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] Acquiring lock "06216917-d7d1-4fd4-a311-e054437e84a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] Lock "06216917-d7d1-4fd4-a311-e054437e84a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] Lock "06216917-d7d1-4fd4-a311-e054437e84a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] No waiting events found dispatching network-vif-unplugged-f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:59 user nova-compute[75378]: WARNING nova.compute.manager [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Received unexpected event network-vif-unplugged-f18d71ff-8728-41e9-82bf-3d66e09e552a for instance with vm_state active and task_state reboot_started_hard.
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Received event network-vif-plugged-f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] Acquiring lock "06216917-d7d1-4fd4-a311-e054437e84a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] Lock "06216917-d7d1-4fd4-a311-e054437e84a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] Lock "06216917-d7d1-4fd4-a311-e054437e84a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] No waiting events found dispatching network-vif-plugged-f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:59 user nova-compute[75378]: WARNING nova.compute.manager [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Received unexpected event network-vif-plugged-f18d71ff-8728-41e9-82bf-3d66e09e552a for instance with vm_state active and task_state reboot_started_hard.
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received event network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] Acquiring lock "013db901-fbee-4593-a14f-95a03e79fad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] No waiting events found dispatching network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:59 user nova-compute[75378]: WARNING nova.compute.manager [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received unexpected event network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 for instance with vm_state rescued and task_state unrescuing.
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received event network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] Acquiring lock "013db901-fbee-4593-a14f-95a03e79fad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:49:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] No waiting events found dispatching network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:49:59 user nova-compute[75378]: WARNING nova.compute.manager [req-256ada3c-d86f-4184-8381-1eae256c6183 req-83156d62-9a49-4c02-88c0-c55ab06750b4 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received unexpected event network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 for instance with vm_state rescued and task_state unrescuing.
Nov 09 03:50:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:50:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23539613338323965', 'path': '/dev/sdd'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:50:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539613338323965', 'path': '/dev/sdd'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:50:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-268422201',display_name='tempest-TestMinimumBasicScenario-server-268422201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-268422201',id=23,image_ref='fe7e0145-3989-490e-8549-fd04c87b1bbf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5VUjQfePCJPThtosrWik/90Fev8SLx+lXghUWZ7Pux7J0g9Au910Z2/wthgd64k+5gb04TiVYNIeAHiEXl7UMhYOVayzfgzu7ZgyfjQfyON+xr+Xu4JclsIwlyTILmzA==',key_name='tempest-TestMinimumBasicScenario-2091302230',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:46:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a02ac142a06244ef9819e09b22e4a941',ramdisk_id='',reservation_id='r-kzrp4n1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe7e0145-3989-490e-8549-fd04c87b1bbf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-322168895',owner_user_name='tempest-TestMinimumBasicScenario-322168895-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:49:58Z,user_data=None,user_id='b74e4631d102431f83fe51fc39a3768a',uuid=06216917-d7d1-4fd4-a311-e054437e84a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "address": "fa:16:3e:a8:c1:72", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d71ff-87", "ovs_interfaceid": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:50:00 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Converting VIF {"id": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "address": "fa:16:3e:a8:c1:72", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d71ff-87", "ovs_interfaceid": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:50:00 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:c1:72,bridge_name='br-int',has_traffic_filtering=True,id=f18d71ff-8728-41e9-82bf-3d66e09e552a,network=Network(5fa0c6e5-0332-4a5f-b866-8f823ceaa13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d71ff-87') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:50:00 user nova-compute[75378]: DEBUG nova.objects.instance [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lazy-loading 'pci_devices' on Instance uuid 06216917-d7d1-4fd4-a311-e054437e84a6 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:50:00 user nova-compute[75378]: DEBUG nova.objects.base [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Object Instance<06216917-d7d1-4fd4-a311-e054437e84a6> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:50:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:50:00 user nova-compute[75378]:   <uuid>06216917-d7d1-4fd4-a311-e054437e84a6</uuid>
Nov 09 03:50:00 user nova-compute[75378]:   <name>instance-00000017</name>
Nov 09 03:50:00 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:50:00 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:50:00 user nova-compute[75378]:   <metadata>
Nov 09 03:50:00 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:50:00 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:50:00 user nova-compute[75378]:       <nova:name>tempest-TestMinimumBasicScenario-server-268422201</nova:name>
Nov 09 03:50:00 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:49:59</nova:creationTime>
Nov 09 03:50:00 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:50:00 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:50:00 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:50:00 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:50:00 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:50:00 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:50:00 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:50:00 user nova-compute[75378]:       <nova:owner>
Nov 09 03:50:00 user nova-compute[75378]:         <nova:user uuid="b74e4631d102431f83fe51fc39a3768a">tempest-TestMinimumBasicScenario-322168895-project-member</nova:user>
Nov 09 03:50:00 user nova-compute[75378]:         <nova:project uuid="a02ac142a06244ef9819e09b22e4a941">tempest-TestMinimumBasicScenario-322168895</nova:project>
Nov 09 03:50:00 user nova-compute[75378]:       </nova:owner>
Nov 09 03:50:00 user nova-compute[75378]:       <nova:root type="image" uuid="fe7e0145-3989-490e-8549-fd04c87b1bbf"/>
Nov 09 03:50:00 user nova-compute[75378]:       <nova:ports>
Nov 09 03:50:00 user nova-compute[75378]:         <nova:port uuid="f18d71ff-8728-41e9-82bf-3d66e09e552a">
Nov 09 03:50:00 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 09 03:50:00 user nova-compute[75378]:         </nova:port>
Nov 09 03:50:00 user nova-compute[75378]:       </nova:ports>
Nov 09 03:50:00 user nova-compute[75378]:     </nova:instance>
Nov 09 03:50:00 user nova-compute[75378]:   </metadata>
Nov 09 03:50:00 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:50:00 user nova-compute[75378]:     <system>
Nov 09 03:50:00 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:50:00 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:50:00 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:50:00 user nova-compute[75378]:       <entry name="serial">06216917-d7d1-4fd4-a311-e054437e84a6</entry>
Nov 09 03:50:00 user nova-compute[75378]:       <entry name="uuid">06216917-d7d1-4fd4-a311-e054437e84a6</entry>
Nov 09 03:50:00 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:50:00 user nova-compute[75378]:     </system>
Nov 09 03:50:00 user nova-compute[75378]:   </sysinfo>
Nov 09 03:50:00 user nova-compute[75378]:   <os>
Nov 09 03:50:00 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:50:00 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:50:00 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:50:00 user nova-compute[75378]:   </os>
Nov 09 03:50:00 user nova-compute[75378]:   <features>
Nov 09 03:50:00 user nova-compute[75378]:     <acpi/>
Nov 09 03:50:00 user nova-compute[75378]:     <apic/>
Nov 09 03:50:00 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:50:00 user nova-compute[75378]:   </features>
Nov 09 03:50:00 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:50:00 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:50:00 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:50:00 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:50:00 user nova-compute[75378]:   </clock>
Nov 09 03:50:00 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:50:00 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:50:00 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:50:00 user nova-compute[75378]:   </cpu>
Nov 09 03:50:00 user nova-compute[75378]:   <devices>
Nov 09 03:50:00 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:50:00 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:50:00 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk"/>
Nov 09 03:50:00 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:50:00 user nova-compute[75378]:     </disk>
Nov 09 03:50:00 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 03:50:00 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:50:00 user nova-compute[75378]:       <source dev="/dev/sdd"/>
Nov 09 03:50:00 user nova-compute[75378]:       <target dev="vdb" bus="virtio"/>
Nov 09 03:50:00 user nova-compute[75378]:       <serial>2fdd9b92-de5f-4df9-9994-444624a88b75</serial>
Nov 09 03:50:00 user nova-compute[75378]:     </disk>
Nov 09 03:50:00 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:50:00 user nova-compute[75378]:       <mac address="fa:16:3e:a8:c1:72"/>
Nov 09 03:50:00 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:50:00 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:50:00 user nova-compute[75378]:       <target dev="tapf18d71ff-87"/>
Nov 09 03:50:00 user nova-compute[75378]:     </interface>
Nov 09 03:50:00 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:50:00 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/console.log" append="off"/>
Nov 09 03:50:00 user nova-compute[75378]:     </serial>
Nov 09 03:50:00 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:50:00 user nova-compute[75378]:     <video>
Nov 09 03:50:00 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:50:00 user nova-compute[75378]:     </video>
Nov 09 03:50:00 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:50:00 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:50:00 user nova-compute[75378]:     </rng>
Nov 09 03:50:00 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:50:00 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:50:00 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:50:00 user nova-compute[75378]:     </memballoon>
Nov 09 03:50:00 user nova-compute[75378]:   </devices>
Nov 09 03:50:00 user nova-compute[75378]: </domain>
Nov 09 03:50:00 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:50:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:00 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b8bbc61e-2a07-4224-99d4-04e6404f546d tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG nova.objects.instance [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lazy-loading 'trusted_certs' on Instance uuid 06216917-d7d1-4fd4-a311-e054437e84a6 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG nova.objects.base [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Object Instance<06216917-d7d1-4fd4-a311-e054437e84a6> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d1604518a003fe86603e461a25fba6eadd5aed --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d1604518a003fe86603e461a25fba6eadd5aed --force-share --output=json" returned: 0 in 0.182s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Cannot resize image /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG nova.objects.instance [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lazy-loading 'migration_context' on Instance uuid 06216917-d7d1-4fd4-a311-e054437e84a6 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG nova.objects.base [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Object Instance<06216917-d7d1-4fd4-a311-e054437e84a6> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-268422201',display_name='tempest-TestMinimumBasicScenario-server-268422201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-268422201',id=23,image_ref='fe7e0145-3989-490e-8549-fd04c87b1bbf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5VUjQfePCJPThtosrWik/90Fev8SLx+lXghUWZ7Pux7J0g9Au910Z2/wthgd64k+5gb04TiVYNIeAHiEXl7UMhYOVayzfgzu7ZgyfjQfyON+xr+Xu4JclsIwlyTILmzA==',key_name='tempest-TestMinimumBasicScenario-2091302230',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:46:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='a02ac142a06244ef9819e09b22e4a941',ramdisk_id='',reservation_id='r-kzrp4n1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe7e0145-3989-490e-8549-fd04c87b1bbf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-322168895',owner_user_name='tempest-TestMinimumBasicScenario-322168895-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:49:58Z,user_data=None,user_id='b74e4631d102431f83fe51fc39a3768a',uuid=06216917-d7d1-4fd4-a311-e054437e84a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "address": "fa:16:3e:a8:c1:72", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d71ff-87", "ovs_interfaceid": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Converting VIF {"id": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "address": "fa:16:3e:a8:c1:72", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d71ff-87", "ovs_interfaceid": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:c1:72,bridge_name='br-int',has_traffic_filtering=True,id=f18d71ff-8728-41e9-82bf-3d66e09e552a,network=Network(5fa0c6e5-0332-4a5f-b866-8f823ceaa13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d71ff-87') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG os_vif [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:c1:72,bridge_name='br-int',has_traffic_filtering=True,id=f18d71ff-8728-41e9-82bf-3d66e09e552a,network=Network(5fa0c6e5-0332-4a5f-b866-8f823ceaa13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d71ff-87') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e6b1782-a9fa-55b8-98af-e9c3ac25070d', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf18d71ff-87, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf18d71ff-87, col_values=(('qos', UUID('abc29a55-9369-4c49-94cf-74ce745cdd6d')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf18d71ff-87, col_values=(('external_ids', {'iface-id': 'f18d71ff-8728-41e9-82bf-3d66e09e552a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:c1:72', 'vm-uuid': '06216917-d7d1-4fd4-a311-e054437e84a6'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:01 user nova-compute[75378]: INFO os_vif [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:c1:72,bridge_name='br-int',has_traffic_filtering=True,id=f18d71ff-8728-41e9-82bf-3d66e09e552a,network=Network(5fa0c6e5-0332-4a5f-b866-8f823ceaa13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d71ff-87')
Nov 09 03:50:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-29b0dcda-20fc-4fda-a922-55f676566fab req-7639cd6b-ae98-48ec-8152-40e3168bce27 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Received event network-vif-plugged-f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:50:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-29b0dcda-20fc-4fda-a922-55f676566fab req-7639cd6b-ae98-48ec-8152-40e3168bce27 service nova] Acquiring lock "06216917-d7d1-4fd4-a311-e054437e84a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:50:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-29b0dcda-20fc-4fda-a922-55f676566fab req-7639cd6b-ae98-48ec-8152-40e3168bce27 service nova] Lock "06216917-d7d1-4fd4-a311-e054437e84a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:50:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-29b0dcda-20fc-4fda-a922-55f676566fab req-7639cd6b-ae98-48ec-8152-40e3168bce27 service nova] Lock "06216917-d7d1-4fd4-a311-e054437e84a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:50:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-29b0dcda-20fc-4fda-a922-55f676566fab req-7639cd6b-ae98-48ec-8152-40e3168bce27 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] No waiting events found dispatching network-vif-plugged-f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:50:03 user nova-compute[75378]: WARNING nova.compute.manager [req-29b0dcda-20fc-4fda-a922-55f676566fab req-7639cd6b-ae98-48ec-8152-40e3168bce27 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Received unexpected event network-vif-plugged-f18d71ff-8728-41e9-82bf-3d66e09e552a for instance with vm_state active and task_state reboot_started_hard.
Nov 09 03:50:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:05 user nova-compute[75378]: DEBUG nova.compute.manager [req-8ae41158-18dc-4d8d-98a8-d03796f8c995 req-75c36fd0-af67-4a62-bf61-9961e3b4b0b7 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Received event network-vif-plugged-f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:50:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8ae41158-18dc-4d8d-98a8-d03796f8c995 req-75c36fd0-af67-4a62-bf61-9961e3b4b0b7 service nova] Acquiring lock "06216917-d7d1-4fd4-a311-e054437e84a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:50:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8ae41158-18dc-4d8d-98a8-d03796f8c995 req-75c36fd0-af67-4a62-bf61-9961e3b4b0b7 service nova] Lock "06216917-d7d1-4fd4-a311-e054437e84a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:50:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8ae41158-18dc-4d8d-98a8-d03796f8c995 req-75c36fd0-af67-4a62-bf61-9961e3b4b0b7 service nova] Lock "06216917-d7d1-4fd4-a311-e054437e84a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:50:05 user nova-compute[75378]: DEBUG nova.compute.manager [req-8ae41158-18dc-4d8d-98a8-d03796f8c995 req-75c36fd0-af67-4a62-bf61-9961e3b4b0b7 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] No waiting events found dispatching network-vif-plugged-f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:50:05 user nova-compute[75378]: WARNING nova.compute.manager [req-8ae41158-18dc-4d8d-98a8-d03796f8c995 req-75c36fd0-af67-4a62-bf61-9961e3b4b0b7 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Received unexpected event network-vif-plugged-f18d71ff-8728-41e9-82bf-3d66e09e552a for instance with vm_state active and task_state reboot_started_hard.
Nov 09 03:50:05 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:50:05 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Instance rebooted successfully.
Nov 09 03:50:05 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:50:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b121355b-fabc-406f-b67c-7788cb8d3831 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "06216917-d7d1-4fd4-a311-e054437e84a6" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.686s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:50:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:13 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cc4b9517-2616-4cfb-82f7-8379f4619962 is timed out.
Nov 09 03:50:13 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Successfully detached device vdb from instance cc4b9517-2616-4cfb-82f7-8379f4619962 from the live domain config.
Nov 09 03:50:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaKxtveL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:50:13 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:50:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.052s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6044ecd8-da9a-4cc7-86cc-72c894356268]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:50:13 user nova-compute[75378]: No targets found.
Nov 09 03:50:13 user nova-compute[75378]: iSNS:
Nov 09 03:50:13 user nova-compute[75378]: No targets found.
Nov 09 03:50:13 user nova-compute[75378]: STATIC:
Nov 09 03:50:13 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f
Nov 09 03:50:13 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:50:13 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:50:13 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 03:50:13 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:50:13 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:50:13 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75
Nov 09 03:50:13 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:50:13 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:50:13 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b
Nov 09 03:50:13 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:50:13 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:50:13 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09
Nov 09 03:50:13 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:50:13 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:50:13 user nova-compute[75378]: FIRMWARE:
Nov 09 03:50:13 user nova-compute[75378]: No targets found.
Nov 09 03:50:13 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:50:13 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:50:13 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c06f81-63bd-47a3-8cc9-c29580d50b59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bf6b66-19fa-4c7c-ba05-9657a4064303]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:50:13 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:50:13 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:50:13 user nova-compute[75378]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b (non-flash)
Nov 09 03:50:13 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:50:13 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:50:13 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:50:13 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:50:13 user nova-compute[75378]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b (non-flash)
Nov 09 03:50:13 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:50:13 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c5784c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b'): ({'sde'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Removing single pathed devices sde {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a787f71-bd8a-4f37-bd42-d5de5e75dc69]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22e1c08-8167-4e5f-8bab-d471df67402f]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Flushing IO for device /dev/sde {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[420cfb25-adf0-46cc-a812-f1ba208b2416]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e6a9e0-221f-4ab0-8438-c8ff6568d214]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] SCSI volumes sde have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c936f2-64b4-4af4-bdf4-c6ac471aff4c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d91512-9897-4cd0-a378-4299f7c32792]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b, portal: 172.16.0.220,3260]
Nov 09 03:50:13 user nova-compute[75378]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b, portal: 172.16.0.220,3260] successful.
Nov 09 03:50:13 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b897f0d3-7b21-4726-a40d-3ce9849a386b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3bd387-4809-4c93-8e6d-5bd48aca7d39]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] <== disconnect_volume: return (378ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:50:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:50:14 user nova-compute[75378]: DEBUG nova.objects.instance [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lazy-loading 'flavor' on Instance uuid cc4b9517-2616-4cfb-82f7-8379f4619962 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:50:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-450d10d2-463d-4c08-a1e3-6d6fff7a4a63 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "cc4b9517-2616-4cfb-82f7-8379f4619962" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.300s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:50:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Acquiring lock "7e12539b-36a3-4691-89fd-e3d155de38d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Acquiring lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:50:27 user nova-compute[75378]: INFO nova.compute.manager [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Terminating instance
Nov 09 03:50:27 user nova-compute[75378]: DEBUG nova.compute.manager [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-f52d806d-8810-4464-8c53-fb406bb558ea req-bca91d0a-df1f-4850-b0c8-95c4415881d2 service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Received event network-vif-unplugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f52d806d-8810-4464-8c53-fb406bb558ea req-bca91d0a-df1f-4850-b0c8-95c4415881d2 service nova] Acquiring lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f52d806d-8810-4464-8c53-fb406bb558ea req-bca91d0a-df1f-4850-b0c8-95c4415881d2 service nova] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f52d806d-8810-4464-8c53-fb406bb558ea req-bca91d0a-df1f-4850-b0c8-95c4415881d2 service nova] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-f52d806d-8810-4464-8c53-fb406bb558ea req-bca91d0a-df1f-4850-b0c8-95c4415881d2 service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] No waiting events found dispatching network-vif-unplugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-f52d806d-8810-4464-8c53-fb406bb558ea req-bca91d0a-df1f-4850-b0c8-95c4415881d2 service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Received event network-vif-unplugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:50:27 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Instance destroyed successfully.
Nov 09 03:50:27 user nova-compute[75378]: DEBUG nova.objects.instance [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lazy-loading 'resources' on Instance uuid 7e12539b-36a3-4691-89fd-e3d155de38d7 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T03:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1744791017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-630224360',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOf5txPg6ouZaGGPli9fXk7MU4joWJGx02BisK3zQA1UKJLHy2CmfWE/XCnKG3U7ArzcfKvhfDz+mZTrfgm201boyTYwnA7PPwqn4OBn8OrHRJiyu0bpUTMNWI1J7qAdA==',key_name='tempest-keypair-1307438617',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:48:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21784a1d205749fd9a4459fe6605a481',ramdisk_id='',reservation_id='r-6evkz0hg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1531549411',owner_user_name='tempest-ServerActionsV293TestJSON-1531549411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:48:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9e8d4eb00ea4ae5878183644245516f',uuid=7e12539b-36a3-4691-89fd-e3d155de38d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "address": "fa:16:3e:3e:8c:6a", "network": {"id": "ba3f17d0-18fb-4a96-a48a-ea93768ee358", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1139879701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21784a1d205749fd9a4459fe6605a481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7419-ed", "ovs_interfaceid": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Converting VIF {"id": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "address": "fa:16:3e:3e:8c:6a", "network": {"id": "ba3f17d0-18fb-4a96-a48a-ea93768ee358", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1139879701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21784a1d205749fd9a4459fe6605a481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7419-ed", "ovs_interfaceid": "d0ea7419-ed5d-43af-86c6-57db8d9382e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:8c:6a,bridge_name='br-int',has_traffic_filtering=True,id=d0ea7419-ed5d-43af-86c6-57db8d9382e0,network=Network(ba3f17d0-18fb-4a96-a48a-ea93768ee358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea7419-ed') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG os_vif [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:8c:6a,bridge_name='br-int',has_traffic_filtering=True,id=d0ea7419-ed5d-43af-86c6-57db8d9382e0,network=Network(ba3f17d0-18fb-4a96-a48a-ea93768ee358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea7419-ed') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0ea7419-ed, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66199568-908b-48be-a564-c6171bcd982f) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:27 user nova-compute[75378]: INFO os_vif [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:8c:6a,bridge_name='br-int',has_traffic_filtering=True,id=d0ea7419-ed5d-43af-86c6-57db8d9382e0,network=Network(ba3f17d0-18fb-4a96-a48a-ea93768ee358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea7419-ed')
Nov 09 03:50:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpOStwFd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:50:27 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:50:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:50:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb298e22-5e8e-4cd2-9de8-d24a3013bbd3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:50:28 user nova-compute[75378]: No targets found.
Nov 09 03:50:28 user nova-compute[75378]: iSNS:
Nov 09 03:50:28 user nova-compute[75378]: No targets found.
Nov 09 03:50:28 user nova-compute[75378]: STATIC:
Nov 09 03:50:28 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f
Nov 09 03:50:28 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:50:28 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:50:28 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 03:50:28 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:50:28 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:50:28 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75
Nov 09 03:50:28 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:50:28 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:50:28 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09
Nov 09 03:50:28 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:50:28 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:50:28 user nova-compute[75378]: FIRMWARE:
Nov 09 03:50:28 user nova-compute[75378]: No targets found.
Nov 09 03:50:28 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:50:28 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:50:28 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4a7a57-5327-4a6d-a909-52e24e9d7105]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94d81fd-b6a4-433c-bda8-669d7f1643a4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:50:28 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:50:28 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:50:28 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:50:28 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:50:28 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:50:28 user nova-compute[75378]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 (non-flash)
Nov 09 03:50:28 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:50:28 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c7f40d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09'): ({'sdg'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Removing single pathed devices sdg {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef62c9d-cefb-4e5c-9a69-04fdfc83eff9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b85c1d-d68c-47ef-8300-aa54b010c949]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Flushing IO for device /dev/sdg {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[87952bc0-0fb9-4863-bb9a-dbc101bd0ba2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.055s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a4ae64-b423-4915-a2c9-f2203e3c06e7]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] SCSI volumes sdg have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d552bdcf-8eef-4361-86d6-fc342f190b77]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc67e232-7d11-4fd9-8dda-399f826fa95c]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09, portal: 172.16.0.220,3260]
Nov 09 03:50:28 user nova-compute[75378]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09, portal: 172.16.0.220,3260] successful.
Nov 09 03:50:28 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3426aa0-910f-4c33-80c6-b74e104bbb09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7bcd1d-220b-412a-becd-16f71bb9ba36]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] <== disconnect_volume: return (362ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:50:28 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Deleting instance files /opt/stack/data/nova/instances/7e12539b-36a3-4691-89fd-e3d155de38d7_del
Nov 09 03:50:28 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Deletion of /opt/stack/data/nova/instances/7e12539b-36a3-4691-89fd-e3d155de38d7_del complete
Nov 09 03:50:28 user nova-compute[75378]: INFO nova.compute.manager [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 09 03:50:28 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:50:28 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:50:29 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:50:29 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Took 1.07 seconds to deallocate network for instance.
Nov 09 03:50:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-281aa45a-88c0-4df6-a44d-f0f073c91b75 req-d37d6be5-7ece-4230-b7ac-0cee55818f7b service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Received event network-vif-deleted-d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:50:29 user nova-compute[75378]: INFO nova.compute.manager [req-281aa45a-88c0-4df6-a44d-f0f073c91b75 req-d37d6be5-7ece-4230-b7ac-0cee55818f7b service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Neutron deleted interface d0ea7419-ed5d-43af-86c6-57db8d9382e0; detaching it from the instance and deleting it from the info cache
Nov 09 03:50:29 user nova-compute[75378]: DEBUG nova.network.neutron [req-281aa45a-88c0-4df6-a44d-f0f073c91b75 req-d37d6be5-7ece-4230-b7ac-0cee55818f7b service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:50:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-5604a1d0-2c9b-4e6e-93f9-63d5d07b25b9 req-43168224-e685-4f41-b5e0-1a38ab65ed9d service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Received event network-vif-plugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:50:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5604a1d0-2c9b-4e6e-93f9-63d5d07b25b9 req-43168224-e685-4f41-b5e0-1a38ab65ed9d service nova] Acquiring lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:50:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5604a1d0-2c9b-4e6e-93f9-63d5d07b25b9 req-43168224-e685-4f41-b5e0-1a38ab65ed9d service nova] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:50:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5604a1d0-2c9b-4e6e-93f9-63d5d07b25b9 req-43168224-e685-4f41-b5e0-1a38ab65ed9d service nova] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:50:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-5604a1d0-2c9b-4e6e-93f9-63d5d07b25b9 req-43168224-e685-4f41-b5e0-1a38ab65ed9d service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] No waiting events found dispatching network-vif-plugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:50:29 user nova-compute[75378]: WARNING nova.compute.manager [req-5604a1d0-2c9b-4e6e-93f9-63d5d07b25b9 req-43168224-e685-4f41-b5e0-1a38ab65ed9d service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Received unexpected event network-vif-plugged-d0ea7419-ed5d-43af-86c6-57db8d9382e0 for instance with vm_state active and task_state deleting.
Nov 09 03:50:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-281aa45a-88c0-4df6-a44d-f0f073c91b75 req-d37d6be5-7ece-4230-b7ac-0cee55818f7b service nova] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Detach interface failed, port_id=d0ea7419-ed5d-43af-86c6-57db8d9382e0, reason: Instance 7e12539b-36a3-4691-89fd-e3d155de38d7 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 03:50:30 user nova-compute[75378]: INFO nova.compute.manager [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Took 1.08 seconds to detach 1 volumes for instance.
Nov 09 03:50:30 user nova-compute[75378]: DEBUG nova.compute.manager [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] [instance: 7e12539b-36a3-4691-89fd-e3d155de38d7] Deleting volume: b3426aa0-910f-4c33-80c6-b74e104bbb09 {{(pid=75378) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 09 03:50:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:50:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:50:31 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:50:31 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:50:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:50:31 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Deleted allocations for instance 7e12539b-36a3-4691-89fd-e3d155de38d7
Nov 09 03:50:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-39d32349-301a-4b84-9e5a-9bb692fb9299 tempest-ServerActionsV293TestJSON-1531549411 tempest-ServerActionsV293TestJSON-1531549411-project-member] Lock "7e12539b-36a3-4691-89fd-e3d155de38d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.092s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:50:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:31 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:50:31 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:50:31 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:50:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-7d051405-6b57-4db2-9533-c2f4e87134d8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:50:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-7d051405-6b57-4db2-9533-c2f4e87134d8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:50:31 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 03:50:32 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Updating instance_info_cache with network_info: [{"id": "90598abb-8896-4b67-9871-b78f46b1fdfe", "address": "fa:16:3e:ed:1b:d3", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90598abb-88", "ovs_interfaceid": "90598abb-8896-4b67-9871-b78f46b1fdfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:50:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-7d051405-6b57-4db2-9533-c2f4e87134d8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:50:32 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 03:50:32 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:50:32 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:50:32 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:50:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:33 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:50:33 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "883490f1-6a9f-4ad6-83c4-44b78e681de6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "883490f1-6a9f-4ad6-83c4-44b78e681de6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "883490f1-6a9f-4ad6-83c4-44b78e681de6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "883490f1-6a9f-4ad6-83c4-44b78e681de6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "883490f1-6a9f-4ad6-83c4-44b78e681de6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:50:34 user nova-compute[75378]: INFO nova.compute.manager [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Terminating instance
Nov 09 03:50:34 user nova-compute[75378]: DEBUG nova.compute.manager [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG nova.compute.manager [req-7c90cc57-2c81-43ce-ab24-2ea3f56e035a req-2aa2bed4-4c0a-4730-8a4c-8d7d80a58fa2 service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Received event network-vif-unplugged-f0d55e97-a560-4a15-aa75-37045342f477 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7c90cc57-2c81-43ce-ab24-2ea3f56e035a req-2aa2bed4-4c0a-4730-8a4c-8d7d80a58fa2 service nova] Acquiring lock "883490f1-6a9f-4ad6-83c4-44b78e681de6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7c90cc57-2c81-43ce-ab24-2ea3f56e035a req-2aa2bed4-4c0a-4730-8a4c-8d7d80a58fa2 service nova] Lock "883490f1-6a9f-4ad6-83c4-44b78e681de6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7c90cc57-2c81-43ce-ab24-2ea3f56e035a req-2aa2bed4-4c0a-4730-8a4c-8d7d80a58fa2 service nova] Lock "883490f1-6a9f-4ad6-83c4-44b78e681de6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG nova.compute.manager [req-7c90cc57-2c81-43ce-ab24-2ea3f56e035a req-2aa2bed4-4c0a-4730-8a4c-8d7d80a58fa2 service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] No waiting events found dispatching network-vif-unplugged-f0d55e97-a560-4a15-aa75-37045342f477 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:50:34 user nova-compute[75378]: DEBUG nova.compute.manager [req-7c90cc57-2c81-43ce-ab24-2ea3f56e035a req-2aa2bed4-4c0a-4730-8a4c-8d7d80a58fa2 service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Received event network-vif-unplugged-f0d55e97-a560-4a15-aa75-37045342f477 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:35 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Instance destroyed successfully.
Nov 09 03:50:35 user nova-compute[75378]: DEBUG nova.objects.instance [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lazy-loading 'resources' on Instance uuid 883490f1-6a9f-4ad6-83c4-44b78e681de6 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:45:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1824959555',display_name='tempest-AttachVolumeTestJSON-server-1824959555',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1824959555',id=17,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtGAYXAeKGus3cYjp/BtsP80c2YAL+cFDvI+t9+ev0DjFg7WkutOGLfGoOBXAZBMXMU88mGZ443Gx2pud2okPjgb/PDeKXnBZMHtpwI0fj7KM2Wf0CXM0dCs3pVL41zDg==',key_name='tempest-keypair-1678206802',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:45:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d0151a0736b41f498b591b4d3e1a052',ramdisk_id='',reservation_id='r-v4z7ijia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-93032782',owner_user_name='tempest-AttachVolumeTestJSON-93032782-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:45:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b101389f26a84404b72cfc088ec03869',uuid=883490f1-6a9f-4ad6-83c4-44b78e681de6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0d55e97-a560-4a15-aa75-37045342f477", "address": "fa:16:3e:a8:5c:b5", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d55e97-a5", "ovs_interfaceid": "f0d55e97-a560-4a15-aa75-37045342f477", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Converting VIF {"id": "f0d55e97-a560-4a15-aa75-37045342f477", "address": "fa:16:3e:a8:5c:b5", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0d55e97-a5", "ovs_interfaceid": "f0d55e97-a560-4a15-aa75-37045342f477", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:5c:b5,bridge_name='br-int',has_traffic_filtering=True,id=f0d55e97-a560-4a15-aa75-37045342f477,network=Network(b40bde43-b1d2-4eb4-938c-55c626640880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0d55e97-a5') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG os_vif [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:5c:b5,bridge_name='br-int',has_traffic_filtering=True,id=f0d55e97-a560-4a15-aa75-37045342f477,network=Network(b40bde43-b1d2-4eb4-938c-55c626640880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0d55e97-a5') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0d55e97-a5, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d4b7845-887b-4548-87a5-529355821f70) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:35 user nova-compute[75378]: INFO os_vif [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:5c:b5,bridge_name='br-int',has_traffic_filtering=True,id=f0d55e97-a560-4a15-aa75-37045342f477,network=Network(b40bde43-b1d2-4eb4-938c-55c626640880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0d55e97-a5')
Nov 09 03:50:35 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Deleting instance files /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6_del
Nov 09 03:50:35 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Deletion of /opt/stack/data/nova/instances/883490f1-6a9f-4ad6-83c4-44b78e681de6_del complete
Nov 09 03:50:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:35 user nova-compute[75378]: INFO nova.compute.manager [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 09 03:50:35 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:50:36 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Error from libvirt while getting description of instance-00000011: [Error Code 42] Domain not found: no domain with matching uuid '883490f1-6a9f-4ad6-83c4-44b78e681de6' (instance-00000011): libvirt.libvirtError: Domain not found: no domain with matching uuid '883490f1-6a9f-4ad6-83c4-44b78e681de6' (instance-00000011)
Nov 09 03:50:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:50:36 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Took 1.07 seconds to deallocate network for instance.
Nov 09 03:50:36 user nova-compute[75378]: DEBUG nova.compute.manager [req-3529fc59-efdc-4e85-8928-fd48f00c864a req-a21dcd02-8477-4150-a603-15318db64a2b service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Received event network-vif-deleted-f0d55e97-a560-4a15-aa75-37045342f477 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:50:36 user nova-compute[75378]: INFO nova.compute.manager [req-3529fc59-efdc-4e85-8928-fd48f00c864a req-a21dcd02-8477-4150-a603-15318db64a2b service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Neutron deleted interface f0d55e97-a560-4a15-aa75-37045342f477; detaching it from the instance and deleting it from the info cache
Nov 09 03:50:36 user nova-compute[75378]: DEBUG nova.network.neutron [req-3529fc59-efdc-4e85-8928-fd48f00c864a req-a21dcd02-8477-4150-a603-15318db64a2b service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG nova.compute.manager [req-3529fc59-efdc-4e85-8928-fd48f00c864a req-a21dcd02-8477-4150-a603-15318db64a2b service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Detach interface failed, port_id=f0d55e97-a560-4a15-aa75-37045342f477, reason: Instance 883490f1-6a9f-4ad6-83c4-44b78e681de6 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG nova.compute.manager [req-244a9b9a-d16f-42d5-a948-097426e48650 req-c0a18d3f-7f06-40da-949c-2705550e1e9d service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Received event network-vif-plugged-f0d55e97-a560-4a15-aa75-37045342f477 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-244a9b9a-d16f-42d5-a948-097426e48650 req-c0a18d3f-7f06-40da-949c-2705550e1e9d service nova] Acquiring lock "883490f1-6a9f-4ad6-83c4-44b78e681de6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-244a9b9a-d16f-42d5-a948-097426e48650 req-c0a18d3f-7f06-40da-949c-2705550e1e9d service nova] Lock "883490f1-6a9f-4ad6-83c4-44b78e681de6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-244a9b9a-d16f-42d5-a948-097426e48650 req-c0a18d3f-7f06-40da-949c-2705550e1e9d service nova] Lock "883490f1-6a9f-4ad6-83c4-44b78e681de6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG nova.compute.manager [req-244a9b9a-d16f-42d5-a948-097426e48650 req-c0a18d3f-7f06-40da-949c-2705550e1e9d service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] No waiting events found dispatching network-vif-plugged-f0d55e97-a560-4a15-aa75-37045342f477 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:50:36 user nova-compute[75378]: WARNING nova.compute.manager [req-244a9b9a-d16f-42d5-a948-097426e48650 req-c0a18d3f-7f06-40da-949c-2705550e1e9d service nova] [instance: 883490f1-6a9f-4ad6-83c4-44b78e681de6] Received unexpected event network-vif-plugged-f0d55e97-a560-4a15-aa75-37045342f477 for instance with vm_state deleted and task_state None.
Nov 09 03:50:36 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:50:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.488s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:50:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:37 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Deleted allocations for instance 883490f1-6a9f-4ad6-83c4-44b78e681de6
Nov 09 03:50:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0f143a2c-5ec5-4cc5-9a9f-d2454772c87b tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "883490f1-6a9f-4ad6-83c4-44b78e681de6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.626s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:50:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:50:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:50:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:38 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:50:38 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:50:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7422MB free_disk=25.163494110107422GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:50:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:50:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:50:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:50:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:50:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7d051405-6b57-4db2-9533-c2f4e87134d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:50:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:50:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2c2acb48-972a-41d7-987e-48e79b3bef93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:50:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 013db901-fbee-4593-a14f-95a03e79fad0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:50:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 06216917-d7d1-4fd4-a311-e054437e84a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:50:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2abe50f8-3c9b-417e-889f-1d565089d678 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:50:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance cc4b9517-2616-4cfb-82f7-8379f4619962 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:50:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance ed92e04a-56ec-42f1-bed3-8b28a37d1475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:50:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:50:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:50:39 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:50:39 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:50:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:50:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.496s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:50:40 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:50:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:50:47 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:50:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:50:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 03:50:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:50:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:50:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "2abe50f8-3c9b-417e-889f-1d565089d678" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:50:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "2abe50f8-3c9b-417e-889f-1d565089d678" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:50:53 user nova-compute[75378]: DEBUG nova.objects.instance [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lazy-loading 'flavor' on Instance uuid 2abe50f8-3c9b-417e-889f-1d565089d678 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:50:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "2abe50f8-3c9b-417e-889f-1d565089d678" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "2abe50f8-3c9b-417e-889f-1d565089d678" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "2abe50f8-3c9b-417e-889f-1d565089d678" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:50:54 user nova-compute[75378]: INFO nova.compute.manager [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Attaching volume e2956f73-0160-4ad1-866d-7f42d37ab76c to /dev/vdb
Nov 09 03:50:54 user nova-compute[75378]: DEBUG os_brick.utils [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[83029665-11c5-42a7-9909-7088c498d3db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3696c811-538c-4af3-92b9-7d04046a9266]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a51c9c8-dac4-4e7a-ba9f-d904f95d0fd6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a5e4d2-fce1-4cc2-bb9c-263e0c6dec72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:50:54 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:50:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ec2427-5124-4ee1-92e5-730fef5ca593]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG os_brick.utils [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:50:54 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Updating existing volume attachment record: f7c1feae-486c-4737-98a1-66010d4e6238 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Acquiring lock "cc4b9517-2616-4cfb-82f7-8379f4619962" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "cc4b9517-2616-4cfb-82f7-8379f4619962" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Acquiring lock "cc4b9517-2616-4cfb-82f7-8379f4619962-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "cc4b9517-2616-4cfb-82f7-8379f4619962-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "cc4b9517-2616-4cfb-82f7-8379f4619962-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:50:55 user nova-compute[75378]: INFO nova.compute.manager [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Terminating instance
Nov 09 03:50:55 user nova-compute[75378]: DEBUG nova.compute.manager [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-bd92a23f-212a-4fe5-b365-9e24ce1e5cdf req-de0eeb6d-c54e-4d18-88ab-d61dd9998fea service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Received event network-vif-unplugged-1960394a-38fa-4977-95b7-6a057246f84f {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bd92a23f-212a-4fe5-b365-9e24ce1e5cdf req-de0eeb6d-c54e-4d18-88ab-d61dd9998fea service nova] Acquiring lock "cc4b9517-2616-4cfb-82f7-8379f4619962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bd92a23f-212a-4fe5-b365-9e24ce1e5cdf req-de0eeb6d-c54e-4d18-88ab-d61dd9998fea service nova] Lock "cc4b9517-2616-4cfb-82f7-8379f4619962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bd92a23f-212a-4fe5-b365-9e24ce1e5cdf req-de0eeb6d-c54e-4d18-88ab-d61dd9998fea service nova] Lock "cc4b9517-2616-4cfb-82f7-8379f4619962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-bd92a23f-212a-4fe5-b365-9e24ce1e5cdf req-de0eeb6d-c54e-4d18-88ab-d61dd9998fea service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] No waiting events found dispatching network-vif-unplugged-1960394a-38fa-4977-95b7-6a057246f84f {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-bd92a23f-212a-4fe5-b365-9e24ce1e5cdf req-de0eeb6d-c54e-4d18-88ab-d61dd9998fea service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Received event network-vif-unplugged-1960394a-38fa-4977-95b7-6a057246f84f for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:55 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Instance destroyed successfully.
Nov 09 03:50:55 user nova-compute[75378]: DEBUG nova.objects.instance [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lazy-loading 'resources' on Instance uuid cc4b9517-2616-4cfb-82f7-8379f4619962 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:47:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2126959549',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2126959549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2126959',id=25,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkGWvCaGvY0egT1Segn6rf5V7clzMwFXDFUGqwyV0rIGCv9YFI6V5GW9SGtuSCoGJkB6KUhL7jHx85AdosJEBUkYsGpuAcH/Lbu5whwsJxlionhKU1MVYNSbPgny88W7g==',key_name='tempest-keypair-1883075483',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:47:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be12d540705f40b1a28a40589eabfec4',ramdisk_id='',reservation_id='r-k08flwuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1828344835',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:47:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3368d90833948c7b883be82d579610a',uuid=cc4b9517-2616-4cfb-82f7-8379f4619962,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1960394a-38fa-4977-95b7-6a057246f84f", "address": "fa:16:3e:99:9a:c5", "network": {"id": "5d4c731b-c253-46b1-98de-427ee670e8e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1331924378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be12d540705f40b1a28a40589eabfec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1960394a-38", "ovs_interfaceid": "1960394a-38fa-4977-95b7-6a057246f84f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Converting VIF {"id": "1960394a-38fa-4977-95b7-6a057246f84f", "address": "fa:16:3e:99:9a:c5", "network": {"id": "5d4c731b-c253-46b1-98de-427ee670e8e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1331924378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be12d540705f40b1a28a40589eabfec4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1960394a-38", "ovs_interfaceid": "1960394a-38fa-4977-95b7-6a057246f84f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:9a:c5,bridge_name='br-int',has_traffic_filtering=True,id=1960394a-38fa-4977-95b7-6a057246f84f,network=Network(5d4c731b-c253-46b1-98de-427ee670e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1960394a-38') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG os_vif [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:9a:c5,bridge_name='br-int',has_traffic_filtering=True,id=1960394a-38fa-4977-95b7-6a057246f84f,network=Network(5d4c731b-c253-46b1-98de-427ee670e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1960394a-38') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1960394a-38, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3276ab9a-3b77-463e-aa5a-bfffd84b0063) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:50:55 user nova-compute[75378]: INFO os_vif [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:9a:c5,bridge_name='br-int',has_traffic_filtering=True,id=1960394a-38fa-4977-95b7-6a057246f84f,network=Network(5d4c731b-c253-46b1-98de-427ee670e8e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1960394a-38')
Nov 09 03:50:55 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Deleting instance files /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962_del
Nov 09 03:50:55 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Deletion of /opt/stack/data/nova/instances/cc4b9517-2616-4cfb-82f7-8379f4619962_del complete
Nov 09 03:50:56 user nova-compute[75378]: INFO nova.compute.manager [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 09 03:50:56 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:50:56 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:50:56 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:50:57 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:50:57 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Took 1.43 seconds to deallocate network for instance.
Nov 09 03:50:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:50:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:50:57 user nova-compute[75378]: DEBUG nova.compute.manager [req-573fc84e-e451-4bae-bbb3-d3c0974516ea req-45a4a680-3b7a-4d99-8ad7-e4574afc42b4 service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Received event network-vif-plugged-1960394a-38fa-4977-95b7-6a057246f84f {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:50:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-573fc84e-e451-4bae-bbb3-d3c0974516ea req-45a4a680-3b7a-4d99-8ad7-e4574afc42b4 service nova] Acquiring lock "cc4b9517-2616-4cfb-82f7-8379f4619962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:50:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-573fc84e-e451-4bae-bbb3-d3c0974516ea req-45a4a680-3b7a-4d99-8ad7-e4574afc42b4 service nova] Lock "cc4b9517-2616-4cfb-82f7-8379f4619962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:50:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-573fc84e-e451-4bae-bbb3-d3c0974516ea req-45a4a680-3b7a-4d99-8ad7-e4574afc42b4 service nova] Lock "cc4b9517-2616-4cfb-82f7-8379f4619962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:50:57 user nova-compute[75378]: DEBUG nova.compute.manager [req-573fc84e-e451-4bae-bbb3-d3c0974516ea req-45a4a680-3b7a-4d99-8ad7-e4574afc42b4 service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] No waiting events found dispatching network-vif-plugged-1960394a-38fa-4977-95b7-6a057246f84f {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:50:57 user nova-compute[75378]: WARNING nova.compute.manager [req-573fc84e-e451-4bae-bbb3-d3c0974516ea req-45a4a680-3b7a-4d99-8ad7-e4574afc42b4 service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Received unexpected event network-vif-plugged-1960394a-38fa-4977-95b7-6a057246f84f for instance with vm_state deleted and task_state None.
Nov 09 03:50:57 user nova-compute[75378]: DEBUG nova.compute.manager [req-573fc84e-e451-4bae-bbb3-d3c0974516ea req-45a4a680-3b7a-4d99-8ad7-e4574afc42b4 service nova] [instance: cc4b9517-2616-4cfb-82f7-8379f4619962] Received event network-vif-deleted-1960394a-38fa-4977-95b7-6a057246f84f {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:50:57 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:50:57 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:50:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:50:57 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Deleted allocations for instance cc4b9517-2616-4cfb-82f7-8379f4619962
Nov 09 03:50:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fd03b2d0-7c1b-45dc-bf06-91fe22987006 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835 tempest-TestServerVolumeAttachScenarioOldVersion-1828344835-project-member] Lock "cc4b9517-2616-4cfb-82f7-8379f4619962" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.911s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKrhJLbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:51:18 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:51:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:51:18 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:51:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:51:18 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:51:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af4d857-a60a-46c5-82be-73f83a993732]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:51:18 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc852fa-8355-494b-8c17-5cd5fed9ca0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c] added
Nov 09 03:51:18 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5ad3c9-1edb-44b0-a648-9d42137073a2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c898eaf-20f6-4d1a-868c-ec9e588c8465]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IKrhJLbx {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IKrhJLbx" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef5a44f-2fc8-4cc9-a005-6f973fe43c4a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IKrhJLbx'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c33c44-444e-4e0c-93d4-58718d690ee0]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c49d0a-35e9-478d-80aa-32f913f9190c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:51:19 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:51:19 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:51:19 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:51:19 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:51:19 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:51:19 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --login" returned: 0 in 0.116s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2165497-5cf7-4b7d-b946-21d3719b887d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c, portal: 172.16.0.220,3260]
Nov 09 03:51:19 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c, portal: 172.16.0.220,3260] successful.
Nov 09 03:51:19 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d00682-b6f8-437c-8b18-b334039b2ff8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ec8ac5-7b78-4e53-982a-e2fd6d980348]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:51:19 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:51:19 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:51:19 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:51:19 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:51:19 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:51:19 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:51:19 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:51:19 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b697de-2748-4a87-b374-79a50d93d339]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:51:19 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKrhJLbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:51:20 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:51:20 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26364663835663631', 'path': '/dev/sde'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:51:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364663835663631', 'path': '/dev/sde'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:51:20 user nova-compute[75378]: DEBUG nova.objects.instance [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lazy-loading 'flavor' on Instance uuid 2abe50f8-3c9b-417e-889f-1d565089d678 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:51:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 03:51:20 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:51:20 user nova-compute[75378]:   <source dev="/dev/sde"/>
Nov 09 03:51:20 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:51:20 user nova-compute[75378]:   <serial>e2956f73-0160-4ad1-866d-7f42d37ab76c</serial>
Nov 09 03:51:20 user nova-compute[75378]: </disk>
Nov 09 03:51:20 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 03:51:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:51:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:51:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] No VIF found with MAC fa:16:3e:76:38:86, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:51:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-6ce6703f-78b9-4d0f-af80-d4fd52fe223e tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "2abe50f8-3c9b-417e-889f-1d565089d678" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.694s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:21 user nova-compute[75378]: INFO nova.compute.manager [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Rescuing
Nov 09 03:51:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:51:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquired lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:51:21 user nova-compute[75378]: DEBUG nova.network.neutron [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:51:21 user nova-compute[75378]: DEBUG nova.network.neutron [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Updating instance_info_cache with network_info: [{"id": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "address": "fa:16:3e:76:38:86", "network": {"id": "99b3e8be-7102-4b9a-aeae-3151b634d431", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6633f406337a45599d107946b7d4dfdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d1103d-bc", "ovs_interfaceid": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:51:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Releasing lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:51:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:22 user nova-compute[75378]: DEBUG nova.compute.manager [req-2469fd86-c51f-4bda-bc4d-091dfe09366c req-f4303bb5-ccf0-45b4-b7d1-52856ae7012d service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received event network-vif-unplugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:51:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2469fd86-c51f-4bda-bc4d-091dfe09366c req-f4303bb5-ccf0-45b4-b7d1-52856ae7012d service nova] Acquiring lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2469fd86-c51f-4bda-bc4d-091dfe09366c req-f4303bb5-ccf0-45b4-b7d1-52856ae7012d service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2469fd86-c51f-4bda-bc4d-091dfe09366c req-f4303bb5-ccf0-45b4-b7d1-52856ae7012d service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:22 user nova-compute[75378]: DEBUG nova.compute.manager [req-2469fd86-c51f-4bda-bc4d-091dfe09366c req-f4303bb5-ccf0-45b4-b7d1-52856ae7012d service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] No waiting events found dispatching network-vif-unplugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:51:22 user nova-compute[75378]: WARNING nova.compute.manager [req-2469fd86-c51f-4bda-bc4d-091dfe09366c req-f4303bb5-ccf0-45b4-b7d1-52856ae7012d service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received unexpected event network-vif-unplugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 for instance with vm_state active and task_state rescuing.
Nov 09 03:51:22 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Instance destroyed successfully.
Nov 09 03:51:22 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Attempting a stable device rescue
Nov 09 03:51:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75378) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 09 03:51:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Instance directory exists: not creating {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 03:51:22 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Creating image(s)
Nov 09 03:51:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "/opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "/opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "/opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:22 user nova-compute[75378]: DEBUG nova.objects.instance [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2abe50f8-3c9b-417e-889f-1d565089d678 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:51:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "2ca5561e008f7db90329a4f8d5b789cabb812bf7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "2ca5561e008f7db90329a4f8d5b789cabb812bf7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ca5561e008f7db90329a4f8d5b789cabb812bf7.part --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ca5561e008f7db90329a4f8d5b789cabb812bf7.part --force-share --output=json" returned: 0 in 0.214s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:24 user nova-compute[75378]: DEBUG nova.virt.images [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] 33b3c614-4dcb-404d-8069-3b91dc61d266 was qcow2, converting to raw {{(pid=75378) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 03:51:24 user nova-compute[75378]: DEBUG nova.privsep.utils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75378) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 03:51:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ca5561e008f7db90329a4f8d5b789cabb812bf7.part /opt/stack/data/nova/instances/_base/2ca5561e008f7db90329a4f8d5b789cabb812bf7.converted {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:24 user nova-compute[75378]: DEBUG nova.compute.manager [req-dd2d4925-8138-4c62-bdd4-310e2f93c995 req-519e1daa-2781-4e41-a606-b3bf1ea24c26 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received event network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:51:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-dd2d4925-8138-4c62-bdd4-310e2f93c995 req-519e1daa-2781-4e41-a606-b3bf1ea24c26 service nova] Acquiring lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-dd2d4925-8138-4c62-bdd4-310e2f93c995 req-519e1daa-2781-4e41-a606-b3bf1ea24c26 service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-dd2d4925-8138-4c62-bdd4-310e2f93c995 req-519e1daa-2781-4e41-a606-b3bf1ea24c26 service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:24 user nova-compute[75378]: DEBUG nova.compute.manager [req-dd2d4925-8138-4c62-bdd4-310e2f93c995 req-519e1daa-2781-4e41-a606-b3bf1ea24c26 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] No waiting events found dispatching network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:51:24 user nova-compute[75378]: WARNING nova.compute.manager [req-dd2d4925-8138-4c62-bdd4-310e2f93c995 req-519e1daa-2781-4e41-a606-b3bf1ea24c26 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received unexpected event network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 for instance with vm_state active and task_state rescuing.
Nov 09 03:51:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ca5561e008f7db90329a4f8d5b789cabb812bf7.part /opt/stack/data/nova/instances/_base/2ca5561e008f7db90329a4f8d5b789cabb812bf7.converted" returned: 0 in 0.553s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ca5561e008f7db90329a4f8d5b789cabb812bf7.converted --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ca5561e008f7db90329a4f8d5b789cabb812bf7.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "2ca5561e008f7db90329a4f8d5b789cabb812bf7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.158s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "2ca5561e008f7db90329a4f8d5b789cabb812bf7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "2ca5561e008f7db90329a4f8d5b789cabb812bf7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ca5561e008f7db90329a4f8d5b789cabb812bf7 --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ca5561e008f7db90329a4f8d5b789cabb812bf7 --force-share --output=json" returned: 0 in 0.174s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ca5561e008f7db90329a4f8d5b789cabb812bf7,backing_fmt=raw /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk.rescue {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ca5561e008f7db90329a4f8d5b789cabb812bf7,backing_fmt=raw /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk.rescue" returned: 0 in 0.061s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "2ca5561e008f7db90329a4f8d5b789cabb812bf7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.objects.instance [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lazy-loading 'migration_context' on Instance uuid 2abe50f8-3c9b-417e-889f-1d565089d678 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.objects.base [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Object Instance<2abe50f8-3c9b-417e-889f-1d565089d678> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Start _get_guest_xml network_info=[{"id": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "address": "fa:16:3e:76:38:86", "network": {"id": "99b3e8be-7102-4b9a-aeae-3151b634d431", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "vif_mac": "fa:16:3e:76:38:86"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6633f406337a45599d107946b7d4dfdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d1103d-bc", "ovs_interfaceid": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '33b3c614-4dcb-404d-8069-3b91dc61d266', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKrhJLbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '2abe50f8-3c9b-417e-889f-1d565089d678', 'attached_at': '', 'detached_at': '', 'volume_id': 'e2956f73-0160-4ad1-866d-7f42d37ab76c', 'serial': 'e2956f73-0160-4ad1-866d-7f42d37ab76c'}, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'attachment_id': 'f7c1feae-486c-4737-98a1-66010d4e6238', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.objects.instance [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lazy-loading 'resources' on Instance uuid 2abe50f8-3c9b-417e-889f-1d565089d678 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.objects.base [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Object Instance<2abe50f8-3c9b-417e-889f-1d565089d678> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.objects.instance [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lazy-loading 'numa_topology' on Instance uuid 2abe50f8-3c9b-417e-889f-1d565089d678 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.objects.base [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Object Instance<2abe50f8-3c9b-417e-889f-1d565089d678> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:51:25 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:51:25 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.objects.instance [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2abe50f8-3c9b-417e-889f-1d565089d678 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.objects.base [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Object Instance<2abe50f8-3c9b-417e-889f-1d565089d678> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKrhJLbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:51:25 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:51:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:51:25 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:51:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:51:25 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b20331-26c9-4cd7-88f3-c0c701208f70]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = IKrhJLbx\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 09 03:51:25 user nova-compute[75378]: node.name = iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c
Nov 09 03:51:25 user nova-compute[75378]: node.tpgt = -1
Nov 09 03:51:25 user nova-compute[75378]: node.startup = automatic
Nov 09 03:51:25 user nova-compute[75378]: node.leading_login = No
Nov 09 03:51:25 user nova-compute[75378]: iface.iscsi_ifacename = default
Nov 09 03:51:25 user nova-compute[75378]: iface.net_ifacename = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.ipaddress = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.prefix_len = 0
Nov 09 03:51:25 user nova-compute[75378]: iface.hwaddress = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.transport_name = tcp
Nov 09 03:51:25 user nova-compute[75378]: iface.initiatorname = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.state = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.vlan_id = 0
Nov 09 03:51:25 user nova-compute[75378]: iface.vlan_priority = 0
Nov 09 03:51:25 user nova-compute[75378]: iface.vlan_state = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.iface_num = 0
Nov 09 03:51:25 user nova-compute[75378]: iface.mtu = 0
Nov 09 03:51:25 user nova-compute[75378]: iface.port = 0
Nov 09 03:51:25 user nova-compute[75378]: iface.bootproto = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.subnet_mask = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.gateway = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.dhcp_alt_client_id_state = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.dhcp_alt_client_id = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.dhcp_dns = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.dhcp_learn_iqn = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.dhcp_req_vendor_id_state = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.dhcp_vendor_id_state = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.dhcp_vendor_id = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.dhcp_slp_da = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.fragmentation = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.gratuitous_arp = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.incoming_forwarding = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.tos_state = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.tos = 0
Nov 09 03:51:25 user nova-compute[75378]: iface.ttl = 0
Nov 09 03:51:25 user nova-compute[75378]: iface.delayed_ack = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.tcp_nagle = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.tcp_wsf_state = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.tcp_wsf = 0
Nov 09 03:51:25 user nova-compute[75378]: iface.tcp_timer_scale = 0
Nov 09 03:51:25 user nova-compute[75378]: iface.tcp_timestamp = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.redirect = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.def_task_mgmt_timeout = 0
Nov 09 03:51:25 user nova-compute[75378]: iface.header_digest = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.data_digest = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.immediate_data = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.initial_r2t = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.data_seq_inorder = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.data_pdu_inorder = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.erl = 0
Nov 09 03:51:25 user nova-compute[75378]: iface.max_receive_data_len = 0
Nov 09 03:51:25 user nova-compute[75378]: iface.first_burst_len = 0
Nov 09 03:51:25 user nova-compute[75378]: iface.max_outstanding_r2t = 0
Nov 09 03:51:25 user nova-compute[75378]: iface.max_burst_len = 0
Nov 09 03:51:25 user nova-compute[75378]: iface.chap_auth = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.bidi_chap = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.strict_login_compliance = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.discovery_auth = <empty>
Nov 09 03:51:25 user nova-compute[75378]: iface.discovery_logout = <empty>
Nov 09 03:51:25 user nova-compute[75378]: node.discovery_address = <empty>
Nov 09 03:51:25 user nova-compute[75378]: node.discovery_port = 0
Nov 09 03:51:25 user nova-compute[75378]: node.discovery_type = static
Nov 09 03:51:25 user nova-compute[75378]: node.session.initial_cmdsn = 0
Nov 09 03:51:25 user nova-compute[75378]: node.session.initial_login_retry_max = 8
Nov 09 03:51:25 user nova-compute[75378]: node.session.xmit_thread_priority = -20
Nov 09 03:51:25 user nova-compute[75378]: node.session.cmds_max = 128
Nov 09 03:51:25 user nova-compute[75378]: node.session.queue_depth = 32
Nov 09 03:51:25 user nova-compute[75378]: node.session.nr_sessions = 1
Nov 09 03:51:25 user nova-compute[75378]: node.session.auth.authmethod = CHAP
Nov 09 03:51:25 user nova-compute[75378]: node.session.auth.username = IKrhJLbx
Nov 09 03:51:25 user nova-compute[75378]: node.session.auth.password = ***
Nov 09 03:51:25 user nova-compute[75378]: node.session.auth.username_in = <empty>
Nov 09 03:51:25 user nova-compute[75378]: node.session.auth.password_in = <empty>
Nov 09 03:51:25 user nova-compute[75378]: node.session.auth.chap_algs = MD5
Nov 09 03:51:25 user nova-compute[75378]: node.session.timeo.replacement_timeout = 120
Nov 09 03:51:25 user nova-compute[75378]: node.session.err_timeo.abort_timeout = 15
Nov 09 03:51:25 user nova-compute[75378]: node.session.err_timeo.lu_reset_timeout = 30
Nov 09 03:51:25 user nova-compute[75378]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 09 03:51:25 user nova-compute[75378]: node.session.err_timeo.host_reset_timeout = 60
Nov 09 03:51:25 user nova-compute[75378]: node.session.iscsi.FastAbort = Yes
Nov 09 03:51:25 user nova-compute[75378]: node.session.iscsi.InitialR2T = No
Nov 09 03:51:25 user nova-compute[75378]: node.session.iscsi.ImmediateData = Yes
Nov 09 03:51:25 user nova-compute[75378]: node.session.iscsi.FirstBurstLength = 262144
Nov 09 03:51:25 user nova-compute[75378]: node.session.iscsi.MaxBurstLength = 16776192
Nov 09 03:51:25 user nova-compute[75378]: node.session.iscsi.DefaultTime2Retain = 0
Nov 09 03:51:25 user nova-compute[75378]: node.session.iscsi.DefaultTime2Wait = 2
Nov 09 03:51:25 user nova-compute[75378]: node.session.iscsi.MaxConnections = 1
Nov 09 03:51:25 user nova-compute[75378]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 09 03:51:25 user nova-compute[75378]: node.session.iscsi.ERL = 0
Nov 09 03:51:25 user nova-compute[75378]: node.session.scan = manual
Nov 09 03:51:25 user nova-compute[75378]: node.session.reopen_max = 0
Nov 09 03:51:25 user nova-compute[75378]: node.conn[0].address = 172.16.0.220
Nov 09 03:51:25 user nova-compute[75378]: node.conn[0].port = 3260
Nov 09 03:51:25 user nova-compute[75378]: node.conn[0].startup = manual
Nov 09 03:51:25 user nova-compute[75378]: node.conn[0].tcp.window_size = 524288
Nov 09 03:51:25 user nova-compute[75378]: node.conn[0].tcp.type_of_service = 0
Nov 09 03:51:25 user nova-compute[75378]: node.conn[0].timeo.logout_timeout = 15
Nov 09 03:51:25 user nova-compute[75378]: node.conn[0].timeo.login_timeout = 15
Nov 09 03:51:25 user nova-compute[75378]: node.conn[0].timeo.auth_timeout = 45
Nov 09 03:51:25 user nova-compute[75378]: node.conn[0].timeo.noop_out_interval = 5
Nov 09 03:51:25 user nova-compute[75378]: node.conn[0].timeo.noop_out_timeout = 5
Nov 09 03:51:25 user nova-compute[75378]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 09 03:51:25 user nova-compute[75378]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 09 03:51:25 user nova-compute[75378]: node.conn[0].iscsi.HeaderDigest = None
Nov 09 03:51:25 user nova-compute[75378]: node.conn[0].iscsi.DataDigest = None
Nov 09 03:51:25 user nova-compute[75378]: node.conn[0].iscsi.IFMarker = No
Nov 09 03:51:25 user nova-compute[75378]: node.conn[0].iscsi.OFMarker = No
Nov 09 03:51:25 user nova-compute[75378]: # END RECORD
Nov 09 03:51:25 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[db279acc-2574-4174-a351-2cfb50f7b53c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6119ff42-e4b0-46c5-a307-c52992f66129]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IKrhJLbx {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IKrhJLbx" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5f6f87-e404-4eb6-9a7c-e2faf67cca66]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IKrhJLbx'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc8543a-5b0e-4385-b47e-d74a717f66f7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[97daa01d-9d38-45ce-a375-e6a439799616]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:51:25 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:51:25 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:51:25 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:51:25 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:51:25 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:51:25 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:51:25 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:51:25 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.158s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] HCTL ('36', '0', '0', 0) found on session 26 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9cdb1c-b6bb-4f28-bb89-1578eac1d2ff]: (4, ('0 0 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Searching for a device in session 26 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKrhJLbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.181s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] <== connect_volume: return (182ms) {'type': 'block', 'scsi_wwn': '26364663835663631', 'path': '/dev/sde'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364663835663631', 'path': '/dev/sde'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:47:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-923846665',display_name='tempest-ServerStableDeviceRescueTest-server-923846665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-923846665',id=24,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6vPwFrNFPEfbM2OavXaL8l/ouKox+s8izxBC7SxRx4T9FG3kQK/fpJG8Pg3/KTsjW9v2sQ6HRculfxxLxqRaMpZaq1p8ooFGUp+q7xPNn822yLnMs4FIk9MYMVPb05XQ==',key_name='tempest-keypair-1087149700',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:47:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6633f406337a45599d107946b7d4dfdd',ramdisk_id='',reservation_id='r-e4hle5lx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1146989307',owner_user_name='tempest-ServerStableDeviceRescueTest-1146989307-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fadaa571b9b47a4a5978149c070f344',uuid=2abe50f8-3c9b-417e-889f-1d565089d678,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "address": "fa:16:3e:76:38:86", "network": {"id": "99b3e8be-7102-4b9a-aeae-3151b634d431", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "vif_mac": "fa:16:3e:76:38:86"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6633f406337a45599d107946b7d4dfdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d1103d-bc", "ovs_interfaceid": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Converting VIF {"id": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "address": "fa:16:3e:76:38:86", "network": {"id": "99b3e8be-7102-4b9a-aeae-3151b634d431", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "vif_mac": "fa:16:3e:76:38:86"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6633f406337a45599d107946b7d4dfdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d1103d-bc", "ovs_interfaceid": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:38:86,bridge_name='br-int',has_traffic_filtering=True,id=f3d1103d-bcfc-4db6-b227-e1448c56f689,network=Network(99b3e8be-7102-4b9a-aeae-3151b634d431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3d1103d-bc') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.objects.instance [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lazy-loading 'pci_devices' on Instance uuid 2abe50f8-3c9b-417e-889f-1d565089d678 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.objects.base [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Object Instance<2abe50f8-3c9b-417e-889f-1d565089d678> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:51:25 user nova-compute[75378]:   <uuid>2abe50f8-3c9b-417e-889f-1d565089d678</uuid>
Nov 09 03:51:25 user nova-compute[75378]:   <name>instance-00000018</name>
Nov 09 03:51:25 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:51:25 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:51:25 user nova-compute[75378]:   <metadata>
Nov 09 03:51:25 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:51:25 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:51:25 user nova-compute[75378]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-923846665</nova:name>
Nov 09 03:51:25 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:51:25</nova:creationTime>
Nov 09 03:51:25 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:51:25 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:51:25 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:51:25 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:51:25 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:51:25 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:51:25 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:51:25 user nova-compute[75378]:       <nova:owner>
Nov 09 03:51:25 user nova-compute[75378]:         <nova:user uuid="9fadaa571b9b47a4a5978149c070f344">tempest-ServerStableDeviceRescueTest-1146989307-project-member</nova:user>
Nov 09 03:51:25 user nova-compute[75378]:         <nova:project uuid="6633f406337a45599d107946b7d4dfdd">tempest-ServerStableDeviceRescueTest-1146989307</nova:project>
Nov 09 03:51:25 user nova-compute[75378]:       </nova:owner>
Nov 09 03:51:25 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:51:25 user nova-compute[75378]:       <nova:ports>
Nov 09 03:51:25 user nova-compute[75378]:         <nova:port uuid="f3d1103d-bcfc-4db6-b227-e1448c56f689">
Nov 09 03:51:25 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 03:51:25 user nova-compute[75378]:         </nova:port>
Nov 09 03:51:25 user nova-compute[75378]:       </nova:ports>
Nov 09 03:51:25 user nova-compute[75378]:     </nova:instance>
Nov 09 03:51:25 user nova-compute[75378]:   </metadata>
Nov 09 03:51:25 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:51:25 user nova-compute[75378]:     <system>
Nov 09 03:51:25 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:51:25 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:51:25 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:51:25 user nova-compute[75378]:       <entry name="serial">2abe50f8-3c9b-417e-889f-1d565089d678</entry>
Nov 09 03:51:25 user nova-compute[75378]:       <entry name="uuid">2abe50f8-3c9b-417e-889f-1d565089d678</entry>
Nov 09 03:51:25 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:51:25 user nova-compute[75378]:     </system>
Nov 09 03:51:25 user nova-compute[75378]:   </sysinfo>
Nov 09 03:51:25 user nova-compute[75378]:   <os>
Nov 09 03:51:25 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:51:25 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:51:25 user nova-compute[75378]:   </os>
Nov 09 03:51:25 user nova-compute[75378]:   <features>
Nov 09 03:51:25 user nova-compute[75378]:     <acpi/>
Nov 09 03:51:25 user nova-compute[75378]:     <apic/>
Nov 09 03:51:25 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:51:25 user nova-compute[75378]:   </features>
Nov 09 03:51:25 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:51:25 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:51:25 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:51:25 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:51:25 user nova-compute[75378]:   </clock>
Nov 09 03:51:25 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:51:25 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:51:25 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:51:25 user nova-compute[75378]:   </cpu>
Nov 09 03:51:25 user nova-compute[75378]:   <devices>
Nov 09 03:51:25 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:51:25 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:51:25 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk"/>
Nov 09 03:51:25 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:51:25 user nova-compute[75378]:     </disk>
Nov 09 03:51:25 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 03:51:25 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:51:25 user nova-compute[75378]:       <source dev="/dev/sde"/>
Nov 09 03:51:25 user nova-compute[75378]:       <target dev="vdb" bus="virtio"/>
Nov 09 03:51:25 user nova-compute[75378]:       <serial>e2956f73-0160-4ad1-866d-7f42d37ab76c</serial>
Nov 09 03:51:25 user nova-compute[75378]:     </disk>
Nov 09 03:51:25 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:51:25 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:51:25 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk.rescue"/>
Nov 09 03:51:25 user nova-compute[75378]:       <target dev="vdc" bus="virtio"/>
Nov 09 03:51:25 user nova-compute[75378]:       <boot order="1"/>
Nov 09 03:51:25 user nova-compute[75378]:     </disk>
Nov 09 03:51:25 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:51:25 user nova-compute[75378]:       <mac address="fa:16:3e:76:38:86"/>
Nov 09 03:51:25 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:51:25 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:51:25 user nova-compute[75378]:       <target dev="tapf3d1103d-bc"/>
Nov 09 03:51:25 user nova-compute[75378]:     </interface>
Nov 09 03:51:25 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:51:25 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/console.log" append="off"/>
Nov 09 03:51:25 user nova-compute[75378]:     </serial>
Nov 09 03:51:25 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:51:25 user nova-compute[75378]:     <video>
Nov 09 03:51:25 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:51:25 user nova-compute[75378]:     </video>
Nov 09 03:51:25 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:51:25 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:51:25 user nova-compute[75378]:     </rng>
Nov 09 03:51:25 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:51:25 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:51:25 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:51:25 user nova-compute[75378]:     </memballoon>
Nov 09 03:51:25 user nova-compute[75378]:   </devices>
Nov 09 03:51:25 user nova-compute[75378]: </domain>
Nov 09 03:51:25 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:51:25 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Instance destroyed successfully.
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] No VIF found with MAC fa:16:3e:76:38:86, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:51:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-9790b19d-012d-4a1d-81a2-d4c66e17e70f req-692c6ae2-d760-4736-b21f-675f020001db service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received event network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:51:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9790b19d-012d-4a1d-81a2-d4c66e17e70f req-692c6ae2-d760-4736-b21f-675f020001db service nova] Acquiring lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9790b19d-012d-4a1d-81a2-d4c66e17e70f req-692c6ae2-d760-4736-b21f-675f020001db service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9790b19d-012d-4a1d-81a2-d4c66e17e70f req-692c6ae2-d760-4736-b21f-675f020001db service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-9790b19d-012d-4a1d-81a2-d4c66e17e70f req-692c6ae2-d760-4736-b21f-675f020001db service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] No waiting events found dispatching network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:51:27 user nova-compute[75378]: WARNING nova.compute.manager [req-9790b19d-012d-4a1d-81a2-d4c66e17e70f req-692c6ae2-d760-4736-b21f-675f020001db service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received unexpected event network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 for instance with vm_state active and task_state rescuing.
Nov 09 03:51:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:28 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:51:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:28 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:51:28 user nova-compute[75378]: INFO nova.compute.claims [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Claim successful on node user
Nov 09 03:51:29 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:51:29 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:51:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-c2135d94-f521-44d0-a9da-96a3e221e962 req-ebf95375-6d65-4edf-ab13-8e7f3702eb9c service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received event network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:51:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c2135d94-f521-44d0-a9da-96a3e221e962 req-ebf95375-6d65-4edf-ab13-8e7f3702eb9c service nova] Acquiring lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c2135d94-f521-44d0-a9da-96a3e221e962 req-ebf95375-6d65-4edf-ab13-8e7f3702eb9c service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c2135d94-f521-44d0-a9da-96a3e221e962 req-ebf95375-6d65-4edf-ab13-8e7f3702eb9c service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-c2135d94-f521-44d0-a9da-96a3e221e962 req-ebf95375-6d65-4edf-ab13-8e7f3702eb9c service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] No waiting events found dispatching network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:51:29 user nova-compute[75378]: WARNING nova.compute.manager [req-c2135d94-f521-44d0-a9da-96a3e221e962 req-ebf95375-6d65-4edf-ab13-8e7f3702eb9c service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received unexpected event network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 for instance with vm_state active and task_state rescuing.
Nov 09 03:51:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.595s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:29 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:51:29 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:51:29 user nova-compute[75378]: DEBUG nova.network.neutron [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:51:29 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:51:29 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:51:29 user nova-compute[75378]: DEBUG nova.policy [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b101389f26a84404b72cfc088ec03869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d0151a0736b41f498b591b4d3e1a052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:51:29 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:51:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:51:29 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Creating image(s)
Nov 09 03:51:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "/opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "/opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:29 user nova-compute[75378]: DEBUG nova.compute.manager [None req-071d3056-a3ad-4b4b-a88a-254b1c4e4f35 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:51:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.206s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.248s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk 1073741824" returned: 0 in 0.070s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.339s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG nova.compute.manager [req-1b9733a1-5443-4ca7-82f5-9dc6195a9084 req-04428c35-5f16-4433-add3-71fc24085041 service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Received event network-changed-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG nova.compute.manager [req-1b9733a1-5443-4ca7-82f5-9dc6195a9084 req-04428c35-5f16-4433-add3-71fc24085041 service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Refreshing instance network info cache due to event network-changed-f0923686-86a8-4a1d-a8a9-f59a6aff0b13. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1b9733a1-5443-4ca7-82f5-9dc6195a9084 req-04428c35-5f16-4433-add3-71fc24085041 service nova] Acquiring lock "refresh_cache-ed92e04a-56ec-42f1-bed3-8b28a37d1475" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1b9733a1-5443-4ca7-82f5-9dc6195a9084 req-04428c35-5f16-4433-add3-71fc24085041 service nova] Acquired lock "refresh_cache-ed92e04a-56ec-42f1-bed3-8b28a37d1475" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG nova.network.neutron [req-1b9733a1-5443-4ca7-82f5-9dc6195a9084 req-04428c35-5f16-4433-add3-71fc24085041 service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Refreshing network info cache for port f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.217s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Cannot resize image /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Ensure instance console log exists: /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG nova.network.neutron [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Successfully created port: 62cd3fe2-71e3-478e-ad29-819df0de80f9 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:51:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG nova.objects.instance [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lazy-loading 'flavor' on Instance uuid ed92e04a-56ec-42f1-bed3-8b28a37d1475 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG nova.network.neutron [req-1b9733a1-5443-4ca7-82f5-9dc6195a9084 req-04428c35-5f16-4433-add3-71fc24085041 service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Updated VIF entry in instance network info cache for port f0923686-86a8-4a1d-a8a9-f59a6aff0b13. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG nova.network.neutron [req-1b9733a1-5443-4ca7-82f5-9dc6195a9084 req-04428c35-5f16-4433-add3-71fc24085041 service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Updating instance_info_cache with network_info: [{"id": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "address": "fa:16:3e:08:70:32", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0923686-86", "ovs_interfaceid": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Updating instance_info_cache with network_info: [{"id": "e4725ee0-c613-48af-8163-eafad2605fff", "address": "fa:16:3e:89:f8:61", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4725ee0-c6", "ovs_interfaceid": "e4725ee0-c613-48af-8163-eafad2605fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1b9733a1-5443-4ca7-82f5-9dc6195a9084 req-04428c35-5f16-4433-add3-71fc24085041 service nova] Releasing lock "refresh_cache-ed92e04a-56ec-42f1-bed3-8b28a37d1475" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:31 user nova-compute[75378]: INFO nova.compute.manager [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Attaching volume 47f376dc-cf4e-4738-9306-6b1eb440f6e8 to /dev/vdb
Nov 09 03:51:31 user nova-compute[75378]: DEBUG os_brick.utils [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[389768e3-82cc-4811-9bc3-ef62d1412218]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG nova.network.neutron [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Successfully updated port: 62cd3fe2-71e3-478e-ad29-819df0de80f9 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4a8bed-3eac-4c46-8309-9bf46e65ed42]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "refresh_cache-2d21fbf8-55f3-4acf-8be2-e19a04c0f295" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquired lock "refresh_cache-2d21fbf8-55f3-4acf-8be2-e19a04c0f295" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG nova.network.neutron [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddcf00c-9647-4de4-8829-2b79a92c5402]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2c6262-6108-43f5-8b28-aa80b703b555]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:51:31 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:51:31 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6e4bff-340d-4799-9ad5-dae6c185b57d]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG os_brick.utils [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Updating existing volume attachment record: c2f212ea-e860-405c-9733-b3665da92ff4 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:51:31 user nova-compute[75378]: DEBUG nova.network.neutron [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.network.neutron [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Updating instance_info_cache with network_info: [{"id": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "address": "fa:16:3e:40:9f:77", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cd3fe2-71", "ovs_interfaceid": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Releasing lock "refresh_cache-2d21fbf8-55f3-4acf-8be2-e19a04c0f295" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Instance network_info: |[{"id": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "address": "fa:16:3e:40:9f:77", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cd3fe2-71", "ovs_interfaceid": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Start _get_guest_xml network_info=[{"id": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "address": "fa:16:3e:40:9f:77", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cd3fe2-71", "ovs_interfaceid": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:51:32 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:51:32 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:51:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-443912707',display_name='tempest-AttachVolumeTestJSON-server-443912707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-443912707',id=27,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJi4rJ66uDbl8M6kWEU4dwLt1DoX5K5psifNCTqjOMZuu30qL8ZqQQ5ssFjfaj0KauTZE4cskQso16o6rC6UgJzDACM04knR1T9gBcbjcvj3T+5NlahW7S81EIsSSd7zA==',key_name='tempest-keypair-216498992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d0151a0736b41f498b591b4d3e1a052',ramdisk_id='',reservation_id='r-u9ksv5kp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-93032782',owner_user_name='tempest-AttachVolumeTestJSON-93032782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:51:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b101389f26a84404b72cfc088ec03869',uuid=2d21fbf8-55f3-4acf-8be2-e19a04c0f295,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "address": "fa:16:3e:40:9f:77", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cd3fe2-71", "ovs_interfaceid": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Converting VIF {"id": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "address": "fa:16:3e:40:9f:77", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cd3fe2-71", "ovs_interfaceid": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:9f:77,bridge_name='br-int',has_traffic_filtering=True,id=62cd3fe2-71e3-478e-ad29-819df0de80f9,network=Network(b40bde43-b1d2-4eb4-938c-55c626640880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cd3fe2-71') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.objects.instance [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:51:32 user nova-compute[75378]:   <uuid>2d21fbf8-55f3-4acf-8be2-e19a04c0f295</uuid>
Nov 09 03:51:32 user nova-compute[75378]:   <name>instance-0000001b</name>
Nov 09 03:51:32 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:51:32 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:51:32 user nova-compute[75378]:   <metadata>
Nov 09 03:51:32 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:51:32 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:51:32 user nova-compute[75378]:       <nova:name>tempest-AttachVolumeTestJSON-server-443912707</nova:name>
Nov 09 03:51:32 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:51:32</nova:creationTime>
Nov 09 03:51:32 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:51:32 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:51:32 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:51:32 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:51:32 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:51:32 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:51:32 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:51:32 user nova-compute[75378]:       <nova:owner>
Nov 09 03:51:32 user nova-compute[75378]:         <nova:user uuid="b101389f26a84404b72cfc088ec03869">tempest-AttachVolumeTestJSON-93032782-project-member</nova:user>
Nov 09 03:51:32 user nova-compute[75378]:         <nova:project uuid="8d0151a0736b41f498b591b4d3e1a052">tempest-AttachVolumeTestJSON-93032782</nova:project>
Nov 09 03:51:32 user nova-compute[75378]:       </nova:owner>
Nov 09 03:51:32 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:51:32 user nova-compute[75378]:       <nova:ports>
Nov 09 03:51:32 user nova-compute[75378]:         <nova:port uuid="62cd3fe2-71e3-478e-ad29-819df0de80f9">
Nov 09 03:51:32 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 09 03:51:32 user nova-compute[75378]:         </nova:port>
Nov 09 03:51:32 user nova-compute[75378]:       </nova:ports>
Nov 09 03:51:32 user nova-compute[75378]:     </nova:instance>
Nov 09 03:51:32 user nova-compute[75378]:   </metadata>
Nov 09 03:51:32 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:51:32 user nova-compute[75378]:     <system>
Nov 09 03:51:32 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:51:32 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:51:32 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:51:32 user nova-compute[75378]:       <entry name="serial">2d21fbf8-55f3-4acf-8be2-e19a04c0f295</entry>
Nov 09 03:51:32 user nova-compute[75378]:       <entry name="uuid">2d21fbf8-55f3-4acf-8be2-e19a04c0f295</entry>
Nov 09 03:51:32 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:51:32 user nova-compute[75378]:     </system>
Nov 09 03:51:32 user nova-compute[75378]:   </sysinfo>
Nov 09 03:51:32 user nova-compute[75378]:   <os>
Nov 09 03:51:32 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:51:32 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:51:32 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:51:32 user nova-compute[75378]:   </os>
Nov 09 03:51:32 user nova-compute[75378]:   <features>
Nov 09 03:51:32 user nova-compute[75378]:     <acpi/>
Nov 09 03:51:32 user nova-compute[75378]:     <apic/>
Nov 09 03:51:32 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:51:32 user nova-compute[75378]:   </features>
Nov 09 03:51:32 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:51:32 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:51:32 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:51:32 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:51:32 user nova-compute[75378]:   </clock>
Nov 09 03:51:32 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:51:32 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:51:32 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:51:32 user nova-compute[75378]:   </cpu>
Nov 09 03:51:32 user nova-compute[75378]:   <devices>
Nov 09 03:51:32 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:51:32 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:51:32 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk"/>
Nov 09 03:51:32 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:51:32 user nova-compute[75378]:     </disk>
Nov 09 03:51:32 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:51:32 user nova-compute[75378]:       <mac address="fa:16:3e:40:9f:77"/>
Nov 09 03:51:32 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:51:32 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:51:32 user nova-compute[75378]:       <target dev="tap62cd3fe2-71"/>
Nov 09 03:51:32 user nova-compute[75378]:     </interface>
Nov 09 03:51:32 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:51:32 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/console.log" append="off"/>
Nov 09 03:51:32 user nova-compute[75378]:     </serial>
Nov 09 03:51:32 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:51:32 user nova-compute[75378]:     <video>
Nov 09 03:51:32 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:51:32 user nova-compute[75378]:     </video>
Nov 09 03:51:32 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:51:32 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:51:32 user nova-compute[75378]:     </rng>
Nov 09 03:51:32 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:51:32 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:51:32 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:51:32 user nova-compute[75378]:     </memballoon>
Nov 09 03:51:32 user nova-compute[75378]:   </devices>
Nov 09 03:51:32 user nova-compute[75378]: </domain>
Nov 09 03:51:32 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:51:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-443912707',display_name='tempest-AttachVolumeTestJSON-server-443912707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-443912707',id=27,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJi4rJ66uDbl8M6kWEU4dwLt1DoX5K5psifNCTqjOMZuu30qL8ZqQQ5ssFjfaj0KauTZE4cskQso16o6rC6UgJzDACM04knR1T9gBcbjcvj3T+5NlahW7S81EIsSSd7zA==',key_name='tempest-keypair-216498992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d0151a0736b41f498b591b4d3e1a052',ramdisk_id='',reservation_id='r-u9ksv5kp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-93032782',owner_user_name='tempest-AttachVolumeTestJSON-93032782-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:51:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b101389f26a84404b72cfc088ec03869',uuid=2d21fbf8-55f3-4acf-8be2-e19a04c0f295,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "address": "fa:16:3e:40:9f:77", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cd3fe2-71", "ovs_interfaceid": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Converting VIF {"id": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "address": "fa:16:3e:40:9f:77", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cd3fe2-71", "ovs_interfaceid": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:9f:77,bridge_name='br-int',has_traffic_filtering=True,id=62cd3fe2-71e3-478e-ad29-819df0de80f9,network=Network(b40bde43-b1d2-4eb4-938c-55c626640880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cd3fe2-71') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG os_vif [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:9f:77,bridge_name='br-int',has_traffic_filtering=True,id=62cd3fe2-71e3-478e-ad29-819df0de80f9,network=Network(b40bde43-b1d2-4eb4-938c-55c626640880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cd3fe2-71') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '159dfd8d-01c8-5625-be8d-0c540c01b0f5', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62cd3fe2-71, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62cd3fe2-71, col_values=(('qos', UUID('db12cadc-953e-4fc1-9fe2-5c533dfd9390')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62cd3fe2-71, col_values=(('external_ids', {'iface-id': '62cd3fe2-71e3-478e-ad29-819df0de80f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:9f:77', 'vm-uuid': '2d21fbf8-55f3-4acf-8be2-e19a04c0f295'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:32 user nova-compute[75378]: INFO os_vif [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:9f:77,bridge_name='br-int',has_traffic_filtering=True,id=62cd3fe2-71e3-478e-ad29-819df0de80f9,network=Network(b40bde43-b1d2-4eb4-938c-55c626640880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cd3fe2-71')
Nov 09 03:51:32 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] No VIF found with MAC fa:16:3e:40:9f:77, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.compute.manager [req-78a325ac-0dc1-499b-a049-63bac15ca833 req-e1392c39-e76e-4ffd-9fae-ae8c2650f01c service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Received event network-changed-62cd3fe2-71e3-478e-ad29-819df0de80f9 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.compute.manager [req-78a325ac-0dc1-499b-a049-63bac15ca833 req-e1392c39-e76e-4ffd-9fae-ae8c2650f01c service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Refreshing instance network info cache due to event network-changed-62cd3fe2-71e3-478e-ad29-819df0de80f9. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-78a325ac-0dc1-499b-a049-63bac15ca833 req-e1392c39-e76e-4ffd-9fae-ae8c2650f01c service nova] Acquiring lock "refresh_cache-2d21fbf8-55f3-4acf-8be2-e19a04c0f295" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-78a325ac-0dc1-499b-a049-63bac15ca833 req-e1392c39-e76e-4ffd-9fae-ae8c2650f01c service nova] Acquired lock "refresh_cache-2d21fbf8-55f3-4acf-8be2-e19a04c0f295" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.network.neutron [req-78a325ac-0dc1-499b-a049-63bac15ca833 req-e1392c39-e76e-4ffd-9fae-ae8c2650f01c service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Refreshing network info cache for port 62cd3fe2-71e3-478e-ad29-819df0de80f9 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.network.neutron [req-78a325ac-0dc1-499b-a049-63bac15ca833 req-e1392c39-e76e-4ffd-9fae-ae8c2650f01c service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Updated VIF entry in instance network info cache for port 62cd3fe2-71e3-478e-ad29-819df0de80f9. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG nova.network.neutron [req-78a325ac-0dc1-499b-a049-63bac15ca833 req-e1392c39-e76e-4ffd-9fae-ae8c2650f01c service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Updating instance_info_cache with network_info: [{"id": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "address": "fa:16:3e:40:9f:77", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cd3fe2-71", "ovs_interfaceid": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:51:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-78a325ac-0dc1-499b-a049-63bac15ca833 req-e1392c39-e76e-4ffd-9fae-ae8c2650f01c service nova] Releasing lock "refresh_cache-2d21fbf8-55f3-4acf-8be2-e19a04c0f295" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:51:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:34 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:51:34 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:51:34 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:51:34 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:51:34 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:51:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:34 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:51:34 user nova-compute[75378]: DEBUG nova.compute.manager [req-6aea66cc-fe52-4b7e-9244-4bf1444549ef req-1ff5d007-07b4-458e-a53f-00fc26d89519 service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Received event network-vif-plugged-62cd3fe2-71e3-478e-ad29-819df0de80f9 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:51:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6aea66cc-fe52-4b7e-9244-4bf1444549ef req-1ff5d007-07b4-458e-a53f-00fc26d89519 service nova] Acquiring lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6aea66cc-fe52-4b7e-9244-4bf1444549ef req-1ff5d007-07b4-458e-a53f-00fc26d89519 service nova] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6aea66cc-fe52-4b7e-9244-4bf1444549ef req-1ff5d007-07b4-458e-a53f-00fc26d89519 service nova] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:34 user nova-compute[75378]: DEBUG nova.compute.manager [req-6aea66cc-fe52-4b7e-9244-4bf1444549ef req-1ff5d007-07b4-458e-a53f-00fc26d89519 service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] No waiting events found dispatching network-vif-plugged-62cd3fe2-71e3-478e-ad29-819df0de80f9 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:51:34 user nova-compute[75378]: WARNING nova.compute.manager [req-6aea66cc-fe52-4b7e-9244-4bf1444549ef req-1ff5d007-07b4-458e-a53f-00fc26d89519 service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Received unexpected event network-vif-plugged-62cd3fe2-71e3-478e-ad29-819df0de80f9 for instance with vm_state building and task_state spawning.
Nov 09 03:51:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.compute.manager [req-799de79e-b28c-42b6-bf47-7ed04b55c3cf req-507f2850-2011-4b6f-85d5-7eb335ebd79d service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received event network-changed-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.compute.manager [req-799de79e-b28c-42b6-bf47-7ed04b55c3cf req-507f2850-2011-4b6f-85d5-7eb335ebd79d service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Refreshing instance network info cache due to event network-changed-e4725ee0-c613-48af-8163-eafad2605fff. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-799de79e-b28c-42b6-bf47-7ed04b55c3cf req-507f2850-2011-4b6f-85d5-7eb335ebd79d service nova] Acquiring lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-799de79e-b28c-42b6-bf47-7ed04b55c3cf req-507f2850-2011-4b6f-85d5-7eb335ebd79d service nova] Acquired lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.network.neutron [req-799de79e-b28c-42b6-bf47-7ed04b55c3cf req-507f2850-2011-4b6f-85d5-7eb335ebd79d service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Refreshing network info cache for port e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:51:36 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Instance spawned successfully.
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.compute.manager [req-dc322896-832d-44b5-a279-554ecb52035f req-3f27c100-3597-45c7-9bb1-6599a24e4a6b service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Received event network-vif-plugged-62cd3fe2-71e3-478e-ad29-819df0de80f9 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-dc322896-832d-44b5-a279-554ecb52035f req-3f27c100-3597-45c7-9bb1-6599a24e4a6b service nova] Acquiring lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-dc322896-832d-44b5-a279-554ecb52035f req-3f27c100-3597-45c7-9bb1-6599a24e4a6b service nova] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-dc322896-832d-44b5-a279-554ecb52035f req-3f27c100-3597-45c7-9bb1-6599a24e4a6b service nova] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.compute.manager [req-dc322896-832d-44b5-a279-554ecb52035f req-3f27c100-3597-45c7-9bb1-6599a24e4a6b service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] No waiting events found dispatching network-vif-plugged-62cd3fe2-71e3-478e-ad29-819df0de80f9 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:51:36 user nova-compute[75378]: WARNING nova.compute.manager [req-dc322896-832d-44b5-a279-554ecb52035f req-3f27c100-3597-45c7-9bb1-6599a24e4a6b service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Received unexpected event network-vif-plugged-62cd3fe2-71e3-478e-ad29-819df0de80f9 for instance with vm_state building and task_state spawning.
Nov 09 03:51:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:36 user nova-compute[75378]: INFO nova.compute.manager [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Took 6.87 seconds to spawn the instance on the hypervisor.
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:51:36 user nova-compute[75378]: INFO nova.compute.manager [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Took 7.87 seconds to build instance.
Nov 09 03:51:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b01acf05-8186-439a-836c-8c697c298cb0 tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.004s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:36 user nova-compute[75378]: INFO nova.compute.manager [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Detaching volume 49c0abde-7447-477d-8cff-0a805a87bf0f
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.network.neutron [req-799de79e-b28c-42b6-bf47-7ed04b55c3cf req-507f2850-2011-4b6f-85d5-7eb335ebd79d service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Updated VIF entry in instance network info cache for port e4725ee0-c613-48af-8163-eafad2605fff. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.network.neutron [req-799de79e-b28c-42b6-bf47-7ed04b55c3cf req-507f2850-2011-4b6f-85d5-7eb335ebd79d service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Updating instance_info_cache with network_info: [{"id": "e4725ee0-c613-48af-8163-eafad2605fff", "address": "fa:16:3e:89:f8:61", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4725ee0-c6", "ovs_interfaceid": "e4725ee0-c613-48af-8163-eafad2605fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:51:36 user nova-compute[75378]: INFO nova.virt.block_device [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Attempting to driver detach volume 49c0abde-7447-477d-8cff-0a805a87bf0f from mountpoint /dev/vdb
Nov 09 03:51:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-799de79e-b28c-42b6-bf47-7ed04b55c3cf req-507f2850-2011-4b6f-85d5-7eb335ebd79d service nova] Releasing lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Attempting to detach device vdb from instance 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:51:36 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:51:36 user nova-compute[75378]:   <source dev="/dev/sdb"/>
Nov 09 03:51:36 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:51:36 user nova-compute[75378]:   <serial>49c0abde-7447-477d-8cff-0a805a87bf0f</serial>
Nov 09 03:51:36 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 03:51:36 user nova-compute[75378]: </disk>
Nov 09 03:51:36 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:51:36 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Successfully detached device vdb from instance 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 from the persistent domain config.
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:51:36 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:51:36 user nova-compute[75378]:   <source dev="/dev/sdb"/>
Nov 09 03:51:36 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:51:36 user nova-compute[75378]:   <serial>49c0abde-7447-477d-8cff-0a805a87bf0f</serial>
Nov 09 03:51:36 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 03:51:36 user nova-compute[75378]: </disk>
Nov 09 03:51:36 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 03:51:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:51:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:51:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:38 user nova-compute[75378]: DEBUG nova.compute.manager [req-80f33b2c-9c6f-4fd9-b051-d0e4f8a63bdc req-5816b2c0-7976-4ec7-b1ff-3f45ccf9c6fc service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received event network-changed-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:51:38 user nova-compute[75378]: DEBUG nova.compute.manager [req-80f33b2c-9c6f-4fd9-b051-d0e4f8a63bdc req-5816b2c0-7976-4ec7-b1ff-3f45ccf9c6fc service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Refreshing instance network info cache due to event network-changed-e4725ee0-c613-48af-8163-eafad2605fff. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:51:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-80f33b2c-9c6f-4fd9-b051-d0e4f8a63bdc req-5816b2c0-7976-4ec7-b1ff-3f45ccf9c6fc service nova] Acquiring lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:51:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-80f33b2c-9c6f-4fd9-b051-d0e4f8a63bdc req-5816b2c0-7976-4ec7-b1ff-3f45ccf9c6fc service nova] Acquired lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:51:38 user nova-compute[75378]: DEBUG nova.network.neutron [req-80f33b2c-9c6f-4fd9-b051-d0e4f8a63bdc req-5816b2c0-7976-4ec7-b1ff-3f45ccf9c6fc service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Refreshing network info cache for port e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:51:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:51:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:38 user nova-compute[75378]: DEBUG nova.network.neutron [req-80f33b2c-9c6f-4fd9-b051-d0e4f8a63bdc req-5816b2c0-7976-4ec7-b1ff-3f45ccf9c6fc service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Updated VIF entry in instance network info cache for port e4725ee0-c613-48af-8163-eafad2605fff. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:51:38 user nova-compute[75378]: DEBUG nova.network.neutron [req-80f33b2c-9c6f-4fd9-b051-d0e4f8a63bdc req-5816b2c0-7976-4ec7-b1ff-3f45ccf9c6fc service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Updating instance_info_cache with network_info: [{"id": "e4725ee0-c613-48af-8163-eafad2605fff", "address": "fa:16:3e:89:f8:61", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4725ee0-c6", "ovs_interfaceid": "e4725ee0-c613-48af-8163-eafad2605fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:51:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-80f33b2c-9c6f-4fd9-b051-d0e4f8a63bdc req-5816b2c0-7976-4ec7-b1ff-3f45ccf9c6fc service nova] Releasing lock "refresh_cache-89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:51:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:39 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:51:39 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:51:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7843MB free_disk=25.111007690429688GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:51:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:51:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:51:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7d051405-6b57-4db2-9533-c2f4e87134d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:51:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:51:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2c2acb48-972a-41d7-987e-48e79b3bef93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:51:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 013db901-fbee-4593-a14f-95a03e79fad0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:51:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 06216917-d7d1-4fd4-a311-e054437e84a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:51:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2abe50f8-3c9b-417e-889f-1d565089d678 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:51:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance ed92e04a-56ec-42f1-bed3-8b28a37d1475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:51:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:51:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:51:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:51:40 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:51:40 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:51:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:51:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.645s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:43 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:51:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "11f18164-9676-4a8a-91be-8bd87673ec5b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "11f18164-9676-4a8a-91be-8bd87673ec5b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:51:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:47 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:51:47 user nova-compute[75378]: INFO nova.compute.claims [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Claim successful on node user
Nov 09 03:51:47 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:51:47 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:51:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:51:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:51:47 user nova-compute[75378]: DEBUG nova.network.neutron [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:51:47 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:51:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:51:47 user nova-compute[75378]: DEBUG nova.policy [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57efcfeacd7f4daf916e7dd04e11d8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2176531ffa4cf7bec818309e39ab8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:51:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:51:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:51:48 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Creating image(s)
Nov 09 03:51:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "/opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "/opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "/opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.255s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.270s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk 1073741824" returned: 0 in 0.068s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.348s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:48 user nova-compute[75378]: DEBUG nova.network.neutron [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Successfully created port: a18b5039-3584-437a-b55f-b72630693484 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:51:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.258s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:48 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:51:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:49 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Cannot resize image /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:51:49 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:51:49 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Ensure instance console log exists: /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:51:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:49 user nova-compute[75378]: DEBUG nova.compute.manager [req-19f749ee-379e-4ffb-916f-7b94f2a03c04 req-2321a01e-8f9c-4084-8e9b-197b258dc7f4 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Received event network-changed-f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:51:49 user nova-compute[75378]: DEBUG nova.compute.manager [req-19f749ee-379e-4ffb-916f-7b94f2a03c04 req-2321a01e-8f9c-4084-8e9b-197b258dc7f4 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Refreshing instance network info cache due to event network-changed-f18d71ff-8728-41e9-82bf-3d66e09e552a. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:51:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-19f749ee-379e-4ffb-916f-7b94f2a03c04 req-2321a01e-8f9c-4084-8e9b-197b258dc7f4 service nova] Acquiring lock "refresh_cache-06216917-d7d1-4fd4-a311-e054437e84a6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:51:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-19f749ee-379e-4ffb-916f-7b94f2a03c04 req-2321a01e-8f9c-4084-8e9b-197b258dc7f4 service nova] Acquired lock "refresh_cache-06216917-d7d1-4fd4-a311-e054437e84a6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:51:49 user nova-compute[75378]: DEBUG nova.network.neutron [req-19f749ee-379e-4ffb-916f-7b94f2a03c04 req-2321a01e-8f9c-4084-8e9b-197b258dc7f4 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Refreshing network info cache for port f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:51:49 user nova-compute[75378]: DEBUG nova.network.neutron [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Successfully updated port: a18b5039-3584-437a-b55f-b72630693484 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:51:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "refresh_cache-11f18164-9676-4a8a-91be-8bd87673ec5b" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:51:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquired lock "refresh_cache-11f18164-9676-4a8a-91be-8bd87673ec5b" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:51:49 user nova-compute[75378]: DEBUG nova.network.neutron [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:51:49 user nova-compute[75378]: DEBUG nova.compute.manager [req-c072b471-fe69-4591-90dd-4710628d30a9 req-dc2ace8d-11e6-4c00-99cc-c65d35a13540 service nova] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Received event network-changed-a18b5039-3584-437a-b55f-b72630693484 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:51:49 user nova-compute[75378]: DEBUG nova.compute.manager [req-c072b471-fe69-4591-90dd-4710628d30a9 req-dc2ace8d-11e6-4c00-99cc-c65d35a13540 service nova] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Refreshing instance network info cache due to event network-changed-a18b5039-3584-437a-b55f-b72630693484. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:51:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c072b471-fe69-4591-90dd-4710628d30a9 req-dc2ace8d-11e6-4c00-99cc-c65d35a13540 service nova] Acquiring lock "refresh_cache-11f18164-9676-4a8a-91be-8bd87673ec5b" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:51:49 user nova-compute[75378]: DEBUG nova.network.neutron [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:51:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.network.neutron [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Updating instance_info_cache with network_info: [{"id": "a18b5039-3584-437a-b55f-b72630693484", "address": "fa:16:3e:f3:24:46", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa18b5039-35", "ovs_interfaceid": "a18b5039-3584-437a-b55f-b72630693484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Releasing lock "refresh_cache-11f18164-9676-4a8a-91be-8bd87673ec5b" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.compute.manager [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Instance network_info: |[{"id": "a18b5039-3584-437a-b55f-b72630693484", "address": "fa:16:3e:f3:24:46", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa18b5039-35", "ovs_interfaceid": "a18b5039-3584-437a-b55f-b72630693484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c072b471-fe69-4591-90dd-4710628d30a9 req-dc2ace8d-11e6-4c00-99cc-c65d35a13540 service nova] Acquired lock "refresh_cache-11f18164-9676-4a8a-91be-8bd87673ec5b" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.network.neutron [req-c072b471-fe69-4591-90dd-4710628d30a9 req-dc2ace8d-11e6-4c00-99cc-c65d35a13540 service nova] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Refreshing network info cache for port a18b5039-3584-437a-b55f-b72630693484 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Start _get_guest_xml network_info=[{"id": "a18b5039-3584-437a-b55f-b72630693484", "address": "fa:16:3e:f3:24:46", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa18b5039-35", "ovs_interfaceid": "a18b5039-3584-437a-b55f-b72630693484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:51:50 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:51:50 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1322564567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1322564567',id=28,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c2176531ffa4cf7bec818309e39ab8d',ramdisk_id='',reservation_id='r-42iirc0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:51:48Z,user_data=None,user_id='57efcfeacd7f4daf916e7dd04e11d8f2',uuid=11f18164-9676-4a8a-91be-8bd87673ec5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a18b5039-3584-437a-b55f-b72630693484", "address": "fa:16:3e:f3:24:46", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa18b5039-35", "ovs_interfaceid": "a18b5039-3584-437a-b55f-b72630693484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converting VIF {"id": "a18b5039-3584-437a-b55f-b72630693484", "address": "fa:16:3e:f3:24:46", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa18b5039-35", "ovs_interfaceid": "a18b5039-3584-437a-b55f-b72630693484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:24:46,bridge_name='br-int',has_traffic_filtering=True,id=a18b5039-3584-437a-b55f-b72630693484,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa18b5039-35') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.objects.instance [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'pci_devices' on Instance uuid 11f18164-9676-4a8a-91be-8bd87673ec5b {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:51:50 user nova-compute[75378]:   <uuid>11f18164-9676-4a8a-91be-8bd87673ec5b</uuid>
Nov 09 03:51:50 user nova-compute[75378]:   <name>instance-0000001c</name>
Nov 09 03:51:50 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:51:50 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:51:50 user nova-compute[75378]:   <metadata>
Nov 09 03:51:50 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:51:50 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:51:50 user nova-compute[75378]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1322564567</nova:name>
Nov 09 03:51:50 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:51:50</nova:creationTime>
Nov 09 03:51:50 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:51:50 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:51:50 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:51:50 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:51:50 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:51:50 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:51:50 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:51:50 user nova-compute[75378]:       <nova:owner>
Nov 09 03:51:50 user nova-compute[75378]:         <nova:user uuid="57efcfeacd7f4daf916e7dd04e11d8f2">tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member</nova:user>
Nov 09 03:51:50 user nova-compute[75378]:         <nova:project uuid="4c2176531ffa4cf7bec818309e39ab8d">tempest-ServerBootFromVolumeStableRescueTest-1679422577</nova:project>
Nov 09 03:51:50 user nova-compute[75378]:       </nova:owner>
Nov 09 03:51:50 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:51:50 user nova-compute[75378]:       <nova:ports>
Nov 09 03:51:50 user nova-compute[75378]:         <nova:port uuid="a18b5039-3584-437a-b55f-b72630693484">
Nov 09 03:51:50 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 09 03:51:50 user nova-compute[75378]:         </nova:port>
Nov 09 03:51:50 user nova-compute[75378]:       </nova:ports>
Nov 09 03:51:50 user nova-compute[75378]:     </nova:instance>
Nov 09 03:51:50 user nova-compute[75378]:   </metadata>
Nov 09 03:51:50 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:51:50 user nova-compute[75378]:     <system>
Nov 09 03:51:50 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:51:50 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:51:50 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:51:50 user nova-compute[75378]:       <entry name="serial">11f18164-9676-4a8a-91be-8bd87673ec5b</entry>
Nov 09 03:51:50 user nova-compute[75378]:       <entry name="uuid">11f18164-9676-4a8a-91be-8bd87673ec5b</entry>
Nov 09 03:51:50 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:51:50 user nova-compute[75378]:     </system>
Nov 09 03:51:50 user nova-compute[75378]:   </sysinfo>
Nov 09 03:51:50 user nova-compute[75378]:   <os>
Nov 09 03:51:50 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:51:50 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:51:50 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:51:50 user nova-compute[75378]:   </os>
Nov 09 03:51:50 user nova-compute[75378]:   <features>
Nov 09 03:51:50 user nova-compute[75378]:     <acpi/>
Nov 09 03:51:50 user nova-compute[75378]:     <apic/>
Nov 09 03:51:50 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:51:50 user nova-compute[75378]:   </features>
Nov 09 03:51:50 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:51:50 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:51:50 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:51:50 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:51:50 user nova-compute[75378]:   </clock>
Nov 09 03:51:50 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:51:50 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:51:50 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:51:50 user nova-compute[75378]:   </cpu>
Nov 09 03:51:50 user nova-compute[75378]:   <devices>
Nov 09 03:51:50 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:51:50 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:51:50 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk"/>
Nov 09 03:51:50 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:51:50 user nova-compute[75378]:     </disk>
Nov 09 03:51:50 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:51:50 user nova-compute[75378]:       <mac address="fa:16:3e:f3:24:46"/>
Nov 09 03:51:50 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:51:50 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:51:50 user nova-compute[75378]:       <target dev="tapa18b5039-35"/>
Nov 09 03:51:50 user nova-compute[75378]:     </interface>
Nov 09 03:51:50 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:51:50 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/console.log" append="off"/>
Nov 09 03:51:50 user nova-compute[75378]:     </serial>
Nov 09 03:51:50 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:51:50 user nova-compute[75378]:     <video>
Nov 09 03:51:50 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:51:50 user nova-compute[75378]:     </video>
Nov 09 03:51:50 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:51:50 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:51:50 user nova-compute[75378]:     </rng>
Nov 09 03:51:50 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:51:50 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:51:50 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:51:50 user nova-compute[75378]:     </memballoon>
Nov 09 03:51:50 user nova-compute[75378]:   </devices>
Nov 09 03:51:50 user nova-compute[75378]: </domain>
Nov 09 03:51:50 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1322564567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1322564567',id=28,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c2176531ffa4cf7bec818309e39ab8d',ramdisk_id='',reservation_id='r-42iirc0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:51:48Z,user_data=None,user_id='57efcfeacd7f4daf916e7dd04e11d8f2',uuid=11f18164-9676-4a8a-91be-8bd87673ec5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a18b5039-3584-437a-b55f-b72630693484", "address": "fa:16:3e:f3:24:46", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa18b5039-35", "ovs_interfaceid": "a18b5039-3584-437a-b55f-b72630693484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converting VIF {"id": "a18b5039-3584-437a-b55f-b72630693484", "address": "fa:16:3e:f3:24:46", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa18b5039-35", "ovs_interfaceid": "a18b5039-3584-437a-b55f-b72630693484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:24:46,bridge_name='br-int',has_traffic_filtering=True,id=a18b5039-3584-437a-b55f-b72630693484,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa18b5039-35') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG os_vif [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:24:46,bridge_name='br-int',has_traffic_filtering=True,id=a18b5039-3584-437a-b55f-b72630693484,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa18b5039-35') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a2e4aa4-284b-528f-bee5-ce81246f1721', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa18b5039-35, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa18b5039-35, col_values=(('qos', UUID('1281a110-0a1d-4729-8f6e-9f44c800cc4c')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa18b5039-35, col_values=(('external_ids', {'iface-id': 'a18b5039-3584-437a-b55f-b72630693484', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:24:46', 'vm-uuid': '11f18164-9676-4a8a-91be-8bd87673ec5b'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:50 user nova-compute[75378]: INFO os_vif [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:24:46,bridge_name='br-int',has_traffic_filtering=True,id=a18b5039-3584-437a-b55f-b72630693484,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa18b5039-35')
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] No VIF found with MAC fa:16:3e:f3:24:46, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.network.neutron [req-19f749ee-379e-4ffb-916f-7b94f2a03c04 req-2321a01e-8f9c-4084-8e9b-197b258dc7f4 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Updated VIF entry in instance network info cache for port f18d71ff-8728-41e9-82bf-3d66e09e552a. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.network.neutron [req-19f749ee-379e-4ffb-916f-7b94f2a03c04 req-2321a01e-8f9c-4084-8e9b-197b258dc7f4 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Updating instance_info_cache with network_info: [{"id": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "address": "fa:16:3e:a8:c1:72", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d71ff-87", "ovs_interfaceid": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-19f749ee-379e-4ffb-916f-7b94f2a03c04 req-2321a01e-8f9c-4084-8e9b-197b258dc7f4 service nova] Releasing lock "refresh_cache-06216917-d7d1-4fd4-a311-e054437e84a6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-baa55c33-b283-40e5-b2b8-3f1faf8c7bde req-5731a836-5f70-492d-ae9f-1b5de3e2472e service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Received event network-changed-f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-baa55c33-b283-40e5-b2b8-3f1faf8c7bde req-5731a836-5f70-492d-ae9f-1b5de3e2472e service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Refreshing instance network info cache due to event network-changed-f18d71ff-8728-41e9-82bf-3d66e09e552a. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-baa55c33-b283-40e5-b2b8-3f1faf8c7bde req-5731a836-5f70-492d-ae9f-1b5de3e2472e service nova] Acquiring lock "refresh_cache-06216917-d7d1-4fd4-a311-e054437e84a6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-baa55c33-b283-40e5-b2b8-3f1faf8c7bde req-5731a836-5f70-492d-ae9f-1b5de3e2472e service nova] Acquired lock "refresh_cache-06216917-d7d1-4fd4-a311-e054437e84a6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.network.neutron [req-baa55c33-b283-40e5-b2b8-3f1faf8c7bde req-5731a836-5f70-492d-ae9f-1b5de3e2472e service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Refreshing network info cache for port f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.network.neutron [req-c072b471-fe69-4591-90dd-4710628d30a9 req-dc2ace8d-11e6-4c00-99cc-c65d35a13540 service nova] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Updated VIF entry in instance network info cache for port a18b5039-3584-437a-b55f-b72630693484. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:51:50 user nova-compute[75378]: DEBUG nova.network.neutron [req-c072b471-fe69-4591-90dd-4710628d30a9 req-dc2ace8d-11e6-4c00-99cc-c65d35a13540 service nova] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Updating instance_info_cache with network_info: [{"id": "a18b5039-3584-437a-b55f-b72630693484", "address": "fa:16:3e:f3:24:46", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa18b5039-35", "ovs_interfaceid": "a18b5039-3584-437a-b55f-b72630693484", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:51:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c072b471-fe69-4591-90dd-4710628d30a9 req-dc2ace8d-11e6-4c00-99cc-c65d35a13540 service nova] Releasing lock "refresh_cache-11f18164-9676-4a8a-91be-8bd87673ec5b" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:51:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "06216917-d7d1-4fd4-a311-e054437e84a6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "06216917-d7d1-4fd4-a311-e054437e84a6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:51 user nova-compute[75378]: INFO nova.compute.manager [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Detaching volume 2fdd9b92-de5f-4df9-9994-444624a88b75
Nov 09 03:51:51 user nova-compute[75378]: INFO nova.virt.block_device [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Attempting to driver detach volume 2fdd9b92-de5f-4df9-9994-444624a88b75 from mountpoint /dev/vdb
Nov 09 03:51:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Attempting to detach device vdb from instance 06216917-d7d1-4fd4-a311-e054437e84a6 from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 03:51:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:51:51 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:51:51 user nova-compute[75378]:   <source dev="/dev/sdd"/>
Nov 09 03:51:51 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:51:51 user nova-compute[75378]:   <serial>2fdd9b92-de5f-4df9-9994-444624a88b75</serial>
Nov 09 03:51:51 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 03:51:51 user nova-compute[75378]: </disk>
Nov 09 03:51:51 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:51:51 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Successfully detached device vdb from instance 06216917-d7d1-4fd4-a311-e054437e84a6 from the persistent domain config.
Nov 09 03:51:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 06216917-d7d1-4fd4-a311-e054437e84a6 from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 03:51:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:51:51 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:51:51 user nova-compute[75378]:   <source dev="/dev/sdd"/>
Nov 09 03:51:51 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:51:51 user nova-compute[75378]:   <serial>2fdd9b92-de5f-4df9-9994-444624a88b75</serial>
Nov 09 03:51:51 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 03:51:51 user nova-compute[75378]: </disk>
Nov 09 03:51:51 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:51:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:51 user nova-compute[75378]: DEBUG nova.network.neutron [req-baa55c33-b283-40e5-b2b8-3f1faf8c7bde req-5731a836-5f70-492d-ae9f-1b5de3e2472e service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Updated VIF entry in instance network info cache for port f18d71ff-8728-41e9-82bf-3d66e09e552a. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:51:51 user nova-compute[75378]: DEBUG nova.network.neutron [req-baa55c33-b283-40e5-b2b8-3f1faf8c7bde req-5731a836-5f70-492d-ae9f-1b5de3e2472e service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Updating instance_info_cache with network_info: [{"id": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "address": "fa:16:3e:a8:c1:72", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d71ff-87", "ovs_interfaceid": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:51:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-baa55c33-b283-40e5-b2b8-3f1faf8c7bde req-5731a836-5f70-492d-ae9f-1b5de3e2472e service nova] Releasing lock "refresh_cache-06216917-d7d1-4fd4-a311-e054437e84a6" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:51:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 06216917-d7d1-4fd4-a311-e054437e84a6 {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 03:51:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:52 user nova-compute[75378]: DEBUG nova.compute.manager [req-634de714-8e9e-4ccd-8f4b-cf0617dcdb3e req-f5843348-6ac3-4f95-8fa4-c13b719d4071 service nova] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Received event network-vif-plugged-a18b5039-3584-437a-b55f-b72630693484 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:51:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-634de714-8e9e-4ccd-8f4b-cf0617dcdb3e req-f5843348-6ac3-4f95-8fa4-c13b719d4071 service nova] Acquiring lock "11f18164-9676-4a8a-91be-8bd87673ec5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-634de714-8e9e-4ccd-8f4b-cf0617dcdb3e req-f5843348-6ac3-4f95-8fa4-c13b719d4071 service nova] Lock "11f18164-9676-4a8a-91be-8bd87673ec5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-634de714-8e9e-4ccd-8f4b-cf0617dcdb3e req-f5843348-6ac3-4f95-8fa4-c13b719d4071 service nova] Lock "11f18164-9676-4a8a-91be-8bd87673ec5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:52 user nova-compute[75378]: DEBUG nova.compute.manager [req-634de714-8e9e-4ccd-8f4b-cf0617dcdb3e req-f5843348-6ac3-4f95-8fa4-c13b719d4071 service nova] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] No waiting events found dispatching network-vif-plugged-a18b5039-3584-437a-b55f-b72630693484 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:51:52 user nova-compute[75378]: WARNING nova.compute.manager [req-634de714-8e9e-4ccd-8f4b-cf0617dcdb3e req-f5843348-6ac3-4f95-8fa4-c13b719d4071 service nova] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Received unexpected event network-vif-plugged-a18b5039-3584-437a-b55f-b72630693484 for instance with vm_state building and task_state spawning.
Nov 09 03:51:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:54 user nova-compute[75378]: DEBUG nova.compute.manager [req-7ea2387f-0be2-407f-94a3-edd682deadc2 req-66524451-f87e-4781-b960-cddecc545f31 service nova] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Received event network-vif-plugged-a18b5039-3584-437a-b55f-b72630693484 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:51:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7ea2387f-0be2-407f-94a3-edd682deadc2 req-66524451-f87e-4781-b960-cddecc545f31 service nova] Acquiring lock "11f18164-9676-4a8a-91be-8bd87673ec5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:51:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7ea2387f-0be2-407f-94a3-edd682deadc2 req-66524451-f87e-4781-b960-cddecc545f31 service nova] Lock "11f18164-9676-4a8a-91be-8bd87673ec5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:51:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7ea2387f-0be2-407f-94a3-edd682deadc2 req-66524451-f87e-4781-b960-cddecc545f31 service nova] Lock "11f18164-9676-4a8a-91be-8bd87673ec5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:54 user nova-compute[75378]: DEBUG nova.compute.manager [req-7ea2387f-0be2-407f-94a3-edd682deadc2 req-66524451-f87e-4781-b960-cddecc545f31 service nova] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] No waiting events found dispatching network-vif-plugged-a18b5039-3584-437a-b55f-b72630693484 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:51:54 user nova-compute[75378]: WARNING nova.compute.manager [req-7ea2387f-0be2-407f-94a3-edd682deadc2 req-66524451-f87e-4781-b960-cddecc545f31 service nova] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Received unexpected event network-vif-plugged-a18b5039-3584-437a-b55f-b72630693484 for instance with vm_state building and task_state spawning.
Nov 09 03:51:54 user nova-compute[75378]: DEBUG nova.compute.manager [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:51:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:51:54 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Instance spawned successfully.
Nov 09 03:51:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:51:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:51:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:51:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:51:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:51:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:51:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:51:54 user nova-compute[75378]: INFO nova.compute.manager [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Took 6.88 seconds to spawn the instance on the hypervisor.
Nov 09 03:51:54 user nova-compute[75378]: DEBUG nova.compute.manager [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:51:55 user nova-compute[75378]: INFO nova.compute.manager [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Took 7.73 seconds to build instance.
Nov 09 03:51:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-25efc278-f87d-4939-b65e-792c82a38b45 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "11f18164-9676-4a8a-91be-8bd87673ec5b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.852s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:51:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:51:57 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 is timed out.
Nov 09 03:51:57 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Successfully detached device vdb from instance 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 from the live domain config.
Nov 09 03:51:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RJIcuhgv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:51:57 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:51:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37986bb-1e04-44d6-a9e9-f075ff0c2ea4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:51:57 user nova-compute[75378]: No targets found.
Nov 09 03:51:57 user nova-compute[75378]: iSNS:
Nov 09 03:51:57 user nova-compute[75378]: No targets found.
Nov 09 03:51:57 user nova-compute[75378]: STATIC:
Nov 09 03:51:57 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f
Nov 09 03:51:57 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:51:57 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:51:57 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 03:51:57 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:51:57 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:51:57 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c
Nov 09 03:51:57 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:51:57 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:51:57 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75
Nov 09 03:51:57 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:51:57 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:51:57 user nova-compute[75378]: FIRMWARE:
Nov 09 03:51:57 user nova-compute[75378]: No targets found.
Nov 09 03:51:57 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:51:57 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:51:57 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0f2f1d-8010-4dba-80ce-0459a25fe6a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa06d23-a069-492a-83f7-867028bfe1ce]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:51:57 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:51:57 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:51:57 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:51:57 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:51:57 user nova-compute[75378]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f (non-flash)
Nov 09 03:51:57 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:51:57 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:51:57 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c4293f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f'): ({'sdb'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Removing single pathed devices sdb {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[54449ec8-9b73-4d03-a1b7-6d909699f41f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba82101-c74d-4d47-ad62-2f8a688fefd4]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Flushing IO for device /dev/sdb {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9157eca1-7dee-4c1c-8956-e8691ebeb165]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d0de69-ef41-4bcd-929a-be5834aecaeb]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31fe768-1d46-48a1-abd7-8dd364310eaa]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf4d1e8-49a1-4732-92f0-cd2c78acd3f6]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f, portal: 172.16.0.220,3260]
Nov 09 03:51:57 user nova-compute[75378]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f, portal: 172.16.0.220,3260] successful.
Nov 09 03:51:57 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49c0abde-7447-477d-8cff-0a805a87bf0f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dc630f-7d23-4040-a710-17d86a0eb8ea]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] <== disconnect_volume: return (429ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:51:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:51:58 user nova-compute[75378]: DEBUG nova.objects.instance [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'flavor' on Instance uuid 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:51:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-019f11c9-e3d6-48e8-bf9a-21ae1d477e77 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.204s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FvGRQISs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:52:01 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:52:01 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:52:01 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7363334e-96da-4f80-a626-f79972e78f48]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:52:01 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e15862-1e36-457e-acb9-cfbe8c4ad057]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8] added
Nov 09 03:52:01 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fde421b-4779-4ce4-9081-16e786ade51a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0800a799-a991-4f1a-b09e-9091e8cab132]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FvGRQISs {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FvGRQISs" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5a132c-dce7-4f10-a407-934c9ddf4b84]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FvGRQISs'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb7af4f-7ad5-49eb-a2d8-c1d64432b038]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb05eda-b49f-4557-93ea-08f4d986e757]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:52:01 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:52:01 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:52:01 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:52:01 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:52:01 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:52:01 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9962a767-fd71-4502-8b13-a7a0774d1a2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8, portal: 172.16.0.220,3260]
Nov 09 03:52:01 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8, portal: 172.16.0.220,3260] successful.
Nov 09 03:52:01 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9751450c-95aa-4a70-846e-67e33f88476c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa0250b-feb1-4245-bc6d-bd138449fcc2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:52:01 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:52:01 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:52:01 user nova-compute[75378]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:52:01 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:52:01 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:52:01 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:52:01 user nova-compute[75378]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:52:01 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4544428-3f12-49ab-8849-4b85faafc77c]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:52:01 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FvGRQISs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:52:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:52:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '26431323034643564', 'path': '/dev/sdb'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:52:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431323034643564', 'path': '/dev/sdb'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:52:02 user nova-compute[75378]: DEBUG nova.objects.instance [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lazy-loading 'flavor' on Instance uuid ed92e04a-56ec-42f1-bed3-8b28a37d1475 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:52:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 03:52:02 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:52:02 user nova-compute[75378]:   <source dev="/dev/sdb"/>
Nov 09 03:52:02 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:52:02 user nova-compute[75378]:   <serial>47f376dc-cf4e-4738-9306-6b1eb440f6e8</serial>
Nov 09 03:52:02 user nova-compute[75378]: </disk>
Nov 09 03:52:02 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 03:52:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:52:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:52:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] No VIF found with MAC fa:16:3e:08:70:32, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:52:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-05632bb1-4bc9-45e6-a0de-6643c083ea94 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.646s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:05 user nova-compute[75378]: INFO nova.compute.manager [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Rebuilding instance
Nov 09 03:52:05 user nova-compute[75378]: DEBUG nova.compute.manager [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:52:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:05 user nova-compute[75378]: DEBUG nova.compute.manager [req-36071841-a24c-42fc-9554-b7f0c7ad7770 req-cdd15cab-7ca2-4dc4-a629-376ab400bcee service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Received event network-vif-unplugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:52:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-36071841-a24c-42fc-9554-b7f0c7ad7770 req-cdd15cab-7ca2-4dc4-a629-376ab400bcee service nova] Acquiring lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-36071841-a24c-42fc-9554-b7f0c7ad7770 req-cdd15cab-7ca2-4dc4-a629-376ab400bcee service nova] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-36071841-a24c-42fc-9554-b7f0c7ad7770 req-cdd15cab-7ca2-4dc4-a629-376ab400bcee service nova] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:05 user nova-compute[75378]: DEBUG nova.compute.manager [req-36071841-a24c-42fc-9554-b7f0c7ad7770 req-cdd15cab-7ca2-4dc4-a629-376ab400bcee service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] No waiting events found dispatching network-vif-unplugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:52:05 user nova-compute[75378]: WARNING nova.compute.manager [req-36071841-a24c-42fc-9554-b7f0c7ad7770 req-cdd15cab-7ca2-4dc4-a629-376ab400bcee service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Received unexpected event network-vif-unplugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 for instance with vm_state active and task_state rebuilding.
Nov 09 03:52:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:06 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Instance destroyed successfully.
Nov 09 03:52:06 user nova-compute[75378]: INFO nova.compute.manager [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Detaching volume 47f376dc-cf4e-4738-9306-6b1eb440f6e8
Nov 09 03:52:06 user nova-compute[75378]: INFO nova.virt.block_device [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Attempting to driver detach volume 47f376dc-cf4e-4738-9306-6b1eb440f6e8 from mountpoint /dev/vdb
Nov 09 03:52:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Attempting to detach device vdb from instance ed92e04a-56ec-42f1-bed3-8b28a37d1475 from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:52:06 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:52:06 user nova-compute[75378]:   <source dev="/dev/sdb"/>
Nov 09 03:52:06 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:52:06 user nova-compute[75378]:   <serial>47f376dc-cf4e-4738-9306-6b1eb440f6e8</serial>
Nov 09 03:52:06 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 03:52:06 user nova-compute[75378]: </disk>
Nov 09 03:52:06 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:52:06 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Successfully detached device vdb from instance ed92e04a-56ec-42f1-bed3-8b28a37d1475 from the persistent domain config.
Nov 09 03:52:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FvGRQISs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:52:06 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 03:52:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d289d03f-bd41-45bc-b91e-9e635d9e65fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:52:06 user nova-compute[75378]: No targets found.
Nov 09 03:52:06 user nova-compute[75378]: iSNS:
Nov 09 03:52:06 user nova-compute[75378]: No targets found.
Nov 09 03:52:06 user nova-compute[75378]: STATIC:
Nov 09 03:52:06 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8
Nov 09 03:52:06 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:52:06 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:52:06 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 03:52:06 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:52:06 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:52:06 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c
Nov 09 03:52:06 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:52:06 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:52:06 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75
Nov 09 03:52:06 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:52:06 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:52:06 user nova-compute[75378]: FIRMWARE:
Nov 09 03:52:06 user nova-compute[75378]: No targets found.
Nov 09 03:52:06 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:52:06 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:52:06 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28fa163-00a5-4769-a20e-115b9d6cc56b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adf9434-6bf9-4631-aacb-258142c74c81]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:52:06 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:52:06 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:52:06 user nova-compute[75378]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:52:06 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:52:06 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:52:06 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:52:06 user nova-compute[75378]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:52:06 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3b04d93f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8'): ({'sdb'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Removing single pathed devices sdb {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a616742-3b87-4331-bf48-ac716bebad22]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5edcb0-6534-4256-b888-881f1855f5ce]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Flushing IO for device /dev/sdb {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[511453c2-8d3c-40db-9bba-24b8efa71124]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bb6c53-14c4-480c-b9e1-944712726d81]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ae25bc-a9cd-4d2b-add5-ba904b7a5872]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ed6627-1907-40b6-8379-2a524d9ba595]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8, portal: 172.16.0.220,3260]
Nov 09 03:52:07 user nova-compute[75378]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8, portal: 172.16.0.220,3260] successful.
Nov 09 03:52:07 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d27fbc7-11f1-4bb7-96ef-b49c3a62893a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:52:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] <== disconnect_volume: return (317ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:52:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG nova.compute.manager [req-dc4e45ee-0d7d-4cd9-8371-723add3f9d9f req-fb76648a-a134-4cef-a7a9-e35bdd18f010 service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Received event network-vif-plugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-dc4e45ee-0d7d-4cd9-8371-723add3f9d9f req-fb76648a-a134-4cef-a7a9-e35bdd18f010 service nova] Acquiring lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-dc4e45ee-0d7d-4cd9-8371-723add3f9d9f req-fb76648a-a134-4cef-a7a9-e35bdd18f010 service nova] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-dc4e45ee-0d7d-4cd9-8371-723add3f9d9f req-fb76648a-a134-4cef-a7a9-e35bdd18f010 service nova] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG nova.compute.manager [req-dc4e45ee-0d7d-4cd9-8371-723add3f9d9f req-fb76648a-a134-4cef-a7a9-e35bdd18f010 service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] No waiting events found dispatching network-vif-plugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:52:08 user nova-compute[75378]: WARNING nova.compute.manager [req-dc4e45ee-0d7d-4cd9-8371-723add3f9d9f req-fb76648a-a134-4cef-a7a9-e35bdd18f010 service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Received unexpected event network-vif-plugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 for instance with vm_state active and task_state rebuilding.
Nov 09 03:52:08 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Instance destroyed successfully.
Nov 09 03:52:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:49:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1692964339',display_name='tempest-ServerActionsTestOtherA-server-1723417932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1692964339',id=26,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhe/OL3GXNicZULwBkt8Xad1DZCqYW1OnSvQiEJGYeRe8spVLTNCFMHzUuOG0YSKEEvn+VmZdKf+HgwcnEgeHc+Tl5vJDf5cNrLcH5ndE+P65ps69IZ1N9WZloB873P4Q==',key_name='tempest-keypair-1978093987',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:49:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='548993d280024b60b3778b026177e356',ramdisk_id='',reservation_id='r-fcsl00x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2010465588',owner_user_name='tempest-ServerActionsTestOtherA-2010465588-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:52:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d4f0858695e4509a6b0ab99a8212571',uuid=ed92e04a-56ec-42f1-bed3-8b28a37d1475,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "address": "fa:16:3e:08:70:32", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0923686-86", "ovs_interfaceid": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converting VIF {"id": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "address": "fa:16:3e:08:70:32", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0923686-86", "ovs_interfaceid": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:70:32,bridge_name='br-int',has_traffic_filtering=True,id=f0923686-86a8-4a1d-a8a9-f59a6aff0b13,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0923686-86') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG os_vif [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:70:32,bridge_name='br-int',has_traffic_filtering=True,id=f0923686-86a8-4a1d-a8a9-f59a6aff0b13,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0923686-86') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0923686-86, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1cf56b7-aa3f-4dce-ac4f-01f0c1b24df2) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:08 user nova-compute[75378]: INFO os_vif [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:70:32,bridge_name='br-int',has_traffic_filtering=True,id=f0923686-86a8-4a1d-a8a9-f59a6aff0b13,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0923686-86')
Nov 09 03:52:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FvGRQISs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:52:08 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 03:52:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1520ae55-723a-478c-800e-80d5b42f85dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:52:08 user nova-compute[75378]: No targets found.
Nov 09 03:52:08 user nova-compute[75378]: iSNS:
Nov 09 03:52:08 user nova-compute[75378]: No targets found.
Nov 09 03:52:08 user nova-compute[75378]: STATIC:
Nov 09 03:52:08 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 03:52:08 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:52:08 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:52:08 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c
Nov 09 03:52:08 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:52:08 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:52:08 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75
Nov 09 03:52:08 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:52:08 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:52:08 user nova-compute[75378]: FIRMWARE:
Nov 09 03:52:08 user nova-compute[75378]: No targets found.
Nov 09 03:52:08 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:52:08 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:52:08 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[932975f9-f48b-43f6-b472-0a896b12c271]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8590823e-0ad5-40d9-bcaa-82617459d3d8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:52:08 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:52:08 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:52:08 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:52:08 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:52:08 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:52:08 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3b0462b00>, {}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Disconnecting from: [] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] <== disconnect_volume: return (74ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:52:08 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Deleting instance files /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475_del
Nov 09 03:52:08 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Deletion of /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475_del complete
Nov 09 03:52:08 user nova-compute[75378]: INFO nova.virt.block_device [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Booting with volume 47f376dc-cf4e-4738-9306-6b1eb440f6e8 at /dev/vdb
Nov 09 03:52:08 user nova-compute[75378]: DEBUG os_brick.utils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f17eff-3352-4d55-a2f0-9f8c0fa088f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d9bc0a-2d4e-4b41-be02-3a8ccc294f76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d792e9f2-7542-4624-b2ca-59da38e66e69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[480f7b0d-8982-4df4-b4ac-f8f39b3c8342]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:52:08 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:52:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e17e0e8-4e10-46ab-9a8e-fd6aa0737b50]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG os_brick.utils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:52:08 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Updating existing volume attachment record: 483af359-3269-4e7e-bb0b-c6316827e7d8 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:52:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:12 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 06216917-d7d1-4fd4-a311-e054437e84a6 is timed out.
Nov 09 03:52:12 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Successfully detached device vdb from instance 06216917-d7d1-4fd4-a311-e054437e84a6 from the live domain config.
Nov 09 03:52:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DrnGeLFz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:52:12 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:52:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5097f8bf-e71a-4755-af17-7f8ca353c381]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:52:12 user nova-compute[75378]: No targets found.
Nov 09 03:52:12 user nova-compute[75378]: iSNS:
Nov 09 03:52:12 user nova-compute[75378]: No targets found.
Nov 09 03:52:12 user nova-compute[75378]: STATIC:
Nov 09 03:52:12 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 03:52:12 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:52:12 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:52:12 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c
Nov 09 03:52:12 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:52:12 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:52:12 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75
Nov 09 03:52:12 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:52:12 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:52:12 user nova-compute[75378]: FIRMWARE:
Nov 09 03:52:12 user nova-compute[75378]: No targets found.
Nov 09 03:52:12 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:52:12 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:52:12 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99de426-a3c8-46f2-a5a6-2b4f7b142bbd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f109bb-f056-4c2a-944d-3c1c032611ae]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:52:12 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:52:12 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:52:12 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:52:12 user nova-compute[75378]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 (non-flash)
Nov 09 03:52:12 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:52:12 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c44dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75'): ({'sdd'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Removing single pathed devices sdd {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9ce3ee-904b-4b8d-aaf9-23f03451d2a4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[608b414c-ae25-4a47-9537-74a5570cf7f8]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Flushing IO for device /dev/sdd {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30a0418-09f2-4d9b-bfb7-77f3efb116ed]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9874cfba-b90e-4187-ae9e-c3fd1d88c783]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] SCSI volumes sdd have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a455647-2c34-494d-a275-803adee7eae0]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dba2f7-ce4d-4f4a-b495-6dfc6f6b1a07]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75, portal: 172.16.0.220,3260]
Nov 09 03:52:12 user nova-compute[75378]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75, portal: 172.16.0.220,3260] successful.
Nov 09 03:52:12 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fdd9b92-de5f-4df9-9994-444624a88b75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11b6575-faa9-4179-9608-e2ad0231008b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] <== disconnect_volume: return (336ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:52:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:52:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:13 user nova-compute[75378]: DEBUG nova.objects.instance [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lazy-loading 'flavor' on Instance uuid 06216917-d7d1-4fd4-a311-e054437e84a6 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:52:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-490bedf6-4513-4fe8-a2fb-8d742db79172 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "06216917-d7d1-4fd4-a311-e054437e84a6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.470s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:20 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:52:20 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Cleaning up deleted instances {{(pid=75378) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 03:52:20 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] There are 0 instances to clean {{(pid=75378) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 03:52:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:27 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:52:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:27 user nova-compute[75378]: INFO nova.compute.manager [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Terminating instance
Nov 09 03:52:27 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:52:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-39a76bf5-7c92-4cd7-8f1f-19112258a6f8 req-ae30f68a-8fd1-4e8d-b31d-6c69834c90a5 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received event network-vif-unplugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:52:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-39a76bf5-7c92-4cd7-8f1f-19112258a6f8 req-ae30f68a-8fd1-4e8d-b31d-6c69834c90a5 service nova] Acquiring lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-39a76bf5-7c92-4cd7-8f1f-19112258a6f8 req-ae30f68a-8fd1-4e8d-b31d-6c69834c90a5 service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-39a76bf5-7c92-4cd7-8f1f-19112258a6f8 req-ae30f68a-8fd1-4e8d-b31d-6c69834c90a5 service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-39a76bf5-7c92-4cd7-8f1f-19112258a6f8 req-ae30f68a-8fd1-4e8d-b31d-6c69834c90a5 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] No waiting events found dispatching network-vif-unplugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:52:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-39a76bf5-7c92-4cd7-8f1f-19112258a6f8 req-ae30f68a-8fd1-4e8d-b31d-6c69834c90a5 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received event network-vif-unplugged-e4725ee0-c613-48af-8163-eafad2605fff for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:52:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:28 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Instance destroyed successfully.
Nov 09 03:52:28 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'resources' on Instance uuid 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:52:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-846627937',display_name='tempest-ServerRescueNegativeTestJSON-server-846627937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-846627937',id=18,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBC3j8XalFsnv+ohCWJaFMOzhebiKVhwDqjVSbRzER5tSDvpTJuoMZ9QtIikxGF9BqxV9wk5YQgyNlPsJFGp6zlCYonssIWXLzu36PmDp5LDOUw0qUWi4uNuNyeb3voJCw==',key_name='tempest-keypair-880565104',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:47:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87cddc7aab3e44cf82391eebc6a167b1',ramdisk_id='',reservation_id='r-ww0mhtjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1449314788',owner_user_name='tempest-ServerRescueNegativeTestJSON-1449314788-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:49:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab29d2c2dda547aeb386aa641f4acd24',uuid=89cb3e6d-1b20-4c45-aa0b-a64c92d893c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4725ee0-c613-48af-8163-eafad2605fff", "address": "fa:16:3e:89:f8:61", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4725ee0-c6", "ovs_interfaceid": "e4725ee0-c613-48af-8163-eafad2605fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:52:28 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converting VIF {"id": "e4725ee0-c613-48af-8163-eafad2605fff", "address": "fa:16:3e:89:f8:61", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4725ee0-c6", "ovs_interfaceid": "e4725ee0-c613-48af-8163-eafad2605fff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:52:28 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:f8:61,bridge_name='br-int',has_traffic_filtering=True,id=e4725ee0-c613-48af-8163-eafad2605fff,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4725ee0-c6') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:52:28 user nova-compute[75378]: DEBUG os_vif [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:f8:61,bridge_name='br-int',has_traffic_filtering=True,id=e4725ee0-c613-48af-8163-eafad2605fff,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4725ee0-c6') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:52:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4725ee0-c6, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:52:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:52:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bcc24d56-4526-4987-84b8-d38fe4df3d7e) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:52:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:52:28 user nova-compute[75378]: INFO os_vif [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:f8:61,bridge_name='br-int',has_traffic_filtering=True,id=e4725ee0-c613-48af-8163-eafad2605fff,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4725ee0-c6')
Nov 09 03:52:28 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Deleting instance files /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3_del
Nov 09 03:52:28 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Deletion of /opt/stack/data/nova/instances/89cb3e6d-1b20-4c45-aa0b-a64c92d893c3_del complete
Nov 09 03:52:28 user nova-compute[75378]: INFO nova.compute.manager [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 09 03:52:28 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:52:28 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:52:28 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:52:29 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:52:29 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Took 0.85 seconds to deallocate network for instance.
Nov 09 03:52:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-82ffa6be-4aba-4b36-98f0-bc3394b6f147 req-7bd66ecf-b034-48fa-855d-7b03cc82f9e0 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received event network-vif-deleted-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:52:29 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:52:29 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:52:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:29 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Deleted allocations for instance 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3
Nov 09 03:52:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ab3c1a10-857e-499b-99bb-34b03f044abf tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.435s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-5f9cc7b9-44a4-4991-a224-db9d6de16ed2 req-c79c63ac-6d3d-462f-8fd6-f393a8535871 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received event network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:52:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5f9cc7b9-44a4-4991-a224-db9d6de16ed2 req-c79c63ac-6d3d-462f-8fd6-f393a8535871 service nova] Acquiring lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5f9cc7b9-44a4-4991-a224-db9d6de16ed2 req-c79c63ac-6d3d-462f-8fd6-f393a8535871 service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5f9cc7b9-44a4-4991-a224-db9d6de16ed2 req-c79c63ac-6d3d-462f-8fd6-f393a8535871 service nova] Lock "89cb3e6d-1b20-4c45-aa0b-a64c92d893c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:30 user nova-compute[75378]: DEBUG nova.compute.manager [req-5f9cc7b9-44a4-4991-a224-db9d6de16ed2 req-c79c63ac-6d3d-462f-8fd6-f393a8535871 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] No waiting events found dispatching network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:52:30 user nova-compute[75378]: WARNING nova.compute.manager [req-5f9cc7b9-44a4-4991-a224-db9d6de16ed2 req-c79c63ac-6d3d-462f-8fd6-f393a8535871 service nova] [instance: 89cb3e6d-1b20-4c45-aa0b-a64c92d893c3] Received unexpected event network-vif-plugged-e4725ee0-c613-48af-8163-eafad2605fff for instance with vm_state deleted and task_state None.
Nov 09 03:52:31 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:52:31 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:52:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-2c2acb48-972a-41d7-987e-48e79b3bef93" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:52:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-2c2acb48-972a-41d7-987e-48e79b3bef93" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:52:31 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 03:52:31 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Updating instance_info_cache with network_info: [{"id": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "address": "fa:16:3e:02:bc:fb", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d7d7ee-d1", "ovs_interfaceid": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:52:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-2c2acb48-972a-41d7-987e-48e79b3bef93" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:52:31 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 03:52:31 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:52:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:33 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:52:34 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:52:34 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:52:35 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:52:35 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:52:35 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:52:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:35 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:52:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:52:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:52:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:39 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:52:39 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:52:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7658MB free_disk=25.096145629882812GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:52:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:52:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:52:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7d051405-6b57-4db2-9533-c2f4e87134d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:52:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2c2acb48-972a-41d7-987e-48e79b3bef93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:52:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 013db901-fbee-4593-a14f-95a03e79fad0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:52:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 06216917-d7d1-4fd4-a311-e054437e84a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:52:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2abe50f8-3c9b-417e-889f-1d565089d678 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:52:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance ed92e04a-56ec-42f1-bed3-8b28a37d1475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:52:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:52:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 11f18164-9676-4a8a-91be-8bd87673ec5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:52:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:52:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:52:40 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing inventories for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 03:52:40 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Updating ProviderTree inventory for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 03:52:40 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Updating inventory in ProviderTree for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 03:52:40 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing aggregate associations for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8, aggregates: None {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 03:52:40 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing trait associations for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8, traits: HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 03:52:40 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:52:40 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:52:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:52:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.842s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:40 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:52:42 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:52:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:52:46 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:52:46 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75378) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 03:52:47 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:52:48 user nova-compute[75378]: WARNING nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Nov 09 03:52:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 7d051405-6b57-4db2-9533-c2f4e87134d8 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 2c2acb48-972a-41d7-987e-48e79b3bef93 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 013db901-fbee-4593-a14f-95a03e79fad0 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 06216917-d7d1-4fd4-a311-e054437e84a6 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 2abe50f8-3c9b-417e-889f-1d565089d678 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 11f18164-9676-4a8a-91be-8bd87673ec5b {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid ed92e04a-56ec-42f1-bed3-8b28a37d1475 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "7d051405-6b57-4db2-9533-c2f4e87134d8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "7d051405-6b57-4db2-9533-c2f4e87134d8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "2c2acb48-972a-41d7-987e-48e79b3bef93" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "2c2acb48-972a-41d7-987e-48e79b3bef93" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "013db901-fbee-4593-a14f-95a03e79fad0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "013db901-fbee-4593-a14f-95a03e79fad0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "06216917-d7d1-4fd4-a311-e054437e84a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "06216917-d7d1-4fd4-a311-e054437e84a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "2abe50f8-3c9b-417e-889f-1d565089d678" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "2abe50f8-3c9b-417e-889f-1d565089d678" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "11f18164-9676-4a8a-91be-8bd87673ec5b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "11f18164-9676-4a8a-91be-8bd87673ec5b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:48 user nova-compute[75378]: INFO nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "7d051405-6b57-4db2-9533-c2f4e87134d8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "013db901-fbee-4593-a14f-95a03e79fad0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "06216917-d7d1-4fd4-a311-e054437e84a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "11f18164-9676-4a8a-91be-8bd87673ec5b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "2c2acb48-972a-41d7-987e-48e79b3bef93" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "2abe50f8-3c9b-417e-889f-1d565089d678" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "06216917-d7d1-4fd4-a311-e054437e84a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "06216917-d7d1-4fd4-a311-e054437e84a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "06216917-d7d1-4fd4-a311-e054437e84a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "06216917-d7d1-4fd4-a311-e054437e84a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "06216917-d7d1-4fd4-a311-e054437e84a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:53 user nova-compute[75378]: INFO nova.compute.manager [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Terminating instance
Nov 09 03:52:53 user nova-compute[75378]: DEBUG nova.compute.manager [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:52:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:54 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Instance destroyed successfully.
Nov 09 03:52:54 user nova-compute[75378]: DEBUG nova.objects.instance [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lazy-loading 'resources' on Instance uuid 06216917-d7d1-4fd4-a311-e054437e84a6 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:52:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-268422201',display_name='tempest-TestMinimumBasicScenario-server-268422201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-268422201',id=23,image_ref='fe7e0145-3989-490e-8549-fd04c87b1bbf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5VUjQfePCJPThtosrWik/90Fev8SLx+lXghUWZ7Pux7J0g9Au910Z2/wthgd64k+5gb04TiVYNIeAHiEXl7UMhYOVayzfgzu7ZgyfjQfyON+xr+Xu4JclsIwlyTILmzA==',key_name='tempest-TestMinimumBasicScenario-2091302230',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:46:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a02ac142a06244ef9819e09b22e4a941',ramdisk_id='',reservation_id='r-kzrp4n1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fe7e0145-3989-490e-8549-fd04c87b1bbf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-322168895',owner_user_name='tempest-TestMinimumBasicScenario-322168895-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:50:06Z,user_data=None,user_id='b74e4631d102431f83fe51fc39a3768a',uuid=06216917-d7d1-4fd4-a311-e054437e84a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "address": "fa:16:3e:a8:c1:72", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d71ff-87", "ovs_interfaceid": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:52:54 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Converting VIF {"id": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "address": "fa:16:3e:a8:c1:72", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf18d71ff-87", "ovs_interfaceid": "f18d71ff-8728-41e9-82bf-3d66e09e552a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:52:54 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:c1:72,bridge_name='br-int',has_traffic_filtering=True,id=f18d71ff-8728-41e9-82bf-3d66e09e552a,network=Network(5fa0c6e5-0332-4a5f-b866-8f823ceaa13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d71ff-87') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:52:54 user nova-compute[75378]: DEBUG os_vif [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:c1:72,bridge_name='br-int',has_traffic_filtering=True,id=f18d71ff-8728-41e9-82bf-3d66e09e552a,network=Network(5fa0c6e5-0332-4a5f-b866-8f823ceaa13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d71ff-87') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:52:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf18d71ff-87, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:52:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:52:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=abc29a55-9369-4c49-94cf-74ce745cdd6d) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:52:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:52:54 user nova-compute[75378]: INFO os_vif [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:c1:72,bridge_name='br-int',has_traffic_filtering=True,id=f18d71ff-8728-41e9-82bf-3d66e09e552a,network=Network(5fa0c6e5-0332-4a5f-b866-8f823ceaa13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf18d71ff-87')
Nov 09 03:52:54 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Deleting instance files /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6_del
Nov 09 03:52:54 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Deletion of /opt/stack/data/nova/instances/06216917-d7d1-4fd4-a311-e054437e84a6_del complete
Nov 09 03:52:54 user nova-compute[75378]: INFO nova.compute.manager [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 09 03:52:54 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:52:54 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:52:54 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:52:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:52:55 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Creating image(s)
Nov 09 03:52:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "/opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "/opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.183s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:55 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:52:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-dc64ea3d-51c4-41e8-ab33-7a7f2061eb73 req-79f6233f-6da3-40de-9394-dfb50f85c553 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Received event network-vif-deleted-f18d71ff-8728-41e9-82bf-3d66e09e552a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:52:55 user nova-compute[75378]: INFO nova.compute.manager [req-dc64ea3d-51c4-41e8-ab33-7a7f2061eb73 req-79f6233f-6da3-40de-9394-dfb50f85c553 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Neutron deleted interface f18d71ff-8728-41e9-82bf-3d66e09e552a; detaching it from the instance and deleting it from the info cache
Nov 09 03:52:55 user nova-compute[75378]: DEBUG nova.network.neutron [req-dc64ea3d-51c4-41e8-ab33-7a7f2061eb73 req-79f6233f-6da3-40de-9394-dfb50f85c553 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:52:55 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Took 1.07 seconds to deallocate network for instance.
Nov 09 03:52:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-dc64ea3d-51c4-41e8-ab33-7a7f2061eb73 req-79f6233f-6da3-40de-9394-dfb50f85c553 service nova] [instance: 06216917-d7d1-4fd4-a311-e054437e84a6] Detach interface failed, port_id=f18d71ff-8728-41e9-82bf-3d66e09e552a, reason: Instance 06216917-d7d1-4fd4-a311-e054437e84a6 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 03:52:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.192s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk 1073741824" returned: 0 in 0.090s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.194s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:55 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:52:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Cannot resize image /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Ensure instance console log exists: /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Start _get_guest_xml network_info=[{"id": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "address": "fa:16:3e:08:70:32", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0923686-86", "ovs_interfaceid": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FvGRQISs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ed92e04a-56ec-42f1-bed3-8b28a37d1475', 'attached_at': '', 'detached_at': '', 'volume_id': '47f376dc-cf4e-4738-9306-6b1eb440f6e8', 'serial': '47f376dc-cf4e-4738-9306-6b1eb440f6e8'}, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'attachment_id': '483af359-3269-4e7e-bb0b-c6316827e7d8', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:52:56 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 09 03:52:56 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.objects.instance [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lazy-loading 'vcpu_model' on Instance uuid ed92e04a-56ec-42f1-bed3-8b28a37d1475 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FvGRQISs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:52:56 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:52:56 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:52:56 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:52:56 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Deleted allocations for instance 06216917-d7d1-4fd4-a311-e054437e84a6
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34277d1-a26d-464d-869f-44d1f4803794]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:52:56 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.140s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7de92d-3f76-4d72-970c-57cd4654c70b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8] added
Nov 09 03:52:56 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.048s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ac741b-14bf-49b5-9059-e2af4546500a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a48cbf27-bd80-444b-ac7a-c8df491b994d tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "06216917-d7d1-4fd4-a311-e054437e84a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.957s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5e4e1d-fe55-454e-a26a-9650db7d01e5]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FvGRQISs {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FvGRQISs" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[121aa923-c1d5-4e70-81cf-85217dc5c6d6]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FvGRQISs'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69aa2e2-cfda-44fa-9bea-b78382d9bd15]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[710740fc-3b29-494c-9e21-804727c87b38]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:52:56 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:52:56 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:52:56 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:52:56 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc26bfa-25ba-461a-9f09-2b8a67a7a54a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8, portal: 172.16.0.220,3260]
Nov 09 03:52:56 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8, portal: 172.16.0.220,3260] successful.
Nov 09 03:52:56 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17a8040-14a7-42e5-b431-60f7ecc06fed]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c70bc1-69ca-4b73-a8e3-0bb2a87d8ba2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:52:56 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:52:56 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:52:56 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:52:56 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:52:56 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:52:56 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.500s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bbda0b-f361-433c-a824-395e83c38d09]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:52:56 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: None {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FvGRQISs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.539s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] <== connect_volume: return (1541ms) {'type': 'block', 'scsi_wwn': '26431323034643564', 'path': '/dev/sdb'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431323034643564', 'path': '/dev/sdb'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T03:49:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1692964339',display_name='tempest-ServerActionsTestOtherA-server-1723417932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1692964339',id=26,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhe/OL3GXNicZULwBkt8Xad1DZCqYW1OnSvQiEJGYeRe8spVLTNCFMHzUuOG0YSKEEvn+VmZdKf+HgwcnEgeHc+Tl5vJDf5cNrLcH5ndE+P65ps69IZ1N9WZloB873P4Q==',key_name='tempest-keypair-1978093987',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:49:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='548993d280024b60b3778b026177e356',ramdisk_id='',reservation_id='r-fcsl00x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2010465588',owner_user_name='tempest-ServerActionsTestOtherA-2010465588-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:52:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d4f0858695e4509a6b0ab99a8212571',uuid=ed92e04a-56ec-42f1-bed3-8b28a37d1475,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "address": "fa:16:3e:08:70:32", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0923686-86", "ovs_interfaceid": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converting VIF {"id": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "address": "fa:16:3e:08:70:32", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0923686-86", "ovs_interfaceid": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:70:32,bridge_name='br-int',has_traffic_filtering=True,id=f0923686-86a8-4a1d-a8a9-f59a6aff0b13,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0923686-86') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:52:57 user nova-compute[75378]:   <uuid>ed92e04a-56ec-42f1-bed3-8b28a37d1475</uuid>
Nov 09 03:52:57 user nova-compute[75378]:   <name>instance-0000001a</name>
Nov 09 03:52:57 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:52:57 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:52:57 user nova-compute[75378]:   <metadata>
Nov 09 03:52:57 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:52:57 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:52:57 user nova-compute[75378]:       <nova:name>tempest-ServerActionsTestOtherA-server-1723417932</nova:name>
Nov 09 03:52:57 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:52:56</nova:creationTime>
Nov 09 03:52:57 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:52:57 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:52:57 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:52:57 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:52:57 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:52:57 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:52:57 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:52:57 user nova-compute[75378]:       <nova:owner>
Nov 09 03:52:57 user nova-compute[75378]:         <nova:user uuid="5d4f0858695e4509a6b0ab99a8212571">tempest-ServerActionsTestOtherA-2010465588-project-member</nova:user>
Nov 09 03:52:57 user nova-compute[75378]:         <nova:project uuid="548993d280024b60b3778b026177e356">tempest-ServerActionsTestOtherA-2010465588</nova:project>
Nov 09 03:52:57 user nova-compute[75378]:       </nova:owner>
Nov 09 03:52:57 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:52:57 user nova-compute[75378]:       <nova:ports>
Nov 09 03:52:57 user nova-compute[75378]:         <nova:port uuid="f0923686-86a8-4a1d-a8a9-f59a6aff0b13">
Nov 09 03:52:57 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 09 03:52:57 user nova-compute[75378]:         </nova:port>
Nov 09 03:52:57 user nova-compute[75378]:       </nova:ports>
Nov 09 03:52:57 user nova-compute[75378]:     </nova:instance>
Nov 09 03:52:57 user nova-compute[75378]:   </metadata>
Nov 09 03:52:57 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:52:57 user nova-compute[75378]:     <system>
Nov 09 03:52:57 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:52:57 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:52:57 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:52:57 user nova-compute[75378]:       <entry name="serial">ed92e04a-56ec-42f1-bed3-8b28a37d1475</entry>
Nov 09 03:52:57 user nova-compute[75378]:       <entry name="uuid">ed92e04a-56ec-42f1-bed3-8b28a37d1475</entry>
Nov 09 03:52:57 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:52:57 user nova-compute[75378]:     </system>
Nov 09 03:52:57 user nova-compute[75378]:   </sysinfo>
Nov 09 03:52:57 user nova-compute[75378]:   <os>
Nov 09 03:52:57 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:52:57 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:52:57 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:52:57 user nova-compute[75378]:   </os>
Nov 09 03:52:57 user nova-compute[75378]:   <features>
Nov 09 03:52:57 user nova-compute[75378]:     <acpi/>
Nov 09 03:52:57 user nova-compute[75378]:     <apic/>
Nov 09 03:52:57 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:52:57 user nova-compute[75378]:   </features>
Nov 09 03:52:57 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:52:57 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:52:57 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:52:57 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:52:57 user nova-compute[75378]:   </clock>
Nov 09 03:52:57 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:52:57 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:52:57 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:52:57 user nova-compute[75378]:   </cpu>
Nov 09 03:52:57 user nova-compute[75378]:   <devices>
Nov 09 03:52:57 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:52:57 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:52:57 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk"/>
Nov 09 03:52:57 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:52:57 user nova-compute[75378]:     </disk>
Nov 09 03:52:57 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 03:52:57 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:52:57 user nova-compute[75378]:       <source dev="/dev/sdb"/>
Nov 09 03:52:57 user nova-compute[75378]:       <target dev="vdb" bus="virtio"/>
Nov 09 03:52:57 user nova-compute[75378]:       <serial>47f376dc-cf4e-4738-9306-6b1eb440f6e8</serial>
Nov 09 03:52:57 user nova-compute[75378]:     </disk>
Nov 09 03:52:57 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:52:57 user nova-compute[75378]:       <mac address="fa:16:3e:08:70:32"/>
Nov 09 03:52:57 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:52:57 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:52:57 user nova-compute[75378]:       <target dev="tapf0923686-86"/>
Nov 09 03:52:57 user nova-compute[75378]:     </interface>
Nov 09 03:52:57 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:52:57 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/console.log" append="off"/>
Nov 09 03:52:57 user nova-compute[75378]:     </serial>
Nov 09 03:52:57 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:52:57 user nova-compute[75378]:     <video>
Nov 09 03:52:57 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:52:57 user nova-compute[75378]:     </video>
Nov 09 03:52:57 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:52:57 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:52:57 user nova-compute[75378]:     </rng>
Nov 09 03:52:57 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:52:57 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:52:57 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:52:57 user nova-compute[75378]:     </memballoon>
Nov 09 03:52:57 user nova-compute[75378]:   </devices>
Nov 09 03:52:57 user nova-compute[75378]: </domain>
Nov 09 03:52:57 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T03:49:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1692964339',display_name='tempest-ServerActionsTestOtherA-server-1723417932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1692964339',id=26,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhe/OL3GXNicZULwBkt8Xad1DZCqYW1OnSvQiEJGYeRe8spVLTNCFMHzUuOG0YSKEEvn+VmZdKf+HgwcnEgeHc+Tl5vJDf5cNrLcH5ndE+P65ps69IZ1N9WZloB873P4Q==',key_name='tempest-keypair-1978093987',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:49:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='548993d280024b60b3778b026177e356',ramdisk_id='',reservation_id='r-fcsl00x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2010465588',owner_user_name='tempest-ServerActionsTestOtherA-2010465588-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:52:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d4f0858695e4509a6b0ab99a8212571',uuid=ed92e04a-56ec-42f1-bed3-8b28a37d1475,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "address": "fa:16:3e:08:70:32", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0923686-86", "ovs_interfaceid": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converting VIF {"id": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "address": "fa:16:3e:08:70:32", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0923686-86", "ovs_interfaceid": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:70:32,bridge_name='br-int',has_traffic_filtering=True,id=f0923686-86a8-4a1d-a8a9-f59a6aff0b13,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0923686-86') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG os_vif [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:70:32,bridge_name='br-int',has_traffic_filtering=True,id=f0923686-86a8-4a1d-a8a9-f59a6aff0b13,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0923686-86') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88a6755a-f739-5eaf-b05b-fead480ce8d2', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0923686-86, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0923686-86, col_values=(('qos', UUID('e9ede180-1963-4237-ba3b-fd14eca6b896')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0923686-86, col_values=(('external_ids', {'iface-id': 'f0923686-86a8-4a1d-a8a9-f59a6aff0b13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:70:32', 'vm-uuid': 'ed92e04a-56ec-42f1-bed3-8b28a37d1475'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:57 user nova-compute[75378]: INFO os_vif [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:70:32,bridge_name='br-int',has_traffic_filtering=True,id=f0923686-86a8-4a1d-a8a9-f59a6aff0b13,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0923686-86')
Nov 09 03:52:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:52:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] No VIF found with MAC fa:16:3e:08:70:32, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:52:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:52:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-3ac09ac8-c51d-4357-b89e-e1fd0239791a req-47a59862-9e52-4f91-a5e9-24041225b3c7 service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Received event network-vif-plugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:52:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3ac09ac8-c51d-4357-b89e-e1fd0239791a req-47a59862-9e52-4f91-a5e9-24041225b3c7 service nova] Acquiring lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:52:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3ac09ac8-c51d-4357-b89e-e1fd0239791a req-47a59862-9e52-4f91-a5e9-24041225b3c7 service nova] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:52:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3ac09ac8-c51d-4357-b89e-e1fd0239791a req-47a59862-9e52-4f91-a5e9-24041225b3c7 service nova] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:52:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-3ac09ac8-c51d-4357-b89e-e1fd0239791a req-47a59862-9e52-4f91-a5e9-24041225b3c7 service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] No waiting events found dispatching network-vif-plugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:52:59 user nova-compute[75378]: WARNING nova.compute.manager [req-3ac09ac8-c51d-4357-b89e-e1fd0239791a req-47a59862-9e52-4f91-a5e9-24041225b3c7 service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Received unexpected event network-vif-plugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 for instance with vm_state active and task_state rebuild_spawning.
Nov 09 03:53:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:01 user nova-compute[75378]: DEBUG nova.compute.manager [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:53:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:53:01 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Instance spawned successfully.
Nov 09 03:53:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:53:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:01 user nova-compute[75378]: DEBUG nova.compute.manager [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:53:01 user nova-compute[75378]: DEBUG nova.compute.manager [req-dfb8d243-bcfb-4294-8bf7-62ed3c5d4336 req-b485beec-38eb-464e-b539-97c7264cfb2e service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Received event network-vif-plugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:53:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-dfb8d243-bcfb-4294-8bf7-62ed3c5d4336 req-b485beec-38eb-464e-b539-97c7264cfb2e service nova] Acquiring lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-dfb8d243-bcfb-4294-8bf7-62ed3c5d4336 req-b485beec-38eb-464e-b539-97c7264cfb2e service nova] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-dfb8d243-bcfb-4294-8bf7-62ed3c5d4336 req-b485beec-38eb-464e-b539-97c7264cfb2e service nova] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:01 user nova-compute[75378]: DEBUG nova.compute.manager [req-dfb8d243-bcfb-4294-8bf7-62ed3c5d4336 req-b485beec-38eb-464e-b539-97c7264cfb2e service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] No waiting events found dispatching network-vif-plugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:53:01 user nova-compute[75378]: WARNING nova.compute.manager [req-dfb8d243-bcfb-4294-8bf7-62ed3c5d4336 req-b485beec-38eb-464e-b539-97c7264cfb2e service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Received unexpected event network-vif-plugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 for instance with vm_state active and task_state rebuild_spawning.
Nov 09 03:53:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:02 user nova-compute[75378]: DEBUG nova.objects.instance [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75378) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 09 03:53:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0c0609f1-b644-40e7-9716-47fee3e4ccc3 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.099s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Acquiring lock "66c0d842-75e7-4506-97a0-35048f5b445e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "66c0d842-75e7-4506-97a0-35048f5b445e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:04 user nova-compute[75378]: DEBUG nova.compute.manager [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:53:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:04 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:53:04 user nova-compute[75378]: INFO nova.compute.claims [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Claim successful on node user
Nov 09 03:53:05 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:53:05 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:53:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:05 user nova-compute[75378]: DEBUG nova.compute.manager [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:53:05 user nova-compute[75378]: DEBUG nova.compute.manager [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:53:05 user nova-compute[75378]: DEBUG nova.network.neutron [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:53:05 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:53:05 user nova-compute[75378]: DEBUG nova.compute.manager [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:53:05 user nova-compute[75378]: DEBUG nova.policy [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1681626725044d1cba836a92d5fe3827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4984a96b0a47cba8fa82f19c985e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:53:05 user nova-compute[75378]: DEBUG nova.compute.manager [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:53:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:53:05 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Creating image(s)
Nov 09 03:53:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Acquiring lock "/opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "/opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "/opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.200s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.208s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e/disk 1073741824" returned: 0 in 0.068s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.211s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:06 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:53:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:06 user nova-compute[75378]: DEBUG nova.network.neutron [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Successfully created port: 9d5eb777-bc52-4053-8ff1-e47215b83682 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:53:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:06 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Cannot resize image /opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:53:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:53:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Ensure instance console log exists: /opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:53:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:06 user nova-compute[75378]: DEBUG nova.network.neutron [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Successfully updated port: 9d5eb777-bc52-4053-8ff1-e47215b83682 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:53:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Acquiring lock "refresh_cache-66c0d842-75e7-4506-97a0-35048f5b445e" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:53:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Acquired lock "refresh_cache-66c0d842-75e7-4506-97a0-35048f5b445e" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:53:06 user nova-compute[75378]: DEBUG nova.network.neutron [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-18c87ba8-44fb-4b2a-b5d3-0411ff537a10 req-c781bdc5-6b11-45ca-a342-dd212eb23986 service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Received event network-changed-9d5eb777-bc52-4053-8ff1-e47215b83682 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-18c87ba8-44fb-4b2a-b5d3-0411ff537a10 req-c781bdc5-6b11-45ca-a342-dd212eb23986 service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Refreshing instance network info cache due to event network-changed-9d5eb777-bc52-4053-8ff1-e47215b83682. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-18c87ba8-44fb-4b2a-b5d3-0411ff537a10 req-c781bdc5-6b11-45ca-a342-dd212eb23986 service nova] Acquiring lock "refresh_cache-66c0d842-75e7-4506-97a0-35048f5b445e" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.network.neutron [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.network.neutron [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Updating instance_info_cache with network_info: [{"id": "9d5eb777-bc52-4053-8ff1-e47215b83682", "address": "fa:16:3e:87:77:b7", "network": {"id": "c24e97e2-0bda-4032-839f-897e81cb118e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1098129296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b4984a96b0a47cba8fa82f19c985e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5eb777-bc", "ovs_interfaceid": "9d5eb777-bc52-4053-8ff1-e47215b83682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Releasing lock "refresh_cache-66c0d842-75e7-4506-97a0-35048f5b445e" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.compute.manager [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Instance network_info: |[{"id": "9d5eb777-bc52-4053-8ff1-e47215b83682", "address": "fa:16:3e:87:77:b7", "network": {"id": "c24e97e2-0bda-4032-839f-897e81cb118e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1098129296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b4984a96b0a47cba8fa82f19c985e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5eb777-bc", "ovs_interfaceid": "9d5eb777-bc52-4053-8ff1-e47215b83682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-18c87ba8-44fb-4b2a-b5d3-0411ff537a10 req-c781bdc5-6b11-45ca-a342-dd212eb23986 service nova] Acquired lock "refresh_cache-66c0d842-75e7-4506-97a0-35048f5b445e" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.network.neutron [req-18c87ba8-44fb-4b2a-b5d3-0411ff537a10 req-c781bdc5-6b11-45ca-a342-dd212eb23986 service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Refreshing network info cache for port 9d5eb777-bc52-4053-8ff1-e47215b83682 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Start _get_guest_xml network_info=[{"id": "9d5eb777-bc52-4053-8ff1-e47215b83682", "address": "fa:16:3e:87:77:b7", "network": {"id": "c24e97e2-0bda-4032-839f-897e81cb118e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1098129296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b4984a96b0a47cba8fa82f19c985e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5eb777-bc", "ovs_interfaceid": "9d5eb777-bc52-4053-8ff1-e47215b83682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:53:07 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:53:07 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-721888433',display_name='tempest-VolumesActionsTest-instance-721888433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-721888433',id=29,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b4984a96b0a47cba8fa82f19c985e50',ramdisk_id='',reservation_id='r-7446srep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-650140927',owner_user_name='tempest-VolumesActionsTest-650140927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:53:05Z,user_data=None,user_id='1681626725044d1cba836a92d5fe3827',uuid=66c0d842-75e7-4506-97a0-35048f5b445e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d5eb777-bc52-4053-8ff1-e47215b83682", "address": "fa:16:3e:87:77:b7", "network": {"id": "c24e97e2-0bda-4032-839f-897e81cb118e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1098129296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b4984a96b0a47cba8fa82f19c985e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5eb777-bc", "ovs_interfaceid": "9d5eb777-bc52-4053-8ff1-e47215b83682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Converting VIF {"id": "9d5eb777-bc52-4053-8ff1-e47215b83682", "address": "fa:16:3e:87:77:b7", "network": {"id": "c24e97e2-0bda-4032-839f-897e81cb118e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1098129296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b4984a96b0a47cba8fa82f19c985e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5eb777-bc", "ovs_interfaceid": "9d5eb777-bc52-4053-8ff1-e47215b83682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:77:b7,bridge_name='br-int',has_traffic_filtering=True,id=9d5eb777-bc52-4053-8ff1-e47215b83682,network=Network(c24e97e2-0bda-4032-839f-897e81cb118e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5eb777-bc') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.objects.instance [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lazy-loading 'pci_devices' on Instance uuid 66c0d842-75e7-4506-97a0-35048f5b445e {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:53:07 user nova-compute[75378]:   <uuid>66c0d842-75e7-4506-97a0-35048f5b445e</uuid>
Nov 09 03:53:07 user nova-compute[75378]:   <name>instance-0000001d</name>
Nov 09 03:53:07 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:53:07 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:53:07 user nova-compute[75378]:   <metadata>
Nov 09 03:53:07 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:53:07 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:53:07 user nova-compute[75378]:       <nova:name>tempest-VolumesActionsTest-instance-721888433</nova:name>
Nov 09 03:53:07 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:53:07</nova:creationTime>
Nov 09 03:53:07 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:53:07 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:53:07 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:53:07 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:53:07 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:53:07 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:53:07 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:53:07 user nova-compute[75378]:       <nova:owner>
Nov 09 03:53:07 user nova-compute[75378]:         <nova:user uuid="1681626725044d1cba836a92d5fe3827">tempest-VolumesActionsTest-650140927-project-member</nova:user>
Nov 09 03:53:07 user nova-compute[75378]:         <nova:project uuid="7b4984a96b0a47cba8fa82f19c985e50">tempest-VolumesActionsTest-650140927</nova:project>
Nov 09 03:53:07 user nova-compute[75378]:       </nova:owner>
Nov 09 03:53:07 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:53:07 user nova-compute[75378]:       <nova:ports>
Nov 09 03:53:07 user nova-compute[75378]:         <nova:port uuid="9d5eb777-bc52-4053-8ff1-e47215b83682">
Nov 09 03:53:07 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 03:53:07 user nova-compute[75378]:         </nova:port>
Nov 09 03:53:07 user nova-compute[75378]:       </nova:ports>
Nov 09 03:53:07 user nova-compute[75378]:     </nova:instance>
Nov 09 03:53:07 user nova-compute[75378]:   </metadata>
Nov 09 03:53:07 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:53:07 user nova-compute[75378]:     <system>
Nov 09 03:53:07 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:53:07 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:53:07 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:53:07 user nova-compute[75378]:       <entry name="serial">66c0d842-75e7-4506-97a0-35048f5b445e</entry>
Nov 09 03:53:07 user nova-compute[75378]:       <entry name="uuid">66c0d842-75e7-4506-97a0-35048f5b445e</entry>
Nov 09 03:53:07 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:53:07 user nova-compute[75378]:     </system>
Nov 09 03:53:07 user nova-compute[75378]:   </sysinfo>
Nov 09 03:53:07 user nova-compute[75378]:   <os>
Nov 09 03:53:07 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:53:07 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:53:07 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:53:07 user nova-compute[75378]:   </os>
Nov 09 03:53:07 user nova-compute[75378]:   <features>
Nov 09 03:53:07 user nova-compute[75378]:     <acpi/>
Nov 09 03:53:07 user nova-compute[75378]:     <apic/>
Nov 09 03:53:07 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:53:07 user nova-compute[75378]:   </features>
Nov 09 03:53:07 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:53:07 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:53:07 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:53:07 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:53:07 user nova-compute[75378]:   </clock>
Nov 09 03:53:07 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:53:07 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:53:07 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:53:07 user nova-compute[75378]:   </cpu>
Nov 09 03:53:07 user nova-compute[75378]:   <devices>
Nov 09 03:53:07 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:53:07 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:53:07 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e/disk"/>
Nov 09 03:53:07 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:53:07 user nova-compute[75378]:     </disk>
Nov 09 03:53:07 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:53:07 user nova-compute[75378]:       <mac address="fa:16:3e:87:77:b7"/>
Nov 09 03:53:07 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:53:07 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:53:07 user nova-compute[75378]:       <target dev="tap9d5eb777-bc"/>
Nov 09 03:53:07 user nova-compute[75378]:     </interface>
Nov 09 03:53:07 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:53:07 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e/console.log" append="off"/>
Nov 09 03:53:07 user nova-compute[75378]:     </serial>
Nov 09 03:53:07 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:53:07 user nova-compute[75378]:     <video>
Nov 09 03:53:07 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:53:07 user nova-compute[75378]:     </video>
Nov 09 03:53:07 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:53:07 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:53:07 user nova-compute[75378]:     </rng>
Nov 09 03:53:07 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:53:07 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:53:07 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:53:07 user nova-compute[75378]:     </memballoon>
Nov 09 03:53:07 user nova-compute[75378]:   </devices>
Nov 09 03:53:07 user nova-compute[75378]: </domain>
Nov 09 03:53:07 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-721888433',display_name='tempest-VolumesActionsTest-instance-721888433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-721888433',id=29,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b4984a96b0a47cba8fa82f19c985e50',ramdisk_id='',reservation_id='r-7446srep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-650140927',owner_user_name='tempest-VolumesActionsTest-650140927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:53:05Z,user_data=None,user_id='1681626725044d1cba836a92d5fe3827',uuid=66c0d842-75e7-4506-97a0-35048f5b445e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d5eb777-bc52-4053-8ff1-e47215b83682", "address": "fa:16:3e:87:77:b7", "network": {"id": "c24e97e2-0bda-4032-839f-897e81cb118e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1098129296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b4984a96b0a47cba8fa82f19c985e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5eb777-bc", "ovs_interfaceid": "9d5eb777-bc52-4053-8ff1-e47215b83682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Converting VIF {"id": "9d5eb777-bc52-4053-8ff1-e47215b83682", "address": "fa:16:3e:87:77:b7", "network": {"id": "c24e97e2-0bda-4032-839f-897e81cb118e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1098129296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b4984a96b0a47cba8fa82f19c985e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5eb777-bc", "ovs_interfaceid": "9d5eb777-bc52-4053-8ff1-e47215b83682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:77:b7,bridge_name='br-int',has_traffic_filtering=True,id=9d5eb777-bc52-4053-8ff1-e47215b83682,network=Network(c24e97e2-0bda-4032-839f-897e81cb118e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5eb777-bc') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG os_vif [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:77:b7,bridge_name='br-int',has_traffic_filtering=True,id=9d5eb777-bc52-4053-8ff1-e47215b83682,network=Network(c24e97e2-0bda-4032-839f-897e81cb118e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5eb777-bc') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f22e53f-b468-5459-836e-04b85cecfc99', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d5eb777-bc, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d5eb777-bc, col_values=(('qos', UUID('c9265fe0-d232-4021-bfa7-2ea7adb92dc0')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d5eb777-bc, col_values=(('external_ids', {'iface-id': '9d5eb777-bc52-4053-8ff1-e47215b83682', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:77:b7', 'vm-uuid': '66c0d842-75e7-4506-97a0-35048f5b445e'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:07 user nova-compute[75378]: INFO os_vif [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:77:b7,bridge_name='br-int',has_traffic_filtering=True,id=9d5eb777-bc52-4053-8ff1-e47215b83682,network=Network(c24e97e2-0bda-4032-839f-897e81cb118e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5eb777-bc')
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] No VIF found with MAC fa:16:3e:87:77:b7, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.network.neutron [req-18c87ba8-44fb-4b2a-b5d3-0411ff537a10 req-c781bdc5-6b11-45ca-a342-dd212eb23986 service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Updated VIF entry in instance network info cache for port 9d5eb777-bc52-4053-8ff1-e47215b83682. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG nova.network.neutron [req-18c87ba8-44fb-4b2a-b5d3-0411ff537a10 req-c781bdc5-6b11-45ca-a342-dd212eb23986 service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Updating instance_info_cache with network_info: [{"id": "9d5eb777-bc52-4053-8ff1-e47215b83682", "address": "fa:16:3e:87:77:b7", "network": {"id": "c24e97e2-0bda-4032-839f-897e81cb118e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1098129296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b4984a96b0a47cba8fa82f19c985e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5eb777-bc", "ovs_interfaceid": "9d5eb777-bc52-4053-8ff1-e47215b83682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:53:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-18c87ba8-44fb-4b2a-b5d3-0411ff537a10 req-c781bdc5-6b11-45ca-a342-dd212eb23986 service nova] Releasing lock "refresh_cache-66c0d842-75e7-4506-97a0-35048f5b445e" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:53:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-5c7b19db-d686-47aa-b189-159a2b2b1bdf req-2b56df00-ef7e-41a1-a214-542971540319 service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Received event network-vif-plugged-9d5eb777-bc52-4053-8ff1-e47215b83682 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:53:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5c7b19db-d686-47aa-b189-159a2b2b1bdf req-2b56df00-ef7e-41a1-a214-542971540319 service nova] Acquiring lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5c7b19db-d686-47aa-b189-159a2b2b1bdf req-2b56df00-ef7e-41a1-a214-542971540319 service nova] Lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5c7b19db-d686-47aa-b189-159a2b2b1bdf req-2b56df00-ef7e-41a1-a214-542971540319 service nova] Lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-5c7b19db-d686-47aa-b189-159a2b2b1bdf req-2b56df00-ef7e-41a1-a214-542971540319 service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] No waiting events found dispatching network-vif-plugged-9d5eb777-bc52-4053-8ff1-e47215b83682 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:53:09 user nova-compute[75378]: WARNING nova.compute.manager [req-5c7b19db-d686-47aa-b189-159a2b2b1bdf req-2b56df00-ef7e-41a1-a214-542971540319 service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Received unexpected event network-vif-plugged-9d5eb777-bc52-4053-8ff1-e47215b83682 for instance with vm_state building and task_state spawning.
Nov 09 03:53:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:11 user nova-compute[75378]: DEBUG nova.compute.manager [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:53:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:53:11 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Instance spawned successfully.
Nov 09 03:53:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:53:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:11 user nova-compute[75378]: DEBUG nova.compute.manager [req-e8d8e751-d207-401f-ba18-cce7379899d9 req-f2311d35-42ce-47de-a718-eea5a50cb918 service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Received event network-vif-plugged-9d5eb777-bc52-4053-8ff1-e47215b83682 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:53:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e8d8e751-d207-401f-ba18-cce7379899d9 req-f2311d35-42ce-47de-a718-eea5a50cb918 service nova] Acquiring lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e8d8e751-d207-401f-ba18-cce7379899d9 req-f2311d35-42ce-47de-a718-eea5a50cb918 service nova] Lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e8d8e751-d207-401f-ba18-cce7379899d9 req-f2311d35-42ce-47de-a718-eea5a50cb918 service nova] Lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:11 user nova-compute[75378]: DEBUG nova.compute.manager [req-e8d8e751-d207-401f-ba18-cce7379899d9 req-f2311d35-42ce-47de-a718-eea5a50cb918 service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] No waiting events found dispatching network-vif-plugged-9d5eb777-bc52-4053-8ff1-e47215b83682 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:53:11 user nova-compute[75378]: WARNING nova.compute.manager [req-e8d8e751-d207-401f-ba18-cce7379899d9 req-f2311d35-42ce-47de-a718-eea5a50cb918 service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Received unexpected event network-vif-plugged-9d5eb777-bc52-4053-8ff1-e47215b83682 for instance with vm_state building and task_state spawning.
Nov 09 03:53:11 user nova-compute[75378]: INFO nova.compute.manager [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Took 5.90 seconds to spawn the instance on the hypervisor.
Nov 09 03:53:11 user nova-compute[75378]: DEBUG nova.compute.manager [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:53:11 user nova-compute[75378]: INFO nova.compute.manager [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Took 6.78 seconds to build instance.
Nov 09 03:53:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7832321d-e347-402f-b502-f198072084e4 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "66c0d842-75e7-4506-97a0-35048f5b445e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.891s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:12 user nova-compute[75378]: INFO nova.compute.manager [None req-288369f8-65ef-470b-9895-54746a6cf65a tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Unrescuing
Nov 09 03:53:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-288369f8-65ef-470b-9895-54746a6cf65a tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:53:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-288369f8-65ef-470b-9895-54746a6cf65a tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquired lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:53:12 user nova-compute[75378]: DEBUG nova.network.neutron [None req-288369f8-65ef-470b-9895-54746a6cf65a tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:53:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:13 user nova-compute[75378]: DEBUG nova.network.neutron [None req-288369f8-65ef-470b-9895-54746a6cf65a tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Updating instance_info_cache with network_info: [{"id": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "address": "fa:16:3e:76:38:86", "network": {"id": "99b3e8be-7102-4b9a-aeae-3151b634d431", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6633f406337a45599d107946b7d4dfdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d1103d-bc", "ovs_interfaceid": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:53:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-288369f8-65ef-470b-9895-54746a6cf65a tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Releasing lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:53:13 user nova-compute[75378]: DEBUG nova.objects.instance [None req-288369f8-65ef-470b-9895-54746a6cf65a tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lazy-loading 'flavor' on Instance uuid 2abe50f8-3c9b-417e-889f-1d565089d678 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:53:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:13 user nova-compute[75378]: DEBUG nova.compute.manager [req-7e7b4e36-603e-4428-b9f9-1e2e4c0b220a req-3881ed24-8338-4100-9dd9-d1a32829b493 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received event network-changed-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:53:13 user nova-compute[75378]: DEBUG nova.compute.manager [req-7e7b4e36-603e-4428-b9f9-1e2e4c0b220a req-3881ed24-8338-4100-9dd9-d1a32829b493 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Refreshing instance network info cache due to event network-changed-f3d1103d-bcfc-4db6-b227-e1448c56f689. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:53:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7e7b4e36-603e-4428-b9f9-1e2e4c0b220a req-3881ed24-8338-4100-9dd9-d1a32829b493 service nova] Acquiring lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:53:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7e7b4e36-603e-4428-b9f9-1e2e4c0b220a req-3881ed24-8338-4100-9dd9-d1a32829b493 service nova] Acquired lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:53:13 user nova-compute[75378]: DEBUG nova.network.neutron [req-7e7b4e36-603e-4428-b9f9-1e2e4c0b220a req-3881ed24-8338-4100-9dd9-d1a32829b493 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Refreshing network info cache for port f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:53:14 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Instance destroyed successfully.
Nov 09 03:53:14 user nova-compute[75378]: DEBUG nova.network.neutron [req-7e7b4e36-603e-4428-b9f9-1e2e4c0b220a req-3881ed24-8338-4100-9dd9-d1a32829b493 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Updated VIF entry in instance network info cache for port f3d1103d-bcfc-4db6-b227-e1448c56f689. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:53:14 user nova-compute[75378]: DEBUG nova.network.neutron [req-7e7b4e36-603e-4428-b9f9-1e2e4c0b220a req-3881ed24-8338-4100-9dd9-d1a32829b493 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Updating instance_info_cache with network_info: [{"id": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "address": "fa:16:3e:76:38:86", "network": {"id": "99b3e8be-7102-4b9a-aeae-3151b634d431", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6633f406337a45599d107946b7d4dfdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d1103d-bc", "ovs_interfaceid": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:53:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7e7b4e36-603e-4428-b9f9-1e2e4c0b220a req-3881ed24-8338-4100-9dd9-d1a32829b493 service nova] Releasing lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:53:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:15 user nova-compute[75378]: DEBUG nova.compute.manager [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received event network-changed-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:53:15 user nova-compute[75378]: DEBUG nova.compute.manager [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Refreshing instance network info cache due to event network-changed-f3d1103d-bcfc-4db6-b227-e1448c56f689. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:53:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] Acquiring lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:53:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] Acquired lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:53:15 user nova-compute[75378]: DEBUG nova.network.neutron [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Refreshing network info cache for port f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:53:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:16 user nova-compute[75378]: DEBUG nova.network.neutron [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Updated VIF entry in instance network info cache for port f3d1103d-bcfc-4db6-b227-e1448c56f689. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:53:16 user nova-compute[75378]: DEBUG nova.network.neutron [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Updating instance_info_cache with network_info: [{"id": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "address": "fa:16:3e:76:38:86", "network": {"id": "99b3e8be-7102-4b9a-aeae-3151b634d431", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6633f406337a45599d107946b7d4dfdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d1103d-bc", "ovs_interfaceid": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:53:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] Releasing lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:53:16 user nova-compute[75378]: DEBUG nova.compute.manager [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received event network-vif-unplugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:53:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] Acquiring lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:16 user nova-compute[75378]: DEBUG nova.compute.manager [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] No waiting events found dispatching network-vif-unplugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:53:16 user nova-compute[75378]: WARNING nova.compute.manager [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received unexpected event network-vif-unplugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 for instance with vm_state rescued and task_state unrescuing.
Nov 09 03:53:16 user nova-compute[75378]: DEBUG nova.compute.manager [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received event network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:53:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] Acquiring lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:16 user nova-compute[75378]: DEBUG nova.compute.manager [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] No waiting events found dispatching network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:53:16 user nova-compute[75378]: WARNING nova.compute.manager [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received unexpected event network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 for instance with vm_state rescued and task_state unrescuing.
Nov 09 03:53:16 user nova-compute[75378]: DEBUG nova.compute.manager [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received event network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:53:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] Acquiring lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:16 user nova-compute[75378]: DEBUG nova.compute.manager [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] No waiting events found dispatching network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:53:16 user nova-compute[75378]: WARNING nova.compute.manager [req-2f5accee-801f-44da-bc88-dcda8c4b06b2 req-3649b3d2-843a-4681-987b-02f50cef7cef service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received unexpected event network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 for instance with vm_state rescued and task_state unrescuing.
Nov 09 03:53:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-f1cb5459-fa32-4511-9b18-c0f09b9014bd req-4fa5c6e8-34b9-4ff2-890e-61defa21585b service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received event network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:53:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f1cb5459-fa32-4511-9b18-c0f09b9014bd req-4fa5c6e8-34b9-4ff2-890e-61defa21585b service nova] Acquiring lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f1cb5459-fa32-4511-9b18-c0f09b9014bd req-4fa5c6e8-34b9-4ff2-890e-61defa21585b service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f1cb5459-fa32-4511-9b18-c0f09b9014bd req-4fa5c6e8-34b9-4ff2-890e-61defa21585b service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-f1cb5459-fa32-4511-9b18-c0f09b9014bd req-4fa5c6e8-34b9-4ff2-890e-61defa21585b service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] No waiting events found dispatching network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:53:17 user nova-compute[75378]: WARNING nova.compute.manager [req-f1cb5459-fa32-4511-9b18-c0f09b9014bd req-4fa5c6e8-34b9-4ff2-890e-61defa21585b service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received unexpected event network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 for instance with vm_state rescued and task_state unrescuing.
Nov 09 03:53:18 user nova-compute[75378]: DEBUG nova.compute.manager [None req-288369f8-65ef-470b-9895-54746a6cf65a tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:53:20 user nova-compute[75378]: DEBUG nova.compute.manager [req-1334181f-3c4d-4dd4-8baa-1d9867001b47 req-6c372c99-93df-4eb6-8e55-f182536f8bad service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Received event network-changed-62cd3fe2-71e3-478e-ad29-819df0de80f9 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:53:20 user nova-compute[75378]: DEBUG nova.compute.manager [req-1334181f-3c4d-4dd4-8baa-1d9867001b47 req-6c372c99-93df-4eb6-8e55-f182536f8bad service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Refreshing instance network info cache due to event network-changed-62cd3fe2-71e3-478e-ad29-819df0de80f9. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:53:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1334181f-3c4d-4dd4-8baa-1d9867001b47 req-6c372c99-93df-4eb6-8e55-f182536f8bad service nova] Acquiring lock "refresh_cache-2d21fbf8-55f3-4acf-8be2-e19a04c0f295" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:53:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1334181f-3c4d-4dd4-8baa-1d9867001b47 req-6c372c99-93df-4eb6-8e55-f182536f8bad service nova] Acquired lock "refresh_cache-2d21fbf8-55f3-4acf-8be2-e19a04c0f295" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:53:20 user nova-compute[75378]: DEBUG nova.network.neutron [req-1334181f-3c4d-4dd4-8baa-1d9867001b47 req-6c372c99-93df-4eb6-8e55-f182536f8bad service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Refreshing network info cache for port 62cd3fe2-71e3-478e-ad29-819df0de80f9 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:53:20 user nova-compute[75378]: DEBUG nova.network.neutron [req-1334181f-3c4d-4dd4-8baa-1d9867001b47 req-6c372c99-93df-4eb6-8e55-f182536f8bad service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Updated VIF entry in instance network info cache for port 62cd3fe2-71e3-478e-ad29-819df0de80f9. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:53:20 user nova-compute[75378]: DEBUG nova.network.neutron [req-1334181f-3c4d-4dd4-8baa-1d9867001b47 req-6c372c99-93df-4eb6-8e55-f182536f8bad service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Updating instance_info_cache with network_info: [{"id": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "address": "fa:16:3e:40:9f:77", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cd3fe2-71", "ovs_interfaceid": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:53:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-1334181f-3c4d-4dd4-8baa-1d9867001b47 req-6c372c99-93df-4eb6-8e55-f182536f8bad service nova] Releasing lock "refresh_cache-2d21fbf8-55f3-4acf-8be2-e19a04c0f295" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:53:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:29 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:53:31 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:53:31 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:53:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-013db901-fbee-4593-a14f-95a03e79fad0" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:53:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-013db901-fbee-4593-a14f-95a03e79fad0" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:53:31 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 03:53:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:31 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Updating instance_info_cache with network_info: [{"id": "5650a4a6-f99d-42e2-8b94-f18562892154", "address": "fa:16:3e:7f:95:df", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5650a4a6-f9", "ovs_interfaceid": "5650a4a6-f99d-42e2-8b94-f18562892154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:53:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-013db901-fbee-4593-a14f-95a03e79fad0" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:53:31 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 03:53:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:33 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG nova.objects.instance [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lazy-loading 'flavor' on Instance uuid 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:34 user nova-compute[75378]: INFO nova.compute.manager [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Attaching volume 17561744-dd99-4fce-aabe-7411fbc1eb80 to /dev/vdb
Nov 09 03:53:34 user nova-compute[75378]: DEBUG os_brick.utils [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b615901-5b85-4906-aeef-fb8ed695a18d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac35a33-8029-43e3-b2c7-4c9f4025b8e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fdaca1-e045-481e-99d5-d7d5115de4db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[601c8dde-6046-4446-be12-aecc08a19349]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:53:34 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:53:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca29ecc2-c38f-4b10-9fea-bbd34c2809d2]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG os_brick.utils [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:53:34 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Updating existing volume attachment record: 9c1ce5b4-18f7-4071-9ad2-0b5a78948d95 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:53:35 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:53:35 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:53:35 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:53:35 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:53:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:35 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:53:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:53:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:38 user nova-compute[75378]: DEBUG nova.compute.manager [None req-3fa4a245-d704-49cf-b877-df88c14593e2 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:53:38 user nova-compute[75378]: INFO nova.compute.manager [None req-3fa4a245-d704-49cf-b877-df88c14593e2 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] instance snapshotting
Nov 09 03:53:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:38 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-3fa4a245-d704-49cf-b877-df88c14593e2 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Beginning live snapshot process
Nov 09 03:53:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:53:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:53:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3fa4a245-d704-49cf-b877-df88c14593e2 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json -f qcow2 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3fa4a245-d704-49cf-b877-df88c14593e2 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json -f qcow2" returned: 0 in 0.219s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3fa4a245-d704-49cf-b877-df88c14593e2 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json -f qcow2 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3fa4a245-d704-49cf-b877-df88c14593e2 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json -f qcow2" returned: 0 in 0.235s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3fa4a245-d704-49cf-b877-df88c14593e2 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3fa4a245-d704-49cf-b877-df88c14593e2 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.204s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3fa4a245-d704-49cf-b877-df88c14593e2 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3_hw0p27/50b042ca9eab4138ac90ab5ebf447482.delta 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3fa4a245-d704-49cf-b877-df88c14593e2 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3_hw0p27/50b042ca9eab4138ac90ab5ebf447482.delta 1073741824" returned: 0 in 0.061s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:39 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-3fa4a245-d704-49cf-b877-df88c14593e2 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 09 03:53:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:40 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:53:40 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:53:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7480MB free_disk=25.05681610107422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:53:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-3fa4a245-d704-49cf-b877-df88c14593e2 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75378) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 03:53:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:53:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:53:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7d051405-6b57-4db2-9533-c2f4e87134d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:53:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2c2acb48-972a-41d7-987e-48e79b3bef93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:53:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 013db901-fbee-4593-a14f-95a03e79fad0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:53:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2abe50f8-3c9b-417e-889f-1d565089d678 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:53:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance ed92e04a-56ec-42f1-bed3-8b28a37d1475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:53:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:53:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 11f18164-9676-4a8a-91be-8bd87673ec5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:53:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 66c0d842-75e7-4506-97a0-35048f5b445e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:53:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:53:40 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:53:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-3fa4a245-d704-49cf-b877-df88c14593e2 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75378) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 03:53:41 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-3fa4a245-d704-49cf-b877-df88c14593e2 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 09 03:53:41 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:53:41 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:53:41 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:53:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.679s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:41 user nova-compute[75378]: DEBUG nova.privsep.utils [None req-3fa4a245-d704-49cf-b877-df88c14593e2 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75378) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 03:53:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3fa4a245-d704-49cf-b877-df88c14593e2 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3_hw0p27/50b042ca9eab4138ac90ab5ebf447482.delta /opt/stack/data/nova/instances/snapshots/tmp3_hw0p27/50b042ca9eab4138ac90ab5ebf447482 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3fa4a245-d704-49cf-b877-df88c14593e2 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3_hw0p27/50b042ca9eab4138ac90ab5ebf447482.delta /opt/stack/data/nova/instances/snapshots/tmp3_hw0p27/50b042ca9eab4138ac90ab5ebf447482" returned: 0 in 0.603s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:42 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-3fa4a245-d704-49cf-b877-df88c14593e2 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Snapshot extracted, beginning image upload
Nov 09 03:53:42 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:53:42 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:53:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:43 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:53:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:53:43 user nova-compute[75378]: INFO nova.compute.claims [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Claim successful on node user
Nov 09 03:53:43 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:53:43 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:53:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:43 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:53:43 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:53:43 user nova-compute[75378]: DEBUG nova.network.neutron [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:53:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:43 user nova-compute[75378]: INFO nova.compute.manager [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Terminating instance
Nov 09 03:53:43 user nova-compute[75378]: DEBUG nova.compute.manager [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:53:43 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:53:43 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:53:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:43 user nova-compute[75378]: DEBUG nova.policy [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e20cee1117e645709251b4b5a6ccb075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bd41e27d9485f845906fed03ba98e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:53:44 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Creating image(s)
Nov 09 03:53:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "/opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "/opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "/opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.200s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG nova.compute.manager [req-d184931f-1c22-4c38-9b36-b4d8a9c52696 req-2a728603-57ea-49a2-ab1e-9bc8564f7ab5 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Received event network-vif-unplugged-4c53e537-1637-4f65-b393-a10e68383acb {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d184931f-1c22-4c38-9b36-b4d8a9c52696 req-2a728603-57ea-49a2-ab1e-9bc8564f7ab5 service nova] Acquiring lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d184931f-1c22-4c38-9b36-b4d8a9c52696 req-2a728603-57ea-49a2-ab1e-9bc8564f7ab5 service nova] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d184931f-1c22-4c38-9b36-b4d8a9c52696 req-2a728603-57ea-49a2-ab1e-9bc8564f7ab5 service nova] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG nova.compute.manager [req-d184931f-1c22-4c38-9b36-b4d8a9c52696 req-2a728603-57ea-49a2-ab1e-9bc8564f7ab5 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] No waiting events found dispatching network-vif-unplugged-4c53e537-1637-4f65-b393-a10e68383acb {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG nova.compute.manager [req-d184931f-1c22-4c38-9b36-b4d8a9c52696 req-2a728603-57ea-49a2-ab1e-9bc8564f7ab5 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Received event network-vif-unplugged-4c53e537-1637-4f65-b393-a10e68383acb for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.220s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk 1073741824" returned: 0 in 0.065s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:44 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Instance destroyed successfully.
Nov 09 03:53:44 user nova-compute[75378]: DEBUG nova.objects.instance [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'resources' on Instance uuid 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-126426902',display_name='tempest-ServerRescueNegativeTestJSON-server-126426902',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-126426902',id=3,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:38:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87cddc7aab3e44cf82391eebc6a167b1',ramdisk_id='',reservation_id='r-2farfnrw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1449314788',owner_user_name='tempest-ServerRescueNegativeTestJSON-1449314788-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:38:27Z,user_data=None,user_id='ab29d2c2dda547aeb386aa641f4acd24',uuid=6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "4c53e537-1637-4f65-b393-a10e68383acb", "address": "fa:16:3e:d8:76:bf", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c53e537-16", "ovs_interfaceid": "4c53e537-1637-4f65-b393-a10e68383acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converting VIF {"id": "4c53e537-1637-4f65-b393-a10e68383acb", "address": "fa:16:3e:d8:76:bf", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c53e537-16", "ovs_interfaceid": "4c53e537-1637-4f65-b393-a10e68383acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:76:bf,bridge_name='br-int',has_traffic_filtering=True,id=4c53e537-1637-4f65-b393-a10e68383acb,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c53e537-16') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG os_vif [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:76:bf,bridge_name='br-int',has_traffic_filtering=True,id=4c53e537-1637-4f65-b393-a10e68383acb,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c53e537-16') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c53e537-16, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=faff080d-44a7-4ddb-97e6-18b74a6e8157) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:53:44 user nova-compute[75378]: INFO os_vif [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:76:bf,bridge_name='br-int',has_traffic_filtering=True,id=4c53e537-1637-4f65-b393-a10e68383acb,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c53e537-16')
Nov 09 03:53:44 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Deleting instance files /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76_del
Nov 09 03:53:44 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Deletion of /opt/stack/data/nova/instances/6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76_del complete
Nov 09 03:53:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.260s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:44 user nova-compute[75378]: INFO nova.compute.manager [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 09 03:53:44 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:53:44 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:53:45 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-3fa4a245-d704-49cf-b877-df88c14593e2 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Snapshot image upload complete
Nov 09 03:53:45 user nova-compute[75378]: INFO nova.compute.manager [None req-3fa4a245-d704-49cf-b877-df88c14593e2 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Took 6.26 seconds to snapshot the instance on the hypervisor.
Nov 09 03:53:45 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:45 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Cannot resize image /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:53:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:53:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Ensure instance console log exists: /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:53:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:45 user nova-compute[75378]: DEBUG nova.network.neutron [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Successfully created port: 02b1dc3d-7065-4313-898c-0cf171da746a {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:53:45 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:53:45 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Took 0.67 seconds to deallocate network for instance.
Nov 09 03:53:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "2abe50f8-3c9b-417e-889f-1d565089d678" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "2abe50f8-3c9b-417e-889f-1d565089d678" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:45 user nova-compute[75378]: INFO nova.compute.manager [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Detaching volume e2956f73-0160-4ad1-866d-7f42d37ab76c
Nov 09 03:53:45 user nova-compute[75378]: INFO nova.virt.block_device [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Attempting to driver detach volume e2956f73-0160-4ad1-866d-7f42d37ab76c from mountpoint /dev/vdb
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Attempting to detach device vdb from instance 2abe50f8-3c9b-417e-889f-1d565089d678 from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:53:46 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:53:46 user nova-compute[75378]:   <source dev="/dev/sde"/>
Nov 09 03:53:46 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:53:46 user nova-compute[75378]:   <serial>e2956f73-0160-4ad1-866d-7f42d37ab76c</serial>
Nov 09 03:53:46 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 03:53:46 user nova-compute[75378]: </disk>
Nov 09 03:53:46 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:53:46 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Successfully detached device vdb from instance 2abe50f8-3c9b-417e-889f-1d565089d678 from the persistent domain config.
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2abe50f8-3c9b-417e-889f-1d565089d678 from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:53:46 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:53:46 user nova-compute[75378]:   <source dev="/dev/sde"/>
Nov 09 03:53:46 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:53:46 user nova-compute[75378]:   <serial>e2956f73-0160-4ad1-866d-7f42d37ab76c</serial>
Nov 09 03:53:46 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 03:53:46 user nova-compute[75378]: </disk>
Nov 09 03:53:46 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.network.neutron [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Successfully updated port: 02b1dc3d-7065-4313-898c-0cf171da746a {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "refresh_cache-c63e2993-88fd-447b-82b7-e1d2fcd8d7da" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquired lock "refresh_cache-c63e2993-88fd-447b-82b7-e1d2fcd8d7da" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.network.neutron [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:53:46 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Deleted allocations for instance 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-fe7f2c93-947a-4c68-8320-82f9a54a8415 req-7dd837ca-a951-4266-b548-5f87505cf63d service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Received event network-changed-02b1dc3d-7065-4313-898c-0cf171da746a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-fe7f2c93-947a-4c68-8320-82f9a54a8415 req-7dd837ca-a951-4266-b548-5f87505cf63d service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Refreshing instance network info cache due to event network-changed-02b1dc3d-7065-4313-898c-0cf171da746a. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-fe7f2c93-947a-4c68-8320-82f9a54a8415 req-7dd837ca-a951-4266-b548-5f87505cf63d service nova] Acquiring lock "refresh_cache-c63e2993-88fd-447b-82b7-e1d2fcd8d7da" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-07057bcc-921c-4e1f-abd4-f3dbed4e3d24 tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.395s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.network.neutron [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2abe50f8-3c9b-417e-889f-1d565089d678 {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-8c889810-576b-41c8-9ef6-d08f3295218d req-8c3fe032-426e-4fb1-8ae7-acbec9774cf8 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Received event network-vif-plugged-4c53e537-1637-4f65-b393-a10e68383acb {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8c889810-576b-41c8-9ef6-d08f3295218d req-8c3fe032-426e-4fb1-8ae7-acbec9774cf8 service nova] Acquiring lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8c889810-576b-41c8-9ef6-d08f3295218d req-8c3fe032-426e-4fb1-8ae7-acbec9774cf8 service nova] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8c889810-576b-41c8-9ef6-d08f3295218d req-8c3fe032-426e-4fb1-8ae7-acbec9774cf8 service nova] Lock "6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-8c889810-576b-41c8-9ef6-d08f3295218d req-8c3fe032-426e-4fb1-8ae7-acbec9774cf8 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] No waiting events found dispatching network-vif-plugged-4c53e537-1637-4f65-b393-a10e68383acb {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:53:46 user nova-compute[75378]: WARNING nova.compute.manager [req-8c889810-576b-41c8-9ef6-d08f3295218d req-8c3fe032-426e-4fb1-8ae7-acbec9774cf8 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Received unexpected event network-vif-plugged-4c53e537-1637-4f65-b393-a10e68383acb for instance with vm_state deleted and task_state None.
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-8c889810-576b-41c8-9ef6-d08f3295218d req-8c3fe032-426e-4fb1-8ae7-acbec9774cf8 service nova] [instance: 6d3e0b6c-74e1-44b5-8ddf-42b5e2c27f76] Received event network-vif-deleted-4c53e537-1637-4f65-b393-a10e68383acb {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.network.neutron [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Updating instance_info_cache with network_info: [{"id": "02b1dc3d-7065-4313-898c-0cf171da746a", "address": "fa:16:3e:e1:1d:ed", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b1dc3d-70", "ovs_interfaceid": "02b1dc3d-7065-4313-898c-0cf171da746a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Releasing lock "refresh_cache-c63e2993-88fd-447b-82b7-e1d2fcd8d7da" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Instance network_info: |[{"id": "02b1dc3d-7065-4313-898c-0cf171da746a", "address": "fa:16:3e:e1:1d:ed", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b1dc3d-70", "ovs_interfaceid": "02b1dc3d-7065-4313-898c-0cf171da746a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-fe7f2c93-947a-4c68-8320-82f9a54a8415 req-7dd837ca-a951-4266-b548-5f87505cf63d service nova] Acquired lock "refresh_cache-c63e2993-88fd-447b-82b7-e1d2fcd8d7da" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.network.neutron [req-fe7f2c93-947a-4c68-8320-82f9a54a8415 req-7dd837ca-a951-4266-b548-5f87505cf63d service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Refreshing network info cache for port 02b1dc3d-7065-4313-898c-0cf171da746a {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Start _get_guest_xml network_info=[{"id": "02b1dc3d-7065-4313-898c-0cf171da746a", "address": "fa:16:3e:e1:1d:ed", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b1dc3d-70", "ovs_interfaceid": "02b1dc3d-7065-4313-898c-0cf171da746a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:53:46 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:53:46 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1615970580',display_name='tempest-VolumesSnapshotTestJSON-instance-1615970580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1615970580',id=30,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIrRjGV/tZcW85MWznr84qH4O3jQrxBAKYOH4WfPBXxATGXlPvh5HVGj/JjyDDAaD+KHqdRKp4QCEaK7HfeZSRarebu6Pis6rTyPzT1Ezc9+a6wY58qN7PV/PCHBjaJYg==',key_name='tempest-keypair-822910912',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='294bd41e27d9485f845906fed03ba98e',ramdisk_id='',reservation_id='r-7b0vlj8n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1705070970',owner_user_name='tempest-VolumesSnapshotTestJSON-1705070970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:53:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e20cee1117e645709251b4b5a6ccb075',uuid=c63e2993-88fd-447b-82b7-e1d2fcd8d7da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02b1dc3d-7065-4313-898c-0cf171da746a", "address": "fa:16:3e:e1:1d:ed", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b1dc3d-70", "ovs_interfaceid": "02b1dc3d-7065-4313-898c-0cf171da746a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Converting VIF {"id": "02b1dc3d-7065-4313-898c-0cf171da746a", "address": "fa:16:3e:e1:1d:ed", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b1dc3d-70", "ovs_interfaceid": "02b1dc3d-7065-4313-898c-0cf171da746a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1d:ed,bridge_name='br-int',has_traffic_filtering=True,id=02b1dc3d-7065-4313-898c-0cf171da746a,network=Network(0a93a88f-39de-4b68-9674-7ed7dfe24759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02b1dc3d-70') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.objects.instance [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lazy-loading 'pci_devices' on Instance uuid c63e2993-88fd-447b-82b7-e1d2fcd8d7da {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:53:46 user nova-compute[75378]:   <uuid>c63e2993-88fd-447b-82b7-e1d2fcd8d7da</uuid>
Nov 09 03:53:46 user nova-compute[75378]:   <name>instance-0000001e</name>
Nov 09 03:53:46 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:53:46 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:53:46 user nova-compute[75378]:   <metadata>
Nov 09 03:53:46 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:53:46 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:53:46 user nova-compute[75378]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1615970580</nova:name>
Nov 09 03:53:46 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:53:46</nova:creationTime>
Nov 09 03:53:46 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:53:46 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:53:46 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:53:46 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:53:46 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:53:46 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:53:46 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:53:46 user nova-compute[75378]:       <nova:owner>
Nov 09 03:53:46 user nova-compute[75378]:         <nova:user uuid="e20cee1117e645709251b4b5a6ccb075">tempest-VolumesSnapshotTestJSON-1705070970-project-member</nova:user>
Nov 09 03:53:46 user nova-compute[75378]:         <nova:project uuid="294bd41e27d9485f845906fed03ba98e">tempest-VolumesSnapshotTestJSON-1705070970</nova:project>
Nov 09 03:53:46 user nova-compute[75378]:       </nova:owner>
Nov 09 03:53:46 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:53:46 user nova-compute[75378]:       <nova:ports>
Nov 09 03:53:46 user nova-compute[75378]:         <nova:port uuid="02b1dc3d-7065-4313-898c-0cf171da746a">
Nov 09 03:53:46 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 09 03:53:46 user nova-compute[75378]:         </nova:port>
Nov 09 03:53:46 user nova-compute[75378]:       </nova:ports>
Nov 09 03:53:46 user nova-compute[75378]:     </nova:instance>
Nov 09 03:53:46 user nova-compute[75378]:   </metadata>
Nov 09 03:53:46 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:53:46 user nova-compute[75378]:     <system>
Nov 09 03:53:46 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:53:46 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:53:46 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:53:46 user nova-compute[75378]:       <entry name="serial">c63e2993-88fd-447b-82b7-e1d2fcd8d7da</entry>
Nov 09 03:53:46 user nova-compute[75378]:       <entry name="uuid">c63e2993-88fd-447b-82b7-e1d2fcd8d7da</entry>
Nov 09 03:53:46 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:53:46 user nova-compute[75378]:     </system>
Nov 09 03:53:46 user nova-compute[75378]:   </sysinfo>
Nov 09 03:53:46 user nova-compute[75378]:   <os>
Nov 09 03:53:46 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:53:46 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:53:46 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:53:46 user nova-compute[75378]:   </os>
Nov 09 03:53:46 user nova-compute[75378]:   <features>
Nov 09 03:53:46 user nova-compute[75378]:     <acpi/>
Nov 09 03:53:46 user nova-compute[75378]:     <apic/>
Nov 09 03:53:46 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:53:46 user nova-compute[75378]:   </features>
Nov 09 03:53:46 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:53:46 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:53:46 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:53:46 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:53:46 user nova-compute[75378]:   </clock>
Nov 09 03:53:46 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:53:46 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:53:46 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:53:46 user nova-compute[75378]:   </cpu>
Nov 09 03:53:46 user nova-compute[75378]:   <devices>
Nov 09 03:53:46 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:53:46 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:53:46 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk"/>
Nov 09 03:53:46 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:53:46 user nova-compute[75378]:     </disk>
Nov 09 03:53:46 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:53:46 user nova-compute[75378]:       <mac address="fa:16:3e:e1:1d:ed"/>
Nov 09 03:53:46 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:53:46 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:53:46 user nova-compute[75378]:       <target dev="tap02b1dc3d-70"/>
Nov 09 03:53:46 user nova-compute[75378]:     </interface>
Nov 09 03:53:46 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:53:46 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/console.log" append="off"/>
Nov 09 03:53:46 user nova-compute[75378]:     </serial>
Nov 09 03:53:46 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:53:46 user nova-compute[75378]:     <video>
Nov 09 03:53:46 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:53:46 user nova-compute[75378]:     </video>
Nov 09 03:53:46 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:53:46 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:53:46 user nova-compute[75378]:     </rng>
Nov 09 03:53:46 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:53:46 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:53:46 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:53:46 user nova-compute[75378]:     </memballoon>
Nov 09 03:53:46 user nova-compute[75378]:   </devices>
Nov 09 03:53:46 user nova-compute[75378]: </domain>
Nov 09 03:53:46 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1615970580',display_name='tempest-VolumesSnapshotTestJSON-instance-1615970580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1615970580',id=30,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIrRjGV/tZcW85MWznr84qH4O3jQrxBAKYOH4WfPBXxATGXlPvh5HVGj/JjyDDAaD+KHqdRKp4QCEaK7HfeZSRarebu6Pis6rTyPzT1Ezc9+a6wY58qN7PV/PCHBjaJYg==',key_name='tempest-keypair-822910912',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='294bd41e27d9485f845906fed03ba98e',ramdisk_id='',reservation_id='r-7b0vlj8n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1705070970',owner_user_name='tempest-VolumesSnapshotTestJSON-1705070970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:53:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e20cee1117e645709251b4b5a6ccb075',uuid=c63e2993-88fd-447b-82b7-e1d2fcd8d7da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02b1dc3d-7065-4313-898c-0cf171da746a", "address": "fa:16:3e:e1:1d:ed", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b1dc3d-70", "ovs_interfaceid": "02b1dc3d-7065-4313-898c-0cf171da746a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Converting VIF {"id": "02b1dc3d-7065-4313-898c-0cf171da746a", "address": "fa:16:3e:e1:1d:ed", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b1dc3d-70", "ovs_interfaceid": "02b1dc3d-7065-4313-898c-0cf171da746a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1d:ed,bridge_name='br-int',has_traffic_filtering=True,id=02b1dc3d-7065-4313-898c-0cf171da746a,network=Network(0a93a88f-39de-4b68-9674-7ed7dfe24759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02b1dc3d-70') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG os_vif [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1d:ed,bridge_name='br-int',has_traffic_filtering=True,id=02b1dc3d-7065-4313-898c-0cf171da746a,network=Network(0a93a88f-39de-4b68-9674-7ed7dfe24759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02b1dc3d-70') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'daed06d1-39d9-5b98-bc36-f0c6daca248a', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02b1dc3d-70, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02b1dc3d-70, col_values=(('qos', UUID('1a78ad41-1047-4cc8-a5e1-f3f467417e7a')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02b1dc3d-70, col_values=(('external_ids', {'iface-id': '02b1dc3d-7065-4313-898c-0cf171da746a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:1d:ed', 'vm-uuid': 'c63e2993-88fd-447b-82b7-e1d2fcd8d7da'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:46 user nova-compute[75378]: INFO os_vif [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1d:ed,bridge_name='br-int',has_traffic_filtering=True,id=02b1dc3d-7065-4313-898c-0cf171da746a,network=Network(0a93a88f-39de-4b68-9674-7ed7dfe24759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02b1dc3d-70')
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:53:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] No VIF found with MAC fa:16:3e:e1:1d:ed, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:53:47 user nova-compute[75378]: DEBUG nova.network.neutron [req-fe7f2c93-947a-4c68-8320-82f9a54a8415 req-7dd837ca-a951-4266-b548-5f87505cf63d service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Updated VIF entry in instance network info cache for port 02b1dc3d-7065-4313-898c-0cf171da746a. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:53:47 user nova-compute[75378]: DEBUG nova.network.neutron [req-fe7f2c93-947a-4c68-8320-82f9a54a8415 req-7dd837ca-a951-4266-b548-5f87505cf63d service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Updating instance_info_cache with network_info: [{"id": "02b1dc3d-7065-4313-898c-0cf171da746a", "address": "fa:16:3e:e1:1d:ed", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b1dc3d-70", "ovs_interfaceid": "02b1dc3d-7065-4313-898c-0cf171da746a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:53:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-fe7f2c93-947a-4c68-8320-82f9a54a8415 req-7dd837ca-a951-4266-b548-5f87505cf63d service nova] Releasing lock "refresh_cache-c63e2993-88fd-447b-82b7-e1d2fcd8d7da" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:53:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:48 user nova-compute[75378]: DEBUG nova.compute.manager [req-d1392f06-fd53-4b1e-9abf-429ede5c544e req-69eebe1c-f067-44bb-922b-de82306cf7fb service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Received event network-vif-plugged-02b1dc3d-7065-4313-898c-0cf171da746a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:53:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d1392f06-fd53-4b1e-9abf-429ede5c544e req-69eebe1c-f067-44bb-922b-de82306cf7fb service nova] Acquiring lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d1392f06-fd53-4b1e-9abf-429ede5c544e req-69eebe1c-f067-44bb-922b-de82306cf7fb service nova] Lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d1392f06-fd53-4b1e-9abf-429ede5c544e req-69eebe1c-f067-44bb-922b-de82306cf7fb service nova] Lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:48 user nova-compute[75378]: DEBUG nova.compute.manager [req-d1392f06-fd53-4b1e-9abf-429ede5c544e req-69eebe1c-f067-44bb-922b-de82306cf7fb service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] No waiting events found dispatching network-vif-plugged-02b1dc3d-7065-4313-898c-0cf171da746a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:53:48 user nova-compute[75378]: WARNING nova.compute.manager [req-d1392f06-fd53-4b1e-9abf-429ede5c544e req-69eebe1c-f067-44bb-922b-de82306cf7fb service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Received unexpected event network-vif-plugged-02b1dc3d-7065-4313-898c-0cf171da746a for instance with vm_state building and task_state spawning.
Nov 09 03:53:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "dad51975-3054-4265-866e-63b1fa778472" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "dad51975-3054-4265-866e-63b1fa778472" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:53:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:48 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:53:48 user nova-compute[75378]: INFO nova.compute.claims [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Claim successful on node user
Nov 09 03:53:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:49 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:53:49 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:53:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.724s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:49 user nova-compute[75378]: DEBUG nova.compute.manager [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:53:49 user nova-compute[75378]: DEBUG nova.compute.manager [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:53:49 user nova-compute[75378]: DEBUG nova.network.neutron [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:53:49 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:53:49 user nova-compute[75378]: DEBUG nova.compute.manager [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:53:49 user nova-compute[75378]: DEBUG nova.policy [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b74e4631d102431f83fe51fc39a3768a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02ac142a06244ef9819e09b22e4a941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:53:49 user nova-compute[75378]: DEBUG nova.compute.manager [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:53:49 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:53:49 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Creating image(s)
Nov 09 03:53:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "/opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "/opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "/opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "ff07ce4742735dccee0af3bf163290ff8521ad3f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "ff07ce4742735dccee0af3bf163290ff8521ad3f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff07ce4742735dccee0af3bf163290ff8521ad3f.part --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff07ce4742735dccee0af3bf163290ff8521ad3f.part --force-share --output=json" returned: 0 in 0.199s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG nova.virt.images [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] 2f041f51-ee71-45c4-8f3e-0fb1c98acb3b was qcow2, converting to raw {{(pid=75378) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG nova.privsep.utils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75378) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ff07ce4742735dccee0af3bf163290ff8521ad3f.part /opt/stack/data/nova/instances/_base/ff07ce4742735dccee0af3bf163290ff8521ad3f.converted {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG nova.network.neutron [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Successfully created port: aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-6a8538cf-a13d-4780-a9b5-19e05f8d3267 req-9bacb37c-0a02-48ee-ac77-19e69701d21e service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Received event network-vif-plugged-02b1dc3d-7065-4313-898c-0cf171da746a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6a8538cf-a13d-4780-a9b5-19e05f8d3267 req-9bacb37c-0a02-48ee-ac77-19e69701d21e service nova] Acquiring lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6a8538cf-a13d-4780-a9b5-19e05f8d3267 req-9bacb37c-0a02-48ee-ac77-19e69701d21e service nova] Lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6a8538cf-a13d-4780-a9b5-19e05f8d3267 req-9bacb37c-0a02-48ee-ac77-19e69701d21e service nova] Lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-6a8538cf-a13d-4780-a9b5-19e05f8d3267 req-9bacb37c-0a02-48ee-ac77-19e69701d21e service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] No waiting events found dispatching network-vif-plugged-02b1dc3d-7065-4313-898c-0cf171da746a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:53:50 user nova-compute[75378]: WARNING nova.compute.manager [req-6a8538cf-a13d-4780-a9b5-19e05f8d3267 req-9bacb37c-0a02-48ee-ac77-19e69701d21e service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Received unexpected event network-vif-plugged-02b1dc3d-7065-4313-898c-0cf171da746a for instance with vm_state building and task_state spawning.
Nov 09 03:53:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ff07ce4742735dccee0af3bf163290ff8521ad3f.part /opt/stack/data/nova/instances/_base/ff07ce4742735dccee0af3bf163290ff8521ad3f.converted" returned: 0 in 0.214s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff07ce4742735dccee0af3bf163290ff8521ad3f.converted --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:53:50 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Instance spawned successfully.
Nov 09 03:53:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff07ce4742735dccee0af3bf163290ff8521ad3f.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "ff07ce4742735dccee0af3bf163290ff8521ad3f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.035s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff07ce4742735dccee0af3bf163290ff8521ad3f --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:50 user nova-compute[75378]: INFO nova.compute.manager [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Took 6.70 seconds to spawn the instance on the hypervisor.
Nov 09 03:53:50 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:53:50 user nova-compute[75378]: INFO nova.compute.manager [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Took 7.58 seconds to build instance.
Nov 09 03:53:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f5115fd-2063-4b54-9975-1f5666fcdb53 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.686s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff07ce4742735dccee0af3bf163290ff8521ad3f --force-share --output=json" returned: 0 in 0.189s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "ff07ce4742735dccee0af3bf163290ff8521ad3f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "ff07ce4742735dccee0af3bf163290ff8521ad3f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff07ce4742735dccee0af3bf163290ff8521ad3f --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG nova.network.neutron [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Successfully updated port: aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "refresh_cache-dad51975-3054-4265-866e-63b1fa778472" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquired lock "refresh_cache-dad51975-3054-4265-866e-63b1fa778472" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:53:50 user nova-compute[75378]: DEBUG nova.network.neutron [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.network.neutron [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff07ce4742735dccee0af3bf163290ff8521ad3f --force-share --output=json" returned: 0 in 0.169s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ff07ce4742735dccee0af3bf163290ff8521ad3f,backing_fmt=raw /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ff07ce4742735dccee0af3bf163290ff8521ad3f,backing_fmt=raw /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk 1073741824" returned: 0 in 0.051s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "ff07ce4742735dccee0af3bf163290ff8521ad3f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff07ce4742735dccee0af3bf163290ff8521ad3f --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff07ce4742735dccee0af3bf163290ff8521ad3f --force-share --output=json" returned: 0 in 0.180s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.network.neutron [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Updating instance_info_cache with network_info: [{"id": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "address": "fa:16:3e:18:d4:b6", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeca0fbf-0f", "ovs_interfaceid": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Releasing lock "refresh_cache-dad51975-3054-4265-866e-63b1fa778472" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.compute.manager [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Instance network_info: |[{"id": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "address": "fa:16:3e:18:d4:b6", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeca0fbf-0f", "ovs_interfaceid": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Cannot resize image /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Ensure instance console log exists: /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Start _get_guest_xml network_info=[{"id": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "address": "fa:16:3e:18:d4:b6", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeca0fbf-0f", "ovs_interfaceid": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:53:45Z,direct_url=<?>,disk_format='qcow2',id=2f041f51-ee71-45c4-8f3e-0fb1c98acb3b,min_disk=0,min_ram=0,name='tempest-scenario-img--846239674',owner='a02ac142a06244ef9819e09b22e4a941',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:53:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '2f041f51-ee71-45c4-8f3e-0fb1c98acb3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:53:51 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:53:51 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:53:45Z,direct_url=<?>,disk_format='qcow2',id=2f041f51-ee71-45c4-8f3e-0fb1c98acb3b,min_disk=0,min_ram=0,name='tempest-scenario-img--846239674',owner='a02ac142a06244ef9819e09b22e4a941',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:53:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:53:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1516022386',display_name='tempest-TestMinimumBasicScenario-server-1516022386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1516022386',id=31,image_ref='2f041f51-ee71-45c4-8f3e-0fb1c98acb3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyv67vssOeK54qAWZF/k4AYOPOvPnW1WZG29d0czelV0KTeFlhrJn4uR3SgEpddKwTko+voJgQGBLPAiBklPeH/VIPj/HkZhhyo43ED47Xjto74eI7S/rK04aKd0FbnuQ==',key_name='tempest-TestMinimumBasicScenario-51380447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a02ac142a06244ef9819e09b22e4a941',ramdisk_id='',reservation_id='r-wdzzcp5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2f041f51-ee71-45c4-8f3e-0fb1c98acb3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-322168895',owner_user_name='tempest-TestMinimumBasicScenario-322168895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:53:50Z,user_data=None,user_id='b74e4631d102431f83fe51fc39a3768a',uuid=dad51975-3054-4265-866e-63b1fa778472,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "address": "fa:16:3e:18:d4:b6", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeca0fbf-0f", "ovs_interfaceid": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Converting VIF {"id": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "address": "fa:16:3e:18:d4:b6", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeca0fbf-0f", "ovs_interfaceid": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:d4:b6,bridge_name='br-int',has_traffic_filtering=True,id=aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8,network=Network(5fa0c6e5-0332-4a5f-b866-8f823ceaa13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeca0fbf-0f') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.objects.instance [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lazy-loading 'pci_devices' on Instance uuid dad51975-3054-4265-866e-63b1fa778472 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:53:51 user nova-compute[75378]:   <uuid>dad51975-3054-4265-866e-63b1fa778472</uuid>
Nov 09 03:53:51 user nova-compute[75378]:   <name>instance-0000001f</name>
Nov 09 03:53:51 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:53:51 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:53:51 user nova-compute[75378]:   <metadata>
Nov 09 03:53:51 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:53:51 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:53:51 user nova-compute[75378]:       <nova:name>tempest-TestMinimumBasicScenario-server-1516022386</nova:name>
Nov 09 03:53:51 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:53:51</nova:creationTime>
Nov 09 03:53:51 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:53:51 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:53:51 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:53:51 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:53:51 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:53:51 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:53:51 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:53:51 user nova-compute[75378]:       <nova:owner>
Nov 09 03:53:51 user nova-compute[75378]:         <nova:user uuid="b74e4631d102431f83fe51fc39a3768a">tempest-TestMinimumBasicScenario-322168895-project-member</nova:user>
Nov 09 03:53:51 user nova-compute[75378]:         <nova:project uuid="a02ac142a06244ef9819e09b22e4a941">tempest-TestMinimumBasicScenario-322168895</nova:project>
Nov 09 03:53:51 user nova-compute[75378]:       </nova:owner>
Nov 09 03:53:51 user nova-compute[75378]:       <nova:root type="image" uuid="2f041f51-ee71-45c4-8f3e-0fb1c98acb3b"/>
Nov 09 03:53:51 user nova-compute[75378]:       <nova:ports>
Nov 09 03:53:51 user nova-compute[75378]:         <nova:port uuid="aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8">
Nov 09 03:53:51 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 03:53:51 user nova-compute[75378]:         </nova:port>
Nov 09 03:53:51 user nova-compute[75378]:       </nova:ports>
Nov 09 03:53:51 user nova-compute[75378]:     </nova:instance>
Nov 09 03:53:51 user nova-compute[75378]:   </metadata>
Nov 09 03:53:51 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:53:51 user nova-compute[75378]:     <system>
Nov 09 03:53:51 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:53:51 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:53:51 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:53:51 user nova-compute[75378]:       <entry name="serial">dad51975-3054-4265-866e-63b1fa778472</entry>
Nov 09 03:53:51 user nova-compute[75378]:       <entry name="uuid">dad51975-3054-4265-866e-63b1fa778472</entry>
Nov 09 03:53:51 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:53:51 user nova-compute[75378]:     </system>
Nov 09 03:53:51 user nova-compute[75378]:   </sysinfo>
Nov 09 03:53:51 user nova-compute[75378]:   <os>
Nov 09 03:53:51 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:53:51 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:53:51 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:53:51 user nova-compute[75378]:   </os>
Nov 09 03:53:51 user nova-compute[75378]:   <features>
Nov 09 03:53:51 user nova-compute[75378]:     <acpi/>
Nov 09 03:53:51 user nova-compute[75378]:     <apic/>
Nov 09 03:53:51 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:53:51 user nova-compute[75378]:   </features>
Nov 09 03:53:51 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:53:51 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:53:51 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:53:51 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:53:51 user nova-compute[75378]:   </clock>
Nov 09 03:53:51 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:53:51 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:53:51 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:53:51 user nova-compute[75378]:   </cpu>
Nov 09 03:53:51 user nova-compute[75378]:   <devices>
Nov 09 03:53:51 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:53:51 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:53:51 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk"/>
Nov 09 03:53:51 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:53:51 user nova-compute[75378]:     </disk>
Nov 09 03:53:51 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:53:51 user nova-compute[75378]:       <mac address="fa:16:3e:18:d4:b6"/>
Nov 09 03:53:51 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:53:51 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:53:51 user nova-compute[75378]:       <target dev="tapaeca0fbf-0f"/>
Nov 09 03:53:51 user nova-compute[75378]:     </interface>
Nov 09 03:53:51 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:53:51 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/console.log" append="off"/>
Nov 09 03:53:51 user nova-compute[75378]:     </serial>
Nov 09 03:53:51 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:53:51 user nova-compute[75378]:     <video>
Nov 09 03:53:51 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:53:51 user nova-compute[75378]:     </video>
Nov 09 03:53:51 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:53:51 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:53:51 user nova-compute[75378]:     </rng>
Nov 09 03:53:51 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:53:51 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:53:51 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:53:51 user nova-compute[75378]:     </memballoon>
Nov 09 03:53:51 user nova-compute[75378]:   </devices>
Nov 09 03:53:51 user nova-compute[75378]: </domain>
Nov 09 03:53:51 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:53:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1516022386',display_name='tempest-TestMinimumBasicScenario-server-1516022386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1516022386',id=31,image_ref='2f041f51-ee71-45c4-8f3e-0fb1c98acb3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyv67vssOeK54qAWZF/k4AYOPOvPnW1WZG29d0czelV0KTeFlhrJn4uR3SgEpddKwTko+voJgQGBLPAiBklPeH/VIPj/HkZhhyo43ED47Xjto74eI7S/rK04aKd0FbnuQ==',key_name='tempest-TestMinimumBasicScenario-51380447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a02ac142a06244ef9819e09b22e4a941',ramdisk_id='',reservation_id='r-wdzzcp5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2f041f51-ee71-45c4-8f3e-0fb1c98acb3b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-322168895',owner_user_name='tempest-TestMinimumBasicScenario-322168895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:53:50Z,user_data=None,user_id='b74e4631d102431f83fe51fc39a3768a',uuid=dad51975-3054-4265-866e-63b1fa778472,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "address": "fa:16:3e:18:d4:b6", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeca0fbf-0f", "ovs_interfaceid": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Converting VIF {"id": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "address": "fa:16:3e:18:d4:b6", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeca0fbf-0f", "ovs_interfaceid": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:d4:b6,bridge_name='br-int',has_traffic_filtering=True,id=aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8,network=Network(5fa0c6e5-0332-4a5f-b866-8f823ceaa13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeca0fbf-0f') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG os_vif [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:d4:b6,bridge_name='br-int',has_traffic_filtering=True,id=aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8,network=Network(5fa0c6e5-0332-4a5f-b866-8f823ceaa13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeca0fbf-0f') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59d46216-7ff6-5a00-8441-edce3bc9687d', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaeca0fbf-0f, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaeca0fbf-0f, col_values=(('qos', UUID('c66ae1ae-5070-4988-bfaf-bad6ebb37dff')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaeca0fbf-0f, col_values=(('external_ids', {'iface-id': 'aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:d4:b6', 'vm-uuid': 'dad51975-3054-4265-866e-63b1fa778472'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:51 user nova-compute[75378]: INFO os_vif [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:d4:b6,bridge_name='br-int',has_traffic_filtering=True,id=aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8,network=Network(5fa0c6e5-0332-4a5f-b866-8f823ceaa13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeca0fbf-0f')
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:53:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] No VIF found with MAC fa:16:3e:18:d4:b6, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:53:52 user nova-compute[75378]: DEBUG nova.compute.manager [req-a70a3e64-5436-499a-b255-b46999de9ae7 req-87cf36e1-e6e7-4d78-87e3-d71ced526c6d service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received event network-changed-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:53:52 user nova-compute[75378]: DEBUG nova.compute.manager [req-a70a3e64-5436-499a-b255-b46999de9ae7 req-87cf36e1-e6e7-4d78-87e3-d71ced526c6d service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Refreshing instance network info cache due to event network-changed-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:53:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a70a3e64-5436-499a-b255-b46999de9ae7 req-87cf36e1-e6e7-4d78-87e3-d71ced526c6d service nova] Acquiring lock "refresh_cache-dad51975-3054-4265-866e-63b1fa778472" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:53:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a70a3e64-5436-499a-b255-b46999de9ae7 req-87cf36e1-e6e7-4d78-87e3-d71ced526c6d service nova] Acquired lock "refresh_cache-dad51975-3054-4265-866e-63b1fa778472" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:53:52 user nova-compute[75378]: DEBUG nova.network.neutron [req-a70a3e64-5436-499a-b255-b46999de9ae7 req-87cf36e1-e6e7-4d78-87e3-d71ced526c6d service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Refreshing network info cache for port aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:53:52 user nova-compute[75378]: DEBUG nova.network.neutron [req-a70a3e64-5436-499a-b255-b46999de9ae7 req-87cf36e1-e6e7-4d78-87e3-d71ced526c6d service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Updated VIF entry in instance network info cache for port aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:53:52 user nova-compute[75378]: DEBUG nova.network.neutron [req-a70a3e64-5436-499a-b255-b46999de9ae7 req-87cf36e1-e6e7-4d78-87e3-d71ced526c6d service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Updating instance_info_cache with network_info: [{"id": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "address": "fa:16:3e:18:d4:b6", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeca0fbf-0f", "ovs_interfaceid": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:53:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a70a3e64-5436-499a-b255-b46999de9ae7 req-87cf36e1-e6e7-4d78-87e3-d71ced526c6d service nova] Releasing lock "refresh_cache-dad51975-3054-4265-866e-63b1fa778472" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:53:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-59cd84c1-cf30-468b-a0eb-d464a9c7f25c req-dc17c987-fb82-45df-acdf-c5f395c0e795 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received event network-vif-plugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:53:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-59cd84c1-cf30-468b-a0eb-d464a9c7f25c req-dc17c987-fb82-45df-acdf-c5f395c0e795 service nova] Acquiring lock "dad51975-3054-4265-866e-63b1fa778472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-59cd84c1-cf30-468b-a0eb-d464a9c7f25c req-dc17c987-fb82-45df-acdf-c5f395c0e795 service nova] Lock "dad51975-3054-4265-866e-63b1fa778472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-59cd84c1-cf30-468b-a0eb-d464a9c7f25c req-dc17c987-fb82-45df-acdf-c5f395c0e795 service nova] Lock "dad51975-3054-4265-866e-63b1fa778472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-59cd84c1-cf30-468b-a0eb-d464a9c7f25c req-dc17c987-fb82-45df-acdf-c5f395c0e795 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] No waiting events found dispatching network-vif-plugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:53:53 user nova-compute[75378]: WARNING nova.compute.manager [req-59cd84c1-cf30-468b-a0eb-d464a9c7f25c req-dc17c987-fb82-45df-acdf-c5f395c0e795 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received unexpected event network-vif-plugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 for instance with vm_state building and task_state spawning.
Nov 09 03:53:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:55 user nova-compute[75378]: DEBUG nova.compute.manager [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:53:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:53:55 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: dad51975-3054-4265-866e-63b1fa778472] Instance spawned successfully.
Nov 09 03:53:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:53:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-55a9a598-9567-4da7-ac79-c803c6bedaaf req-502ebb55-836a-41da-af51-93a91e6b3f9d service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received event network-vif-plugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:53:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-55a9a598-9567-4da7-ac79-c803c6bedaaf req-502ebb55-836a-41da-af51-93a91e6b3f9d service nova] Acquiring lock "dad51975-3054-4265-866e-63b1fa778472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:53:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-55a9a598-9567-4da7-ac79-c803c6bedaaf req-502ebb55-836a-41da-af51-93a91e6b3f9d service nova] Lock "dad51975-3054-4265-866e-63b1fa778472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:53:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-55a9a598-9567-4da7-ac79-c803c6bedaaf req-502ebb55-836a-41da-af51-93a91e6b3f9d service nova] Lock "dad51975-3054-4265-866e-63b1fa778472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-55a9a598-9567-4da7-ac79-c803c6bedaaf req-502ebb55-836a-41da-af51-93a91e6b3f9d service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] No waiting events found dispatching network-vif-plugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:53:55 user nova-compute[75378]: WARNING nova.compute.manager [req-55a9a598-9567-4da7-ac79-c803c6bedaaf req-502ebb55-836a-41da-af51-93a91e6b3f9d service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received unexpected event network-vif-plugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 for instance with vm_state building and task_state spawning.
Nov 09 03:53:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:53:55 user nova-compute[75378]: INFO nova.compute.manager [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 09 03:53:55 user nova-compute[75378]: DEBUG nova.compute.manager [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:53:55 user nova-compute[75378]: INFO nova.compute.manager [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Took 6.84 seconds to build instance.
Nov 09 03:53:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c5a81047-cd3f-40af-89bb-5993308ee040 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "dad51975-3054-4265-866e-63b1fa778472" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.940s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:53:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:53:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:54:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 03:54:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:54:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:54:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:06 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2abe50f8-3c9b-417e-889f-1d565089d678 is timed out.
Nov 09 03:54:06 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Successfully detached device vdb from instance 2abe50f8-3c9b-417e-889f-1d565089d678 from the live domain config.
Nov 09 03:54:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKrhJLbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:54:06 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:54:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a389775a-ed29-48f9-ae90-256e79c21686]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:201d6d2b-e5c7-4d9c-8326-f354085b2a5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:54:06 user nova-compute[75378]: No targets found.
Nov 09 03:54:06 user nova-compute[75378]: iSNS:
Nov 09 03:54:06 user nova-compute[75378]: No targets found.
Nov 09 03:54:06 user nova-compute[75378]: STATIC:
Nov 09 03:54:06 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8
Nov 09 03:54:06 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:54:06 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:54:06 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 03:54:06 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:54:06 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:54:06 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c
Nov 09 03:54:06 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:54:06 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:54:06 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:201d6d2b-e5c7-4d9c-8326-f354085b2a5d
Nov 09 03:54:06 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:54:06 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:54:06 user nova-compute[75378]: FIRMWARE:
Nov 09 03:54:06 user nova-compute[75378]: No targets found.
Nov 09 03:54:06 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:54:06 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:54:06 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0e5e10-fa67-4b22-8e70-bd2d749a25ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:201d6d2b-e5c7-4d9c-8326-f354085b2a5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf36408-5799-41e9-a2d0-5c1d63bd68c6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201d6d2b-e5c7-4d9c-8326-f354085b2a5d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:54:06 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:54:06 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:54:06 user nova-compute[75378]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201d6d2b-e5c7-4d9c-8326-f354085b2a5d (non-flash)
Nov 09 03:54:06 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:54:06 user nova-compute[75378]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c (non-flash)
Nov 09 03:54:06 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:54:06 user nova-compute[75378]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201d6d2b-e5c7-4d9c-8326-f354085b2a5d (non-flash)
Nov 09 03:54:06 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c429750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c'): ({'sde'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Removing single pathed devices sde {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d0d472-d304-44de-a352-c054eaf26b67]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5414a30-3c6c-42b8-8f6b-dfe5ba255c1a]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Flushing IO for device /dev/sde {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[28184389-b876-4798-be4b-50b3c075c9b0]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f15dbb0-5132-47b2-9c4e-4b86df47e45a]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] SCSI volumes sde have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[33881862-6fc7-4fe4-8ef3-fe145a3ddf38]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7799a690-5946-4b70-bdb3-08cf16c17427]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c, portal: 172.16.0.220,3260]
Nov 09 03:54:06 user nova-compute[75378]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c, portal: 172.16.0.220,3260] successful.
Nov 09 03:54:06 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2956f73-0160-4ad1-866d-7f42d37ab76c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[652ba1e0-b771-4f2f-bfcd-297a27d2479e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] <== disconnect_volume: return (301ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:54:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBJuMoVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:54:07 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:54:07 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:54:07 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[524f2e61-4ad3-4dfb-b8cc-068fd7fc084f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:54:07 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b37c803-30af-4203-a26d-56ae50834bcd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80] added
Nov 09 03:54:07 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ee72c7-06fa-4689-8adc-7d67dfb6d7ed]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f3b7c2-0a34-4cd5-a449-b55967955cbd]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HBJuMoVm {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HBJuMoVm" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2789f5e8-c90a-486a-94ea-2d54b8d1345b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HBJuMoVm'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcd5ac0-b338-42c6-ad60-802a95562a6c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG nova.objects.instance [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lazy-loading 'flavor' on Instance uuid 2abe50f8-3c9b-417e-889f-1d565089d678 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a1978c-0814-4ebc-ad11-4bd79410ca40]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:54:07 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:54:07 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:54:07 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:54:07 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f50744cb-7fea-4b06-b75e-ed55c2fca012 tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "2abe50f8-3c9b-417e-889f-1d565089d678" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.905s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf69b7a-352a-45ac-9331-7e4c1949869a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80, portal: 172.16.0.220,3260]
Nov 09 03:54:07 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80, portal: 172.16.0.220,3260] successful.
Nov 09 03:54:07 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8928359-2c34-4982-8cbb-7781a4035d3b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[804ab89c-b684-4534-9195-ce89f1ec5361]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:54:07 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:54:07 user nova-compute[75378]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 (non-flash)
Nov 09 03:54:07 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:54:07 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:54:07 user nova-compute[75378]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 (non-flash)
Nov 09 03:54:07 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b82ba8-9c99-4432-8ac3-88d185178866]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:07 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: None {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:54:08 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:54:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBJuMoVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:54:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:54:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23339313738656661', 'path': '/dev/sdd'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:54:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339313738656661', 'path': '/dev/sdd'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:54:08 user nova-compute[75378]: DEBUG nova.objects.instance [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lazy-loading 'flavor' on Instance uuid 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:54:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 03:54:08 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:54:08 user nova-compute[75378]:   <source dev="/dev/sdd"/>
Nov 09 03:54:08 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:54:08 user nova-compute[75378]:   <serial>17561744-dd99-4fce-aabe-7411fbc1eb80</serial>
Nov 09 03:54:08 user nova-compute[75378]: </disk>
Nov 09 03:54:08 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 03:54:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:54:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:54:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] No VIF found with MAC fa:16:3e:40:9f:77, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:54:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-76859a69-7ffb-4c18-892e-8d141bcf9ceb tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.822s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:54:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG nova.objects.instance [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lazy-loading 'flavor' on Instance uuid 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.006s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:54:17 user nova-compute[75378]: INFO nova.compute.manager [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Attaching volume f89dbc80-5170-4ff7-863b-365e6584386e to /dev/vdc
Nov 09 03:54:17 user nova-compute[75378]: DEBUG os_brick.utils [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb4fc6e-33ed-4dd6-942a-896c96cf9fb9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a82505-7dd5-421a-8eb9-d95b221dc81c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1428495-1e2a-47a8-ac0b-6cca74eb0947]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a02dd9-1ef7-407a-8a17-d9c0bc772c64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:54:17 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:54:17 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd9feea-7049-4db3-882a-441d92ff368c]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG os_brick.utils [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:54:17 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Updating existing volume attachment record: f0b220c2-7e2d-47a7-98ba-dd4740d59686 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:54:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:31 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:54:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:54:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:54:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 03:54:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:54:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:54:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:54:33 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:54:33 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:54:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:54:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:54:33 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 03:54:33 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Updating instance_info_cache with network_info: [{"id": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "address": "fa:16:3e:76:38:86", "network": {"id": "99b3e8be-7102-4b9a-aeae-3151b634d431", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6633f406337a45599d107946b7d4dfdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d1103d-bc", "ovs_interfaceid": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:54:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-2abe50f8-3c9b-417e-889f-1d565089d678" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:54:33 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 03:54:34 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:54:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:54:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:54:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:54:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:54:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:54:34 user nova-compute[75378]: INFO nova.compute.manager [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Terminating instance
Nov 09 03:54:34 user nova-compute[75378]: DEBUG nova.compute.manager [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:54:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:34 user nova-compute[75378]: DEBUG nova.compute.manager [req-f7a61877-3000-47bb-a1db-0e916e427b9b req-34c262da-c163-4b8f-86b1-73a7855be9a7 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received event network-vif-unplugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:54:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f7a61877-3000-47bb-a1db-0e916e427b9b req-34c262da-c163-4b8f-86b1-73a7855be9a7 service nova] Acquiring lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:54:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f7a61877-3000-47bb-a1db-0e916e427b9b req-34c262da-c163-4b8f-86b1-73a7855be9a7 service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:54:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f7a61877-3000-47bb-a1db-0e916e427b9b req-34c262da-c163-4b8f-86b1-73a7855be9a7 service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:54:34 user nova-compute[75378]: DEBUG nova.compute.manager [req-f7a61877-3000-47bb-a1db-0e916e427b9b req-34c262da-c163-4b8f-86b1-73a7855be9a7 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] No waiting events found dispatching network-vif-unplugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:54:34 user nova-compute[75378]: DEBUG nova.compute.manager [req-f7a61877-3000-47bb-a1db-0e916e427b9b req-34c262da-c163-4b8f-86b1-73a7855be9a7 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received event network-vif-unplugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:54:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:35 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:54:35 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Instance destroyed successfully.
Nov 09 03:54:35 user nova-compute[75378]: DEBUG nova.objects.instance [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lazy-loading 'resources' on Instance uuid c647ac61-b8d0-4b30-b1cc-86ddc896eaa3 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:54:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:36:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1026804955',display_name='tempest-ServerRescueNegativeTestJSON-server-1026804955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1026804955',id=2,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:41:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='87cddc7aab3e44cf82391eebc6a167b1',ramdisk_id='',reservation_id='r-lxupg3g9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1449314788',owner_user_name='tempest-ServerRescueNegativeTestJSON-1449314788-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:43:28Z,user_data=None,user_id='ab29d2c2dda547aeb386aa641f4acd24',uuid=c647ac61-b8d0-4b30-b1cc-86ddc896eaa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "address": "fa:16:3e:a6:f3:49", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d42515-fd", "ovs_interfaceid": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:54:35 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converting VIF {"id": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "address": "fa:16:3e:a6:f3:49", "network": {"id": "7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1318913253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "87cddc7aab3e44cf82391eebc6a167b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27d42515-fd", "ovs_interfaceid": "27d42515-fd6b-4627-bfb1-06ee1c1dc36a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:54:35 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:f3:49,bridge_name='br-int',has_traffic_filtering=True,id=27d42515-fd6b-4627-bfb1-06ee1c1dc36a,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d42515-fd') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:54:35 user nova-compute[75378]: DEBUG os_vif [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:f3:49,bridge_name='br-int',has_traffic_filtering=True,id=27d42515-fd6b-4627-bfb1-06ee1c1dc36a,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d42515-fd') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:54:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27d42515-fd, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:54:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=656e5e42-d69d-4e59-8cd6-8f0f3db20420) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:54:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:35 user nova-compute[75378]: INFO os_vif [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:f3:49,bridge_name='br-int',has_traffic_filtering=True,id=27d42515-fd6b-4627-bfb1-06ee1c1dc36a,network=Network(7ddd1638-05f2-4cc2-bd2b-b61c13c86a1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27d42515-fd')
Nov 09 03:54:35 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Deleting instance files /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3_del
Nov 09 03:54:35 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Deletion of /opt/stack/data/nova/instances/c647ac61-b8d0-4b30-b1cc-86ddc896eaa3_del complete
Nov 09 03:54:35 user nova-compute[75378]: INFO nova.compute.manager [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 09 03:54:35 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:54:35 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:54:35 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:54:35 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:54:35 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Took 0.43 seconds to deallocate network for instance.
Nov 09 03:54:35 user nova-compute[75378]: DEBUG nova.compute.manager [req-9352ce0e-5195-452f-96a3-5a712ac6fd36 req-aeb0e18b-3123-40dc-a627-87f2f8df03a5 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received event network-vif-deleted-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:54:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:54:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:54:36 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:54:36 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:54:36 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:54:36 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:54:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:54:36 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Deleted allocations for instance c647ac61-b8d0-4b30-b1cc-86ddc896eaa3
Nov 09 03:54:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-b2482b48-4b18-4222-87af-63f72324c8fa tempest-ServerRescueNegativeTestJSON-1449314788 tempest-ServerRescueNegativeTestJSON-1449314788-project-member] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.718s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:54:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "2abe50f8-3c9b-417e-889f-1d565089d678" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:54:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "2abe50f8-3c9b-417e-889f-1d565089d678" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:54:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:54:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:54:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:54:36 user nova-compute[75378]: INFO nova.compute.manager [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Terminating instance
Nov 09 03:54:36 user nova-compute[75378]: DEBUG nova.compute.manager [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:54:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:36 user nova-compute[75378]: DEBUG nova.compute.manager [req-99030dd3-8c0b-4000-b2c4-5ea76df53227 req-6c7d2358-bb9c-440e-b321-0766b10dea55 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received event network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:54:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-99030dd3-8c0b-4000-b2c4-5ea76df53227 req-6c7d2358-bb9c-440e-b321-0766b10dea55 service nova] Acquiring lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:54:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-99030dd3-8c0b-4000-b2c4-5ea76df53227 req-6c7d2358-bb9c-440e-b321-0766b10dea55 service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:54:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-99030dd3-8c0b-4000-b2c4-5ea76df53227 req-6c7d2358-bb9c-440e-b321-0766b10dea55 service nova] Lock "c647ac61-b8d0-4b30-b1cc-86ddc896eaa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:54:36 user nova-compute[75378]: DEBUG nova.compute.manager [req-99030dd3-8c0b-4000-b2c4-5ea76df53227 req-6c7d2358-bb9c-440e-b321-0766b10dea55 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] No waiting events found dispatching network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:54:36 user nova-compute[75378]: WARNING nova.compute.manager [req-99030dd3-8c0b-4000-b2c4-5ea76df53227 req-6c7d2358-bb9c-440e-b321-0766b10dea55 service nova] [instance: c647ac61-b8d0-4b30-b1cc-86ddc896eaa3] Received unexpected event network-vif-plugged-27d42515-fd6b-4627-bfb1-06ee1c1dc36a for instance with vm_state deleted and task_state None.
Nov 09 03:54:37 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:54:37 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Instance destroyed successfully.
Nov 09 03:54:37 user nova-compute[75378]: DEBUG nova.objects.instance [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lazy-loading 'resources' on Instance uuid 2abe50f8-3c9b-417e-889f-1d565089d678 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:47:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-923846665',display_name='tempest-ServerStableDeviceRescueTest-server-923846665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-923846665',id=24,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6vPwFrNFPEfbM2OavXaL8l/ouKox+s8izxBC7SxRx4T9FG3kQK/fpJG8Pg3/KTsjW9v2sQ6HRculfxxLxqRaMpZaq1p8ooFGUp+q7xPNn822yLnMs4FIk9MYMVPb05XQ==',key_name='tempest-keypair-1087149700',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6633f406337a45599d107946b7d4dfdd',ramdisk_id='',reservation_id='r-e4hle5lx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1146989307',owner_user_name='tempest-ServerStableDeviceRescueTest-1146989307-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:53:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fadaa571b9b47a4a5978149c070f344',uuid=2abe50f8-3c9b-417e-889f-1d565089d678,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "address": "fa:16:3e:76:38:86", "network": {"id": "99b3e8be-7102-4b9a-aeae-3151b634d431", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6633f406337a45599d107946b7d4dfdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d1103d-bc", "ovs_interfaceid": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Converting VIF {"id": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "address": "fa:16:3e:76:38:86", "network": {"id": "99b3e8be-7102-4b9a-aeae-3151b634d431", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1104084388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6633f406337a45599d107946b7d4dfdd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d1103d-bc", "ovs_interfaceid": "f3d1103d-bcfc-4db6-b227-e1448c56f689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:38:86,bridge_name='br-int',has_traffic_filtering=True,id=f3d1103d-bcfc-4db6-b227-e1448c56f689,network=Network(99b3e8be-7102-4b9a-aeae-3151b634d431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3d1103d-bc') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG os_vif [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:38:86,bridge_name='br-int',has_traffic_filtering=True,id=f3d1103d-bcfc-4db6-b227-e1448c56f689,network=Network(99b3e8be-7102-4b9a-aeae-3151b634d431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3d1103d-bc') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3d1103d-bc, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=048d44d8-1738-44a9-971c-02d7e5b57128) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:54:37 user nova-compute[75378]: INFO os_vif [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:38:86,bridge_name='br-int',has_traffic_filtering=True,id=f3d1103d-bcfc-4db6-b227-e1448c56f689,network=Network(99b3e8be-7102-4b9a-aeae-3151b634d431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3d1103d-bc')
Nov 09 03:54:37 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Deleting instance files /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678_del
Nov 09 03:54:37 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Deletion of /opt/stack/data/nova/instances/2abe50f8-3c9b-417e-889f-1d565089d678_del complete
Nov 09 03:54:37 user nova-compute[75378]: INFO nova.compute.manager [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 09 03:54:37 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG nova.compute.manager [req-303de5e1-cc57-4b02-b7a3-241ba1023709 req-70d53b02-fa0d-4789-849a-edd34cc7577b service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received event network-vif-unplugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-303de5e1-cc57-4b02-b7a3-241ba1023709 req-70d53b02-fa0d-4789-849a-edd34cc7577b service nova] Acquiring lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-303de5e1-cc57-4b02-b7a3-241ba1023709 req-70d53b02-fa0d-4789-849a-edd34cc7577b service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-303de5e1-cc57-4b02-b7a3-241ba1023709 req-70d53b02-fa0d-4789-849a-edd34cc7577b service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG nova.compute.manager [req-303de5e1-cc57-4b02-b7a3-241ba1023709 req-70d53b02-fa0d-4789-849a-edd34cc7577b service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] No waiting events found dispatching network-vif-unplugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG nova.compute.manager [req-303de5e1-cc57-4b02-b7a3-241ba1023709 req-70d53b02-fa0d-4789-849a-edd34cc7577b service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received event network-vif-unplugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG nova.compute.manager [req-303de5e1-cc57-4b02-b7a3-241ba1023709 req-70d53b02-fa0d-4789-849a-edd34cc7577b service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received event network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-303de5e1-cc57-4b02-b7a3-241ba1023709 req-70d53b02-fa0d-4789-849a-edd34cc7577b service nova] Acquiring lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-303de5e1-cc57-4b02-b7a3-241ba1023709 req-70d53b02-fa0d-4789-849a-edd34cc7577b service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-303de5e1-cc57-4b02-b7a3-241ba1023709 req-70d53b02-fa0d-4789-849a-edd34cc7577b service nova] Lock "2abe50f8-3c9b-417e-889f-1d565089d678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG nova.compute.manager [req-303de5e1-cc57-4b02-b7a3-241ba1023709 req-70d53b02-fa0d-4789-849a-edd34cc7577b service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] No waiting events found dispatching network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:54:37 user nova-compute[75378]: WARNING nova.compute.manager [req-303de5e1-cc57-4b02-b7a3-241ba1023709 req-70d53b02-fa0d-4789-849a-edd34cc7577b service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received unexpected event network-vif-plugged-f3d1103d-bcfc-4db6-b227-e1448c56f689 for instance with vm_state active and task_state deleting.
Nov 09 03:54:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:38 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:54:38 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Took 0.70 seconds to deallocate network for instance.
Nov 09 03:54:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:54:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:54:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:54:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:38 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:54:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:38 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:54:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:54:38 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Deleted allocations for instance 2abe50f8-3c9b-417e-889f-1d565089d678
Nov 09 03:54:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1b73b26a-aa40-46d3-810e-0b1e370c19ec tempest-ServerStableDeviceRescueTest-1146989307 tempest-ServerStableDeviceRescueTest-1146989307-project-member] Lock "2abe50f8-3c9b-417e-889f-1d565089d678" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.264s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:54:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:39 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Error from libvirt while getting description of instance-00000018: [Error Code 42] Domain not found: no domain with matching uuid '2abe50f8-3c9b-417e-889f-1d565089d678' (instance-00000018): libvirt.libvirtError: Domain not found: no domain with matching uuid '2abe50f8-3c9b-417e-889f-1d565089d678' (instance-00000018)
Nov 09 03:54:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:54:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:39 user nova-compute[75378]: DEBUG nova.compute.manager [req-7f508eb4-86c5-48e8-a8e2-492046b860dc req-fbb5e82e-5a5d-4963-82fd-d74157dc4973 service nova] [instance: 2abe50f8-3c9b-417e-889f-1d565089d678] Received event network-vif-deleted-f3d1103d-bcfc-4db6-b227-e1448c56f689 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:54:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:54:41 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:54:41 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:54:41 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7598MB free_disk=25.078548431396484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:54:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:54:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:54:41 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7d051405-6b57-4db2-9533-c2f4e87134d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:54:41 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2c2acb48-972a-41d7-987e-48e79b3bef93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:54:41 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 013db901-fbee-4593-a14f-95a03e79fad0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:54:41 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance ed92e04a-56ec-42f1-bed3-8b28a37d1475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:54:41 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:54:41 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 11f18164-9676-4a8a-91be-8bd87673ec5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:54:41 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 66c0d842-75e7-4506-97a0-35048f5b445e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:54:41 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c63e2993-88fd-447b-82b7-e1d2fcd8d7da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:54:41 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance dad51975-3054-4265-866e-63b1fa778472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:54:41 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:54:41 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:54:41 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:54:41 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:54:41 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:54:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRQAVfea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:54:42 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:54:42 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:54:42 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3aaab01-4a4f-4e37-99b8-e2a736d2223e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:54:42 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[533fd586-947f-4582-84d9-746c825ba1a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e] added
Nov 09 03:54:42 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3364b1-4dbd-4016-b6b3-322c84122a7e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26a0e42-711a-4d27-b15b-dd782285cf24]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SRQAVfea {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SRQAVfea" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efe156d-598d-4656-9cfc-20d4c8a8abf3]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SRQAVfea'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4d7d9d-c458-4ad9-8dd0-d8bb52eac0ea]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[972a4ea7-a740-497b-bc9e-9223556d6345]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:54:42 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:54:42 user nova-compute[75378]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 (non-flash)
Nov 09 03:54:42 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:54:42 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:54:42 user nova-compute[75378]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 (non-flash)
Nov 09 03:54:42 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[26feefcb-affe-4354-96c2-77c224aa18b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e, portal: 172.16.0.220,3260]
Nov 09 03:54:42 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e, portal: 172.16.0.220,3260] successful.
Nov 09 03:54:42 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b874f7ca-b798-483b-9707-ca3a9acd0691]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1ad464-6772-4cbe-8d44-947d901d6d27]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:54:42 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:54:42 user nova-compute[75378]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 (non-flash)
Nov 09 03:54:42 user nova-compute[75378]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e (non-flash)
Nov 09 03:54:42 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:54:42 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:54:42 user nova-compute[75378]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 (non-flash)
Nov 09 03:54:42 user nova-compute[75378]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e (non-flash)
Nov 09 03:54:42 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1faefda4-e4e1-40b8-9e9f-a42a0791f726]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:54:42 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: None {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:54:43 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:54:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRQAVfea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:54:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:54:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23961396336373666', 'path': '/dev/sde'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:54:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961396336373666', 'path': '/dev/sde'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:54:43 user nova-compute[75378]: DEBUG nova.objects.instance [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lazy-loading 'flavor' on Instance uuid 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:54:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 03:54:43 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:54:43 user nova-compute[75378]:   <source dev="/dev/sde"/>
Nov 09 03:54:43 user nova-compute[75378]:   <target dev="vdc" bus="virtio"/>
Nov 09 03:54:43 user nova-compute[75378]:   <serial>f89dbc80-5170-4ff7-863b-365e6584386e</serial>
Nov 09 03:54:43 user nova-compute[75378]: </disk>
Nov 09 03:54:43 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 03:54:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:54:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:54:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:54:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] No VIF found with MAC fa:16:3e:40:9f:77, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:54:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c9aa1f09-921a-4815-9fcf-3e9c2011918e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.818s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:54:44 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:54:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:54:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:54:44 user nova-compute[75378]: INFO nova.compute.manager [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Detaching volume 17561744-dd99-4fce-aabe-7411fbc1eb80
Nov 09 03:54:44 user nova-compute[75378]: INFO nova.virt.block_device [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Attempting to driver detach volume 17561744-dd99-4fce-aabe-7411fbc1eb80 from mountpoint /dev/vdb
Nov 09 03:54:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Attempting to detach device vdb from instance 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 03:54:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:54:44 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:54:44 user nova-compute[75378]:   <source dev="/dev/sdd"/>
Nov 09 03:54:44 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:54:44 user nova-compute[75378]:   <serial>17561744-dd99-4fce-aabe-7411fbc1eb80</serial>
Nov 09 03:54:44 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 03:54:44 user nova-compute[75378]: </disk>
Nov 09 03:54:44 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:54:44 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Successfully detached device vdb from instance 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 from the persistent domain config.
Nov 09 03:54:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 03:54:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:54:44 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:54:44 user nova-compute[75378]:   <source dev="/dev/sdd"/>
Nov 09 03:54:44 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:54:44 user nova-compute[75378]:   <serial>17561744-dd99-4fce-aabe-7411fbc1eb80</serial>
Nov 09 03:54:44 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 03:54:44 user nova-compute[75378]: </disk>
Nov 09 03:54:44 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:54:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 03:54:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:54:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:54:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:54:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:54:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:54:47 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:54:47 user nova-compute[75378]: INFO nova.compute.claims [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Claim successful on node user
Nov 09 03:54:47 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:54:47 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:54:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:54:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:54:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:54:47 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:54:47 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:54:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:54:47 user nova-compute[75378]: DEBUG nova.policy [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57efcfeacd7f4daf916e7dd04e11d8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2176531ffa4cf7bec818309e39ab8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:54:47 user nova-compute[75378]: INFO nova.virt.block_device [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Booting with volume-backed-image c162665b-54ae-441d-9cd1-28ea81cc5de8 at /dev/vda
Nov 09 03:54:48 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Successfully created port: 04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:54:49 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Successfully updated port: 04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:54:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "refresh_cache-9a841180-ac54-4c2a-9e82-4affb78d3fc9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:54:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquired lock "refresh_cache-9a841180-ac54-4c2a-9e82-4affb78d3fc9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:54:49 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:54:49 user nova-compute[75378]: DEBUG nova.compute.manager [req-d33d1ef9-b514-4db0-b0f7-5023ce25d0ed req-22a8547b-bf3e-4378-b1de-87ef0ef00ce8 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received event network-changed-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:54:49 user nova-compute[75378]: DEBUG nova.compute.manager [req-d33d1ef9-b514-4db0-b0f7-5023ce25d0ed req-22a8547b-bf3e-4378-b1de-87ef0ef00ce8 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Refreshing instance network info cache due to event network-changed-04953f29-39ff-47d1-ba38-55faaa6369ce. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:54:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d33d1ef9-b514-4db0-b0f7-5023ce25d0ed req-22a8547b-bf3e-4378-b1de-87ef0ef00ce8 service nova] Acquiring lock "refresh_cache-9a841180-ac54-4c2a-9e82-4affb78d3fc9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:54:49 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:54:49 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Updating instance_info_cache with network_info: [{"id": "04953f29-39ff-47d1-ba38-55faaa6369ce", "address": "fa:16:3e:7b:a8:05", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04953f29-39", "ovs_interfaceid": "04953f29-39ff-47d1-ba38-55faaa6369ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:54:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Releasing lock "refresh_cache-9a841180-ac54-4c2a-9e82-4affb78d3fc9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:54:49 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Instance network_info: |[{"id": "04953f29-39ff-47d1-ba38-55faaa6369ce", "address": "fa:16:3e:7b:a8:05", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04953f29-39", "ovs_interfaceid": "04953f29-39ff-47d1-ba38-55faaa6369ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:54:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d33d1ef9-b514-4db0-b0f7-5023ce25d0ed req-22a8547b-bf3e-4378-b1de-87ef0ef00ce8 service nova] Acquired lock "refresh_cache-9a841180-ac54-4c2a-9e82-4affb78d3fc9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:54:49 user nova-compute[75378]: DEBUG nova.network.neutron [req-d33d1ef9-b514-4db0-b0f7-5023ce25d0ed req-22a8547b-bf3e-4378-b1de-87ef0ef00ce8 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Refreshing network info cache for port 04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:54:49 user nova-compute[75378]: DEBUG nova.network.neutron [req-d33d1ef9-b514-4db0-b0f7-5023ce25d0ed req-22a8547b-bf3e-4378-b1de-87ef0ef00ce8 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Updated VIF entry in instance network info cache for port 04953f29-39ff-47d1-ba38-55faaa6369ce. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:54:49 user nova-compute[75378]: DEBUG nova.network.neutron [req-d33d1ef9-b514-4db0-b0f7-5023ce25d0ed req-22a8547b-bf3e-4378-b1de-87ef0ef00ce8 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Updating instance_info_cache with network_info: [{"id": "04953f29-39ff-47d1-ba38-55faaa6369ce", "address": "fa:16:3e:7b:a8:05", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04953f29-39", "ovs_interfaceid": "04953f29-39ff-47d1-ba38-55faaa6369ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:54:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d33d1ef9-b514-4db0-b0f7-5023ce25d0ed req-22a8547b-bf3e-4378-b1de-87ef0ef00ce8 service nova] Releasing lock "refresh_cache-9a841180-ac54-4c2a-9e82-4affb78d3fc9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:54:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:52 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:54:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:54:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Acquiring lock "66c0d842-75e7-4506-97a0-35048f5b445e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "66c0d842-75e7-4506-97a0-35048f5b445e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Acquiring lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:05 user nova-compute[75378]: INFO nova.compute.manager [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Terminating instance
Nov 09 03:55:05 user nova-compute[75378]: DEBUG nova.compute.manager [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:05 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 is timed out.
Nov 09 03:55:05 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Successfully detached device vdb from instance 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 from the live domain config.
Nov 09 03:55:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBJuMoVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:55:05 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:55:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[487a57d4-0148-468e-bf3b-75d712ecf06b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:55:05 user nova-compute[75378]: No targets found.
Nov 09 03:55:05 user nova-compute[75378]: iSNS:
Nov 09 03:55:05 user nova-compute[75378]: No targets found.
Nov 09 03:55:05 user nova-compute[75378]: STATIC:
Nov 09 03:55:05 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8
Nov 09 03:55:05 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:55:05 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:55:05 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 03:55:05 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:55:05 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:55:05 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e
Nov 09 03:55:05 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:55:05 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:55:05 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80
Nov 09 03:55:05 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:55:05 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:55:05 user nova-compute[75378]: FIRMWARE:
Nov 09 03:55:05 user nova-compute[75378]: No targets found.
Nov 09 03:55:05 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:55:05 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:55:05 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[660f52b4-5156-4b41-a5ee-6e50e3448dc3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e00290-e0b7-4fd7-812b-9e4e7c939c48]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:55:05 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:55:05 user nova-compute[75378]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 (non-flash)
Nov 09 03:55:05 user nova-compute[75378]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e (non-flash)
Nov 09 03:55:05 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:55:05 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:55:05 user nova-compute[75378]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 (non-flash)
Nov 09 03:55:05 user nova-compute[75378]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e (non-flash)
Nov 09 03:55:05 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c766e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80'): ({'sdd'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Removing single pathed devices sdd {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22cb8cb-70ad-4bc4-b810-66b67bc70f08]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c772a1a7-99f9-4b69-8253-df83272d0854]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Flushing IO for device /dev/sdd {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b7b55b-101b-4775-a78a-6ba8e158eba6]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG nova.compute.manager [req-149c7e80-0585-4878-b49e-8d08da566c02 req-e0449f64-f863-444f-89f8-67ab819096b2 service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Received event network-vif-unplugged-9d5eb777-bc52-4053-8ff1-e47215b83682 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-149c7e80-0585-4878-b49e-8d08da566c02 req-e0449f64-f863-444f-89f8-67ab819096b2 service nova] Acquiring lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-149c7e80-0585-4878-b49e-8d08da566c02 req-e0449f64-f863-444f-89f8-67ab819096b2 service nova] Lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-149c7e80-0585-4878-b49e-8d08da566c02 req-e0449f64-f863-444f-89f8-67ab819096b2 service nova] Lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG nova.compute.manager [req-149c7e80-0585-4878-b49e-8d08da566c02 req-e0449f64-f863-444f-89f8-67ab819096b2 service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] No waiting events found dispatching network-vif-unplugged-9d5eb777-bc52-4053-8ff1-e47215b83682 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG nova.compute.manager [req-149c7e80-0585-4878-b49e-8d08da566c02 req-e0449f64-f863-444f-89f8-67ab819096b2 service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Received event network-vif-unplugged-9d5eb777-bc52-4053-8ff1-e47215b83682 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[691efd18-e34d-45ca-8935-d51d50668541]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] SCSI volumes sdd have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39c29c2-e5f9-48ba-bc95-de07ead2f3b7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:05 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Instance destroyed successfully.
Nov 09 03:55:05 user nova-compute[75378]: DEBUG nova.objects.instance [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lazy-loading 'resources' on Instance uuid 66c0d842-75e7-4506-97a0-35048f5b445e {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260 --logout" returned: 0 in 0.105s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0adcbba-da6f-4ccf-92c1-68a5a5f51741]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80, portal: 172.16.0.220,3260]
Nov 09 03:55:05 user nova-compute[75378]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80, portal: 172.16.0.220,3260] successful.
Nov 09 03:55:05 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-721888433',display_name='tempest-VolumesActionsTest-instance-721888433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-721888433',id=29,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:53:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b4984a96b0a47cba8fa82f19c985e50',ramdisk_id='',reservation_id='r-7446srep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-650140927',owner_user_name='tempest-VolumesActionsTest-650140927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:53:11Z,user_data=None,user_id='1681626725044d1cba836a92d5fe3827',uuid=66c0d842-75e7-4506-97a0-35048f5b445e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d5eb777-bc52-4053-8ff1-e47215b83682", "address": "fa:16:3e:87:77:b7", "network": {"id": "c24e97e2-0bda-4032-839f-897e81cb118e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1098129296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b4984a96b0a47cba8fa82f19c985e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5eb777-bc", "ovs_interfaceid": "9d5eb777-bc52-4053-8ff1-e47215b83682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Converting VIF {"id": "9d5eb777-bc52-4053-8ff1-e47215b83682", "address": "fa:16:3e:87:77:b7", "network": {"id": "c24e97e2-0bda-4032-839f-897e81cb118e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1098129296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b4984a96b0a47cba8fa82f19c985e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5eb777-bc", "ovs_interfaceid": "9d5eb777-bc52-4053-8ff1-e47215b83682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:77:b7,bridge_name='br-int',has_traffic_filtering=True,id=9d5eb777-bc52-4053-8ff1-e47215b83682,network=Network(c24e97e2-0bda-4032-839f-897e81cb118e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5eb777-bc') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG os_vif [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:77:b7,bridge_name='br-int',has_traffic_filtering=True,id=9d5eb777-bc52-4053-8ff1-e47215b83682,network=Network(c24e97e2-0bda-4032-839f-897e81cb118e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5eb777-bc') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d5eb777-bc, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17561744-dd99-4fce-aabe-7411fbc1eb80 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e20ef6a-e95a-43ea-85b6-160b46178b62]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] <== disconnect_volume: return (389ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9265fe0-d232-4021-bfa7-2ea7adb92dc0) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:55:05 user nova-compute[75378]: INFO os_vif [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:77:b7,bridge_name='br-int',has_traffic_filtering=True,id=9d5eb777-bc52-4053-8ff1-e47215b83682,network=Network(c24e97e2-0bda-4032-839f-897e81cb118e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5eb777-bc')
Nov 09 03:55:05 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Deleting instance files /opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e_del
Nov 09 03:55:05 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Deletion of /opt/stack/data/nova/instances/66c0d842-75e7-4506-97a0-35048f5b445e_del complete
Nov 09 03:55:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:05 user nova-compute[75378]: INFO nova.compute.manager [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 09 03:55:05 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:55:05 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:55:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:06 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:55:06 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Took 0.56 seconds to deallocate network for instance.
Nov 09 03:55:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-84293d96-8c2c-40d8-b288-b676212b5c46 req-d0cc7a32-746e-41be-a74a-fdc402d7e50c service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Received event network-vif-deleted-9d5eb777-bc52-4053-8ff1-e47215b83682 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:55:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:06 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:55:06 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:55:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:06 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Deleted allocations for instance 66c0d842-75e7-4506-97a0-35048f5b445e
Nov 09 03:55:06 user nova-compute[75378]: DEBUG nova.objects.instance [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lazy-loading 'flavor' on Instance uuid 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-73971105-009d-4e41-80ef-7adda00dfa8f tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.149s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-04ff998c-f185-4ff5-a40c-cb7a19684385 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "66c0d842-75e7-4506-97a0-35048f5b445e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.898s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:07 user nova-compute[75378]: INFO nova.compute.manager [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Detaching volume f89dbc80-5170-4ff7-863b-365e6584386e
Nov 09 03:55:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Received event network-vif-plugged-9d5eb777-bc52-4053-8ff1-e47215b83682 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] Acquiring lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] Lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] Lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] No waiting events found dispatching network-vif-plugged-9d5eb777-bc52-4053-8ff1-e47215b83682 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:55:07 user nova-compute[75378]: WARNING nova.compute.manager [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Received unexpected event network-vif-plugged-9d5eb777-bc52-4053-8ff1-e47215b83682 for instance with vm_state deleted and task_state None.
Nov 09 03:55:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Received event network-vif-plugged-9d5eb777-bc52-4053-8ff1-e47215b83682 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] Acquiring lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] Lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] Lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] No waiting events found dispatching network-vif-plugged-9d5eb777-bc52-4053-8ff1-e47215b83682 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:55:07 user nova-compute[75378]: WARNING nova.compute.manager [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Received unexpected event network-vif-plugged-9d5eb777-bc52-4053-8ff1-e47215b83682 for instance with vm_state deleted and task_state None.
Nov 09 03:55:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Received event network-vif-plugged-9d5eb777-bc52-4053-8ff1-e47215b83682 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] Acquiring lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] Lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] Lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] No waiting events found dispatching network-vif-plugged-9d5eb777-bc52-4053-8ff1-e47215b83682 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:55:07 user nova-compute[75378]: WARNING nova.compute.manager [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Received unexpected event network-vif-plugged-9d5eb777-bc52-4053-8ff1-e47215b83682 for instance with vm_state deleted and task_state None.
Nov 09 03:55:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Received event network-vif-plugged-9d5eb777-bc52-4053-8ff1-e47215b83682 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] Acquiring lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] Lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] Lock "66c0d842-75e7-4506-97a0-35048f5b445e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG nova.compute.manager [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] No waiting events found dispatching network-vif-plugged-9d5eb777-bc52-4053-8ff1-e47215b83682 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:55:07 user nova-compute[75378]: WARNING nova.compute.manager [req-802f0617-0491-4932-a147-b1dfced62baf req-0facde06-89e9-4832-8d69-f77e63a3a24a service nova] [instance: 66c0d842-75e7-4506-97a0-35048f5b445e] Received unexpected event network-vif-plugged-9d5eb777-bc52-4053-8ff1-e47215b83682 for instance with vm_state deleted and task_state None.
Nov 09 03:55:07 user nova-compute[75378]: INFO nova.virt.block_device [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Attempting to driver detach volume f89dbc80-5170-4ff7-863b-365e6584386e from mountpoint /dev/vdc
Nov 09 03:55:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Attempting to detach device vdc from instance 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:55:07 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:55:07 user nova-compute[75378]:   <source dev="/dev/sde"/>
Nov 09 03:55:07 user nova-compute[75378]:   <target dev="vdc" bus="virtio"/>
Nov 09 03:55:07 user nova-compute[75378]:   <serial>f89dbc80-5170-4ff7-863b-365e6584386e</serial>
Nov 09 03:55:07 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 09 03:55:07 user nova-compute[75378]: </disk>
Nov 09 03:55:07 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:55:07 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Successfully detached device vdc from instance 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 from the persistent domain config.
Nov 09 03:55:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 03:55:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:55:07 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:55:07 user nova-compute[75378]:   <source dev="/dev/sde"/>
Nov 09 03:55:07 user nova-compute[75378]:   <target dev="vdc" bus="virtio"/>
Nov 09 03:55:07 user nova-compute[75378]:   <serial>f89dbc80-5170-4ff7-863b-365e6584386e</serial>
Nov 09 03:55:07 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 09 03:55:07 user nova-compute[75378]: </disk>
Nov 09 03:55:07 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG os_brick.utils [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee8f2c7-906a-4727-93bf-1f1d3e5ac49b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca94999e-4b80-4106-91fb-27cdff8205ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[90158c4e-56fd-4e1d-a246-692b0e1d3ed0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b8bd1d-2103-4854-acfe-41cfca39af58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:55:08 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:55:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ded27a-c1bc-425e-bbb1-2339c1b1411c]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG os_brick.utils [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:55:08 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Updating existing volume attachment record: 2e185329-48c0-4d75-95a2-e4ff611294cb {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:55:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:55:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:28 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 is timed out.
Nov 09 03:55:28 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Successfully detached device vdc from instance 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 from the live domain config.
Nov 09 03:55:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SRQAVfea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:55:28 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:55:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a64e843-7c1a-4bde-96f0-ae7d25a53071]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:55:28 user nova-compute[75378]: No targets found.
Nov 09 03:55:28 user nova-compute[75378]: iSNS:
Nov 09 03:55:28 user nova-compute[75378]: No targets found.
Nov 09 03:55:28 user nova-compute[75378]: STATIC:
Nov 09 03:55:28 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8
Nov 09 03:55:28 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:55:28 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:55:28 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 03:55:28 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:55:28 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:55:28 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e
Nov 09 03:55:28 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:55:28 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:55:28 user nova-compute[75378]: FIRMWARE:
Nov 09 03:55:28 user nova-compute[75378]: No targets found.
Nov 09 03:55:28 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:55:28 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:55:28 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd95fb5d-931b-447b-b386-1d605ff7b599]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[242a0bc4-6613-4109-a9f2-65ac060fbc1d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:55:28 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:55:28 user nova-compute[75378]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e (non-flash)
Nov 09 03:55:28 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:55:28 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:55:28 user nova-compute[75378]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e (non-flash)
Nov 09 03:55:28 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3b0462b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e'): ({'sde'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Removing single pathed devices sde {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f578957a-4fb9-450f-ac23-cf555c950dc5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf2b3db-cacc-4acb-a0a9-7678d6120f4a]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Flushing IO for device /dev/sde {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d175551-7283-423d-8532-92061ab096c2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0ea5e9-29bd-480b-b14d-8c7fa8baa191]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] SCSI volumes sde have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f2abeb-9cfe-496e-9856-26981ab154b3]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[873bb723-5d09-4b17-9173-56f6dd324cf9]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e, portal: 172.16.0.220,3260]
Nov 09 03:55:28 user nova-compute[75378]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e, portal: 172.16.0.220,3260] successful.
Nov 09 03:55:28 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f89dbc80-5170-4ff7-863b-365e6584386e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[42eff192-fd5d-414e-a0b5-0a31880f7f25]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] <== disconnect_volume: return (363ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:55:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:55:29 user nova-compute[75378]: DEBUG nova.objects.instance [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lazy-loading 'flavor' on Instance uuid 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:55:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-be17f74f-3991-4b0e-9214-b12820b9d52c tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:30 user nova-compute[75378]: INFO nova.compute.manager [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Terminating instance
Nov 09 03:55:30 user nova-compute[75378]: DEBUG nova.compute.manager [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:55:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG nova.compute.manager [req-c4c02a90-94be-4998-8761-ab7f6cebd60f req-7d71d54f-322a-4022-98d3-b62db52332fa service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Received event network-vif-unplugged-62cd3fe2-71e3-478e-ad29-819df0de80f9 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c4c02a90-94be-4998-8761-ab7f6cebd60f req-7d71d54f-322a-4022-98d3-b62db52332fa service nova] Acquiring lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c4c02a90-94be-4998-8761-ab7f6cebd60f req-7d71d54f-322a-4022-98d3-b62db52332fa service nova] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c4c02a90-94be-4998-8761-ab7f6cebd60f req-7d71d54f-322a-4022-98d3-b62db52332fa service nova] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG nova.compute.manager [req-c4c02a90-94be-4998-8761-ab7f6cebd60f req-7d71d54f-322a-4022-98d3-b62db52332fa service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] No waiting events found dispatching network-vif-unplugged-62cd3fe2-71e3-478e-ad29-819df0de80f9 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG nova.compute.manager [req-c4c02a90-94be-4998-8761-ab7f6cebd60f req-7d71d54f-322a-4022-98d3-b62db52332fa service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Received event network-vif-unplugged-62cd3fe2-71e3-478e-ad29-819df0de80f9 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:31 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Instance destroyed successfully.
Nov 09 03:55:31 user nova-compute[75378]: DEBUG nova.objects.instance [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lazy-loading 'resources' on Instance uuid 2d21fbf8-55f3-4acf-8be2-e19a04c0f295 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:51:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-443912707',display_name='tempest-AttachVolumeTestJSON-server-443912707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-443912707',id=27,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJi4rJ66uDbl8M6kWEU4dwLt1DoX5K5psifNCTqjOMZuu30qL8ZqQQ5ssFjfaj0KauTZE4cskQso16o6rC6UgJzDACM04knR1T9gBcbjcvj3T+5NlahW7S81EIsSSd7zA==',key_name='tempest-keypair-216498992',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:51:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d0151a0736b41f498b591b4d3e1a052',ramdisk_id='',reservation_id='r-u9ksv5kp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-93032782',owner_user_name='tempest-AttachVolumeTestJSON-93032782-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:51:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b101389f26a84404b72cfc088ec03869',uuid=2d21fbf8-55f3-4acf-8be2-e19a04c0f295,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "address": "fa:16:3e:40:9f:77", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cd3fe2-71", "ovs_interfaceid": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Converting VIF {"id": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "address": "fa:16:3e:40:9f:77", "network": {"id": "b40bde43-b1d2-4eb4-938c-55c626640880", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181357167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d0151a0736b41f498b591b4d3e1a052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62cd3fe2-71", "ovs_interfaceid": "62cd3fe2-71e3-478e-ad29-819df0de80f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:9f:77,bridge_name='br-int',has_traffic_filtering=True,id=62cd3fe2-71e3-478e-ad29-819df0de80f9,network=Network(b40bde43-b1d2-4eb4-938c-55c626640880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cd3fe2-71') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG os_vif [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:9f:77,bridge_name='br-int',has_traffic_filtering=True,id=62cd3fe2-71e3-478e-ad29-819df0de80f9,network=Network(b40bde43-b1d2-4eb4-938c-55c626640880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cd3fe2-71') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62cd3fe2-71, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db12cadc-953e-4fc1-9fe2-5c533dfd9390) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:31 user nova-compute[75378]: INFO os_vif [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:9f:77,bridge_name='br-int',has_traffic_filtering=True,id=62cd3fe2-71e3-478e-ad29-819df0de80f9,network=Network(b40bde43-b1d2-4eb4-938c-55c626640880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62cd3fe2-71')
Nov 09 03:55:31 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Deleting instance files /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295_del
Nov 09 03:55:31 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Deletion of /opt/stack/data/nova/instances/2d21fbf8-55f3-4acf-8be2-e19a04c0f295_del complete
Nov 09 03:55:31 user nova-compute[75378]: INFO nova.compute.manager [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 09 03:55:31 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:55:31 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:55:32 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:55:32 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Took 0.76 seconds to deallocate network for instance.
Nov 09 03:55:32 user nova-compute[75378]: DEBUG nova.compute.manager [req-1b093760-03ff-43fc-a81b-d10a1074b22e req-83b58a1a-cfde-4fdd-9582-8fe360aff7f7 service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Received event network-vif-deleted-62cd3fe2-71e3-478e-ad29-819df0de80f9 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:55:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:32 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:55:32 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:55:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:32 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Deleted allocations for instance 2d21fbf8-55f3-4acf-8be2-e19a04c0f295
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bb892ee9-fe71-4bbd-8ee4-536f6d315a0e tempest-AttachVolumeTestJSON-93032782 tempest-AttachVolumeTestJSON-93032782-project-member] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.169s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Didn't find any instances for network info cache update. {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.compute.manager [req-9a5a0659-c1ed-4ff7-8c40-f2dc18f53fe6 req-feb9a8e7-231f-4892-a3cb-22ef6a3a82e1 service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Received event network-vif-plugged-62cd3fe2-71e3-478e-ad29-819df0de80f9 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9a5a0659-c1ed-4ff7-8c40-f2dc18f53fe6 req-feb9a8e7-231f-4892-a3cb-22ef6a3a82e1 service nova] Acquiring lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9a5a0659-c1ed-4ff7-8c40-f2dc18f53fe6 req-feb9a8e7-231f-4892-a3cb-22ef6a3a82e1 service nova] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9a5a0659-c1ed-4ff7-8c40-f2dc18f53fe6 req-feb9a8e7-231f-4892-a3cb-22ef6a3a82e1 service nova] Lock "2d21fbf8-55f3-4acf-8be2-e19a04c0f295-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.compute.manager [req-9a5a0659-c1ed-4ff7-8c40-f2dc18f53fe6 req-feb9a8e7-231f-4892-a3cb-22ef6a3a82e1 service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] No waiting events found dispatching network-vif-plugged-62cd3fe2-71e3-478e-ad29-819df0de80f9 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:55:33 user nova-compute[75378]: WARNING nova.compute.manager [req-9a5a0659-c1ed-4ff7-8c40-f2dc18f53fe6 req-feb9a8e7-231f-4892-a3cb-22ef6a3a82e1 service nova] [instance: 2d21fbf8-55f3-4acf-8be2-e19a04c0f295] Received unexpected event network-vif-plugged-62cd3fe2-71e3-478e-ad29-819df0de80f9 for instance with vm_state deleted and task_state None.
Nov 09 03:55:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:55:33 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Creating image(s)
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Did not create local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Ensure instance console log exists: /opt/stack/data/nova/instances/9a841180-ac54-4c2a-9e82-4affb78d3fc9/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Start _get_guest_xml network_info=[{"id": "04953f29-39ff-47d1-ba38-55faaa6369ce", "address": "fa:16:3e:7b:a8:05", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04953f29-39", "ovs_interfaceid": "04953f29-39ff-47d1-ba38-55faaa6369ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQFhmJSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9a841180-ac54-4c2a-9e82-4affb78d3fc9', 'attached_at': '', 'detached_at': '', 'volume_id': '1afb52f3-a9af-40ce-9187-72f736022522', 'serial': '1afb52f3-a9af-40ce-9187-72f736022522'}, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': '2e185329-48c0-4d75-95a2-e4ff611294cb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:55:33 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:55:33 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQFhmJSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:55:33 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:55:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:55:33 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:55:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:55:33 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5eaf10-eb56-4861-9023-cd96dda94e96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:55:33 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a925ff-7a28-42c6-ad6a-398aa4bac9c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522] added
Nov 09 03:55:33 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a279b4-0a3e-405f-9fcb-380e3f6e0409]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d69a5d0-c595-44b0-b872-01287b8d32ab]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQFhmJSy {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQFhmJSy" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b149721-e437-4646-b0e7-23fd706ee52e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dQFhmJSy'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:55:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf18a85c-9f0b-4143-867f-1c57b49a316f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ba65e0-87a2-4f74-b87d-4aaed0552d14]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:55:34 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:55:34 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:55:34 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:55:34 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f669ab-60a4-4775-b4c4-3033eb1e0055]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522, portal: 172.16.0.220,3260]
Nov 09 03:55:34 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522, portal: 172.16.0.220,3260] successful.
Nov 09 03:55:34 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58e8cd2-22fb-494d-aced-ec4a717f7459]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a944572-e56f-44d0-9880-2497781c6504]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:55:34 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:55:34 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:55:34 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:55:34 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:55:34 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:55:34 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.447s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4621d8d-a8cc-4257-8e19-0c62c21b6b74]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:34 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: None {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG nova.compute.manager [req-7fa47e8a-3e8c-4504-8c10-8d7ba90dc4b3 req-4db7edef-875d-4a8d-998b-3011d6ebdd0c service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Received event network-changed-02b1dc3d-7065-4313-898c-0cf171da746a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG nova.compute.manager [req-7fa47e8a-3e8c-4504-8c10-8d7ba90dc4b3 req-4db7edef-875d-4a8d-998b-3011d6ebdd0c service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Refreshing instance network info cache due to event network-changed-02b1dc3d-7065-4313-898c-0cf171da746a. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7fa47e8a-3e8c-4504-8c10-8d7ba90dc4b3 req-4db7edef-875d-4a8d-998b-3011d6ebdd0c service nova] Acquiring lock "refresh_cache-c63e2993-88fd-447b-82b7-e1d2fcd8d7da" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7fa47e8a-3e8c-4504-8c10-8d7ba90dc4b3 req-4db7edef-875d-4a8d-998b-3011d6ebdd0c service nova] Acquired lock "refresh_cache-c63e2993-88fd-447b-82b7-e1d2fcd8d7da" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG nova.network.neutron [req-7fa47e8a-3e8c-4504-8c10-8d7ba90dc4b3 req-4db7edef-875d-4a8d-998b-3011d6ebdd0c service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Refreshing network info cache for port 02b1dc3d-7065-4313-898c-0cf171da746a {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQFhmJSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.484s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] <== connect_volume: return (1485ms) {'type': 'block', 'scsi_wwn': '26637666139393537', 'path': '/dev/sdd'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637666139393537', 'path': '/dev/sdd'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:54:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2019851881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2019851881',id=32,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c2176531ffa4cf7bec818309e39ab8d',ramdisk_id='',reservation_id='r-6tm4rcnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:54:48Z,user_data=None,user_id='57efcfeacd7f4daf916e7dd04e11d8f2',uuid=9a841180-ac54-4c2a-9e82-4affb78d3fc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04953f29-39ff-47d1-ba38-55faaa6369ce", "address": "fa:16:3e:7b:a8:05", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04953f29-39", "ovs_interfaceid": "04953f29-39ff-47d1-ba38-55faaa6369ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converting VIF {"id": "04953f29-39ff-47d1-ba38-55faaa6369ce", "address": "fa:16:3e:7b:a8:05", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04953f29-39", "ovs_interfaceid": "04953f29-39ff-47d1-ba38-55faaa6369ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:a8:05,bridge_name='br-int',has_traffic_filtering=True,id=04953f29-39ff-47d1-ba38-55faaa6369ce,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04953f29-39') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG nova.objects.instance [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a841180-ac54-4c2a-9e82-4affb78d3fc9 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG nova.objects.instance [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lazy-loading 'flavor' on Instance uuid c63e2993-88fd-447b-82b7-e1d2fcd8d7da {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:55:35 user nova-compute[75378]:   <uuid>9a841180-ac54-4c2a-9e82-4affb78d3fc9</uuid>
Nov 09 03:55:35 user nova-compute[75378]:   <name>instance-00000020</name>
Nov 09 03:55:35 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:55:35 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:55:35 user nova-compute[75378]:   <metadata>
Nov 09 03:55:35 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:55:35 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:55:35 user nova-compute[75378]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2019851881</nova:name>
Nov 09 03:55:35 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:55:33</nova:creationTime>
Nov 09 03:55:35 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:55:35 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:55:35 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:55:35 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:55:35 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:55:35 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:55:35 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:55:35 user nova-compute[75378]:       <nova:owner>
Nov 09 03:55:35 user nova-compute[75378]:         <nova:user uuid="57efcfeacd7f4daf916e7dd04e11d8f2">tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member</nova:user>
Nov 09 03:55:35 user nova-compute[75378]:         <nova:project uuid="4c2176531ffa4cf7bec818309e39ab8d">tempest-ServerBootFromVolumeStableRescueTest-1679422577</nova:project>
Nov 09 03:55:35 user nova-compute[75378]:       </nova:owner>
Nov 09 03:55:35 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:55:35 user nova-compute[75378]:       <nova:ports>
Nov 09 03:55:35 user nova-compute[75378]:         <nova:port uuid="04953f29-39ff-47d1-ba38-55faaa6369ce">
Nov 09 03:55:35 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 03:55:35 user nova-compute[75378]:         </nova:port>
Nov 09 03:55:35 user nova-compute[75378]:       </nova:ports>
Nov 09 03:55:35 user nova-compute[75378]:     </nova:instance>
Nov 09 03:55:35 user nova-compute[75378]:   </metadata>
Nov 09 03:55:35 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:55:35 user nova-compute[75378]:     <system>
Nov 09 03:55:35 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:55:35 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:55:35 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:55:35 user nova-compute[75378]:       <entry name="serial">9a841180-ac54-4c2a-9e82-4affb78d3fc9</entry>
Nov 09 03:55:35 user nova-compute[75378]:       <entry name="uuid">9a841180-ac54-4c2a-9e82-4affb78d3fc9</entry>
Nov 09 03:55:35 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:55:35 user nova-compute[75378]:     </system>
Nov 09 03:55:35 user nova-compute[75378]:   </sysinfo>
Nov 09 03:55:35 user nova-compute[75378]:   <os>
Nov 09 03:55:35 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:55:35 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:55:35 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:55:35 user nova-compute[75378]:   </os>
Nov 09 03:55:35 user nova-compute[75378]:   <features>
Nov 09 03:55:35 user nova-compute[75378]:     <acpi/>
Nov 09 03:55:35 user nova-compute[75378]:     <apic/>
Nov 09 03:55:35 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:55:35 user nova-compute[75378]:   </features>
Nov 09 03:55:35 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:55:35 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:55:35 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:55:35 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:55:35 user nova-compute[75378]:   </clock>
Nov 09 03:55:35 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:55:35 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:55:35 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:55:35 user nova-compute[75378]:   </cpu>
Nov 09 03:55:35 user nova-compute[75378]:   <devices>
Nov 09 03:55:35 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 03:55:35 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:55:35 user nova-compute[75378]:       <source dev="/dev/sdd"/>
Nov 09 03:55:35 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:55:35 user nova-compute[75378]:       <serial>1afb52f3-a9af-40ce-9187-72f736022522</serial>
Nov 09 03:55:35 user nova-compute[75378]:     </disk>
Nov 09 03:55:35 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:55:35 user nova-compute[75378]:       <mac address="fa:16:3e:7b:a8:05"/>
Nov 09 03:55:35 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:55:35 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:55:35 user nova-compute[75378]:       <target dev="tap04953f29-39"/>
Nov 09 03:55:35 user nova-compute[75378]:     </interface>
Nov 09 03:55:35 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:55:35 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/9a841180-ac54-4c2a-9e82-4affb78d3fc9/console.log" append="off"/>
Nov 09 03:55:35 user nova-compute[75378]:     </serial>
Nov 09 03:55:35 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:55:35 user nova-compute[75378]:     <video>
Nov 09 03:55:35 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:55:35 user nova-compute[75378]:     </video>
Nov 09 03:55:35 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:55:35 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:55:35 user nova-compute[75378]:     </rng>
Nov 09 03:55:35 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:55:35 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:55:35 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:55:35 user nova-compute[75378]:     </memballoon>
Nov 09 03:55:35 user nova-compute[75378]:   </devices>
Nov 09 03:55:35 user nova-compute[75378]: </domain>
Nov 09 03:55:35 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:54:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2019851881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2019851881',id=32,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c2176531ffa4cf7bec818309e39ab8d',ramdisk_id='',reservation_id='r-6tm4rcnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:54:48Z,user_data=None,user_id='57efcfeacd7f4daf916e7dd04e11d8f2',uuid=9a841180-ac54-4c2a-9e82-4affb78d3fc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04953f29-39ff-47d1-ba38-55faaa6369ce", "address": "fa:16:3e:7b:a8:05", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04953f29-39", "ovs_interfaceid": "04953f29-39ff-47d1-ba38-55faaa6369ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converting VIF {"id": "04953f29-39ff-47d1-ba38-55faaa6369ce", "address": "fa:16:3e:7b:a8:05", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04953f29-39", "ovs_interfaceid": "04953f29-39ff-47d1-ba38-55faaa6369ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:a8:05,bridge_name='br-int',has_traffic_filtering=True,id=04953f29-39ff-47d1-ba38-55faaa6369ce,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04953f29-39') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG os_vif [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:a8:05,bridge_name='br-int',has_traffic_filtering=True,id=04953f29-39ff-47d1-ba38-55faaa6369ce,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04953f29-39') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a3dceda0-80f6-5c92-ad08-7b86a9be5054', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:35 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Ignoring supplied device name: /dev/vdb
Nov 09 03:55:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04953f29-39, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04953f29-39, col_values=(('qos', UUID('f46d3ec7-d738-4b8f-9e98-bd3438b289bb')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04953f29-39, col_values=(('external_ids', {'iface-id': '04953f29-39ff-47d1-ba38-55faaa6369ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:a8:05', 'vm-uuid': '9a841180-ac54-4c2a-9e82-4affb78d3fc9'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:35 user nova-compute[75378]: INFO os_vif [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:a8:05,bridge_name='br-int',has_traffic_filtering=True,id=04953f29-39ff-47d1-ba38-55faaa6369ce,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04953f29-39')
Nov 09 03:55:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] No VIF found with MAC fa:16:3e:7b:a8:05, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:35 user nova-compute[75378]: INFO nova.compute.manager [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Attaching volume f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 to /dev/vdb
Nov 09 03:55:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG os_brick.utils [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6576c7-2cb3-4cb0-b9f7-51d05827524a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[69df04e2-1235-4fab-8e38-414367328d15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e40f7f-9b64-4321-8dd3-c8309c18fd9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae92731f-d820-48eb-bd8d-1f36671f01ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG nova.network.neutron [req-7fa47e8a-3e8c-4504-8c10-8d7ba90dc4b3 req-4db7edef-875d-4a8d-998b-3011d6ebdd0c service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Updated VIF entry in instance network info cache for port 02b1dc3d-7065-4313-898c-0cf171da746a. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG nova.network.neutron [req-7fa47e8a-3e8c-4504-8c10-8d7ba90dc4b3 req-4db7edef-875d-4a8d-998b-3011d6ebdd0c service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Updating instance_info_cache with network_info: [{"id": "02b1dc3d-7065-4313-898c-0cf171da746a", "address": "fa:16:3e:e1:1d:ed", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b1dc3d-70", "ovs_interfaceid": "02b1dc3d-7065-4313-898c-0cf171da746a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7fa47e8a-3e8c-4504-8c10-8d7ba90dc4b3 req-4db7edef-875d-4a8d-998b-3011d6ebdd0c service nova] Releasing lock "refresh_cache-c63e2993-88fd-447b-82b7-e1d2fcd8d7da" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:55:35 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:55:35 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c11e310-f9e6-4f1d-8957-987f749f29c3]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG os_brick.utils [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:55:35 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Updating existing volume attachment record: 3c3973d9-c0cf-40f9-b29d-bc320af56a86 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:55:36 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:55:36 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:55:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:37 user nova-compute[75378]: DEBUG nova.compute.manager [req-21ada94f-a4b3-4c39-baee-fe1e95996fdf req-0277f301-48c2-465a-8a8d-c3a0a4aef1b7 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received event network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:55:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-21ada94f-a4b3-4c39-baee-fe1e95996fdf req-0277f301-48c2-465a-8a8d-c3a0a4aef1b7 service nova] Acquiring lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-21ada94f-a4b3-4c39-baee-fe1e95996fdf req-0277f301-48c2-465a-8a8d-c3a0a4aef1b7 service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-21ada94f-a4b3-4c39-baee-fe1e95996fdf req-0277f301-48c2-465a-8a8d-c3a0a4aef1b7 service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:37 user nova-compute[75378]: DEBUG nova.compute.manager [req-21ada94f-a4b3-4c39-baee-fe1e95996fdf req-0277f301-48c2-465a-8a8d-c3a0a4aef1b7 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] No waiting events found dispatching network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:55:37 user nova-compute[75378]: WARNING nova.compute.manager [req-21ada94f-a4b3-4c39-baee-fe1e95996fdf req-0277f301-48c2-465a-8a8d-c3a0a4aef1b7 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received unexpected event network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce for instance with vm_state building and task_state spawning.
Nov 09 03:55:37 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:55:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:38 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:55:38 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:55:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:38 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:55:39 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Instance spawned successfully.
Nov 09 03:55:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG nova.compute.manager [req-bb2e6c80-eda5-4e54-87af-6d72e55eae33 req-7bba0292-eea7-4c95-9788-b598f32d7476 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received event network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bb2e6c80-eda5-4e54-87af-6d72e55eae33 req-7bba0292-eea7-4c95-9788-b598f32d7476 service nova] Acquiring lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bb2e6c80-eda5-4e54-87af-6d72e55eae33 req-7bba0292-eea7-4c95-9788-b598f32d7476 service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bb2e6c80-eda5-4e54-87af-6d72e55eae33 req-7bba0292-eea7-4c95-9788-b598f32d7476 service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG nova.compute.manager [req-bb2e6c80-eda5-4e54-87af-6d72e55eae33 req-7bba0292-eea7-4c95-9788-b598f32d7476 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] No waiting events found dispatching network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:55:39 user nova-compute[75378]: WARNING nova.compute.manager [req-bb2e6c80-eda5-4e54-87af-6d72e55eae33 req-7bba0292-eea7-4c95-9788-b598f32d7476 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received unexpected event network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce for instance with vm_state building and task_state spawning.
Nov 09 03:55:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:39 user nova-compute[75378]: INFO nova.compute.manager [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 09 03:55:39 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "06799031-9998-4829-8725-09526681c442" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "06799031-9998-4829-8725-09526681c442" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:39 user nova-compute[75378]: INFO nova.compute.manager [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Took 52.14 seconds to build instance.
Nov 09 03:55:39 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:55:39 user nova-compute[75378]: INFO nova.compute.claims [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Claim successful on node user
Nov 09 03:55:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8ae60a5-694f-4e45-8053-8245b2f1814e tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.241s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.573s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475/disk --force-share --output=json" returned: 0 in 0.368s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:55:40 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:55:40 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG nova.policy [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2afcdb0627e34b6e893b7981ea4615e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d990b7b4c19436d8cd8f43d8d0facb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:55:40 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Creating image(s)
Nov 09 03:55:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "/opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "/opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "/opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.252s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.206s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk 1073741824" returned: 0 in 0.072s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.190s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Cannot resize image /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Ensure instance console log exists: /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Successfully created port: 037999da-478f-48ea-8d99-2c86b18842e8 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Successfully updated port: 037999da-478f-48ea-8d99-2c86b18842e8 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:55:42 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:55:42 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:55:42 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8061MB free_disk=25.134925842285156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "refresh_cache-06799031-9998-4829-8725-09526681c442" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquired lock "refresh_cache-06799031-9998-4829-8725-09526681c442" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG nova.compute.manager [req-c0ceea1b-cb84-4da3-affd-99a171a9195d req-0608b3e2-2001-4fb5-9b0c-8c767c376489 service nova] [instance: 06799031-9998-4829-8725-09526681c442] Received event network-changed-037999da-478f-48ea-8d99-2c86b18842e8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG nova.compute.manager [req-c0ceea1b-cb84-4da3-affd-99a171a9195d req-0608b3e2-2001-4fb5-9b0c-8c767c376489 service nova] [instance: 06799031-9998-4829-8725-09526681c442] Refreshing instance network info cache due to event network-changed-037999da-478f-48ea-8d99-2c86b18842e8. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c0ceea1b-cb84-4da3-affd-99a171a9195d req-0608b3e2-2001-4fb5-9b0c-8c767c376489 service nova] Acquiring lock "refresh_cache-06799031-9998-4829-8725-09526681c442" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7d051405-6b57-4db2-9533-c2f4e87134d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2c2acb48-972a-41d7-987e-48e79b3bef93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 013db901-fbee-4593-a14f-95a03e79fad0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance ed92e04a-56ec-42f1-bed3-8b28a37d1475 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 11f18164-9676-4a8a-91be-8bd87673ec5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c63e2993-88fd-447b-82b7-e1d2fcd8d7da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance dad51975-3054-4265-866e-63b1fa778472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9a841180-ac54-4c2a-9e82-4affb78d3fc9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 06799031-9998-4829-8725-09526681c442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:55:42 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Updating instance_info_cache with network_info: [{"id": "037999da-478f-48ea-8d99-2c86b18842e8", "address": "fa:16:3e:41:3b:05", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037999da-47", "ovs_interfaceid": "037999da-478f-48ea-8d99-2c86b18842e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Releasing lock "refresh_cache-06799031-9998-4829-8725-09526681c442" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Instance network_info: |[{"id": "037999da-478f-48ea-8d99-2c86b18842e8", "address": "fa:16:3e:41:3b:05", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037999da-47", "ovs_interfaceid": "037999da-478f-48ea-8d99-2c86b18842e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c0ceea1b-cb84-4da3-affd-99a171a9195d req-0608b3e2-2001-4fb5-9b0c-8c767c376489 service nova] Acquired lock "refresh_cache-06799031-9998-4829-8725-09526681c442" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.network.neutron [req-c0ceea1b-cb84-4da3-affd-99a171a9195d req-0608b3e2-2001-4fb5-9b0c-8c767c376489 service nova] [instance: 06799031-9998-4829-8725-09526681c442] Refreshing network info cache for port 037999da-478f-48ea-8d99-2c86b18842e8 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Start _get_guest_xml network_info=[{"id": "037999da-478f-48ea-8d99-2c86b18842e8", "address": "fa:16:3e:41:3b:05", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037999da-47", "ovs_interfaceid": "037999da-478f-48ea-8d99-2c86b18842e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:55:43 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:55:43 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:55:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1996227040',display_name='tempest-AttachVolumeNegativeTest-server-1996227040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1996227040',id=33,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIri4molai/oUIqKmxJbObknGBXVg/fe16qKxTlHAuSupxC2u/0CgZaBcMplT255HRlFJljzi1DEJzf0NqM9wctYe+9tL+88iHqplYGhHTkGu6VGEuwFEKF2Z5H4/fadg==',key_name='tempest-keypair-1397532635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d990b7b4c19436d8cd8f43d8d0facb9',ramdisk_id='',reservation_id='r-og8gx1co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-921155549',owner_user_name='tempest-AttachVolumeNegativeTest-921155549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:55:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afcdb0627e34b6e893b7981ea4615e3',uuid=06799031-9998-4829-8725-09526681c442,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "037999da-478f-48ea-8d99-2c86b18842e8", "address": "fa:16:3e:41:3b:05", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037999da-47", "ovs_interfaceid": "037999da-478f-48ea-8d99-2c86b18842e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converting VIF {"id": "037999da-478f-48ea-8d99-2c86b18842e8", "address": "fa:16:3e:41:3b:05", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037999da-47", "ovs_interfaceid": "037999da-478f-48ea-8d99-2c86b18842e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:3b:05,bridge_name='br-int',has_traffic_filtering=True,id=037999da-478f-48ea-8d99-2c86b18842e8,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037999da-47') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lazy-loading 'pci_devices' on Instance uuid 06799031-9998-4829-8725-09526681c442 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:55:43 user nova-compute[75378]:   <uuid>06799031-9998-4829-8725-09526681c442</uuid>
Nov 09 03:55:43 user nova-compute[75378]:   <name>instance-00000021</name>
Nov 09 03:55:43 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:55:43 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:55:43 user nova-compute[75378]:   <metadata>
Nov 09 03:55:43 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:55:43 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:55:43 user nova-compute[75378]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1996227040</nova:name>
Nov 09 03:55:43 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:55:43</nova:creationTime>
Nov 09 03:55:43 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:55:43 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:55:43 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:55:43 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:55:43 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:55:43 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:55:43 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:55:43 user nova-compute[75378]:       <nova:owner>
Nov 09 03:55:43 user nova-compute[75378]:         <nova:user uuid="2afcdb0627e34b6e893b7981ea4615e3">tempest-AttachVolumeNegativeTest-921155549-project-member</nova:user>
Nov 09 03:55:43 user nova-compute[75378]:         <nova:project uuid="6d990b7b4c19436d8cd8f43d8d0facb9">tempest-AttachVolumeNegativeTest-921155549</nova:project>
Nov 09 03:55:43 user nova-compute[75378]:       </nova:owner>
Nov 09 03:55:43 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:55:43 user nova-compute[75378]:       <nova:ports>
Nov 09 03:55:43 user nova-compute[75378]:         <nova:port uuid="037999da-478f-48ea-8d99-2c86b18842e8">
Nov 09 03:55:43 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 09 03:55:43 user nova-compute[75378]:         </nova:port>
Nov 09 03:55:43 user nova-compute[75378]:       </nova:ports>
Nov 09 03:55:43 user nova-compute[75378]:     </nova:instance>
Nov 09 03:55:43 user nova-compute[75378]:   </metadata>
Nov 09 03:55:43 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:55:43 user nova-compute[75378]:     <system>
Nov 09 03:55:43 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:55:43 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:55:43 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:55:43 user nova-compute[75378]:       <entry name="serial">06799031-9998-4829-8725-09526681c442</entry>
Nov 09 03:55:43 user nova-compute[75378]:       <entry name="uuid">06799031-9998-4829-8725-09526681c442</entry>
Nov 09 03:55:43 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:55:43 user nova-compute[75378]:     </system>
Nov 09 03:55:43 user nova-compute[75378]:   </sysinfo>
Nov 09 03:55:43 user nova-compute[75378]:   <os>
Nov 09 03:55:43 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:55:43 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:55:43 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:55:43 user nova-compute[75378]:   </os>
Nov 09 03:55:43 user nova-compute[75378]:   <features>
Nov 09 03:55:43 user nova-compute[75378]:     <acpi/>
Nov 09 03:55:43 user nova-compute[75378]:     <apic/>
Nov 09 03:55:43 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:55:43 user nova-compute[75378]:   </features>
Nov 09 03:55:43 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:55:43 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:55:43 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:55:43 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:55:43 user nova-compute[75378]:   </clock>
Nov 09 03:55:43 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:55:43 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:55:43 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:55:43 user nova-compute[75378]:   </cpu>
Nov 09 03:55:43 user nova-compute[75378]:   <devices>
Nov 09 03:55:43 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:55:43 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:55:43 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk"/>
Nov 09 03:55:43 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:55:43 user nova-compute[75378]:     </disk>
Nov 09 03:55:43 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:55:43 user nova-compute[75378]:       <mac address="fa:16:3e:41:3b:05"/>
Nov 09 03:55:43 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:55:43 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:55:43 user nova-compute[75378]:       <target dev="tap037999da-47"/>
Nov 09 03:55:43 user nova-compute[75378]:     </interface>
Nov 09 03:55:43 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:55:43 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/console.log" append="off"/>
Nov 09 03:55:43 user nova-compute[75378]:     </serial>
Nov 09 03:55:43 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:55:43 user nova-compute[75378]:     <video>
Nov 09 03:55:43 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:55:43 user nova-compute[75378]:     </video>
Nov 09 03:55:43 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:55:43 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:55:43 user nova-compute[75378]:     </rng>
Nov 09 03:55:43 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:55:43 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:55:43 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:55:43 user nova-compute[75378]:     </memballoon>
Nov 09 03:55:43 user nova-compute[75378]:   </devices>
Nov 09 03:55:43 user nova-compute[75378]: </domain>
Nov 09 03:55:43 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:55:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1996227040',display_name='tempest-AttachVolumeNegativeTest-server-1996227040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1996227040',id=33,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIri4molai/oUIqKmxJbObknGBXVg/fe16qKxTlHAuSupxC2u/0CgZaBcMplT255HRlFJljzi1DEJzf0NqM9wctYe+9tL+88iHqplYGhHTkGu6VGEuwFEKF2Z5H4/fadg==',key_name='tempest-keypair-1397532635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d990b7b4c19436d8cd8f43d8d0facb9',ramdisk_id='',reservation_id='r-og8gx1co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-921155549',owner_user_name='tempest-AttachVolumeNegativeTest-921155549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:55:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afcdb0627e34b6e893b7981ea4615e3',uuid=06799031-9998-4829-8725-09526681c442,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "037999da-478f-48ea-8d99-2c86b18842e8", "address": "fa:16:3e:41:3b:05", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037999da-47", "ovs_interfaceid": "037999da-478f-48ea-8d99-2c86b18842e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converting VIF {"id": "037999da-478f-48ea-8d99-2c86b18842e8", "address": "fa:16:3e:41:3b:05", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037999da-47", "ovs_interfaceid": "037999da-478f-48ea-8d99-2c86b18842e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:3b:05,bridge_name='br-int',has_traffic_filtering=True,id=037999da-478f-48ea-8d99-2c86b18842e8,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037999da-47') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG os_vif [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:3b:05,bridge_name='br-int',has_traffic_filtering=True,id=037999da-478f-48ea-8d99-2c86b18842e8,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037999da-47') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1576c22a-2d7a-56eb-84f8-6cf3bde8d992', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap037999da-47, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap037999da-47, col_values=(('qos', UUID('e0d2bdb1-4fc5-4e15-8695-a63a19b4d4ec')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap037999da-47, col_values=(('external_ids', {'iface-id': '037999da-478f-48ea-8d99-2c86b18842e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:3b:05', 'vm-uuid': '06799031-9998-4829-8725-09526681c442'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.695s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:43 user nova-compute[75378]: INFO os_vif [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:3b:05,bridge_name='br-int',has_traffic_filtering=True,id=037999da-478f-48ea-8d99-2c86b18842e8,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037999da-47')
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] No VIF found with MAC fa:16:3e:41:3b:05, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.network.neutron [req-c0ceea1b-cb84-4da3-affd-99a171a9195d req-0608b3e2-2001-4fb5-9b0c-8c767c376489 service nova] [instance: 06799031-9998-4829-8725-09526681c442] Updated VIF entry in instance network info cache for port 037999da-478f-48ea-8d99-2c86b18842e8. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG nova.network.neutron [req-c0ceea1b-cb84-4da3-affd-99a171a9195d req-0608b3e2-2001-4fb5-9b0c-8c767c376489 service nova] [instance: 06799031-9998-4829-8725-09526681c442] Updating instance_info_cache with network_info: [{"id": "037999da-478f-48ea-8d99-2c86b18842e8", "address": "fa:16:3e:41:3b:05", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037999da-47", "ovs_interfaceid": "037999da-478f-48ea-8d99-2c86b18842e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:55:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c0ceea1b-cb84-4da3-affd-99a171a9195d req-0608b3e2-2001-4fb5-9b0c-8c767c376489 service nova] Releasing lock "refresh_cache-06799031-9998-4829-8725-09526681c442" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:55:44 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:55:44 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:55:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-bd4ebd56-4373-4a25-a09a-95389b9f7073 req-b35d371a-ee94-4ec0-b70b-221663c79e0f service nova] [instance: 06799031-9998-4829-8725-09526681c442] Received event network-vif-plugged-037999da-478f-48ea-8d99-2c86b18842e8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:55:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bd4ebd56-4373-4a25-a09a-95389b9f7073 req-b35d371a-ee94-4ec0-b70b-221663c79e0f service nova] Acquiring lock "06799031-9998-4829-8725-09526681c442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bd4ebd56-4373-4a25-a09a-95389b9f7073 req-b35d371a-ee94-4ec0-b70b-221663c79e0f service nova] Lock "06799031-9998-4829-8725-09526681c442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bd4ebd56-4373-4a25-a09a-95389b9f7073 req-b35d371a-ee94-4ec0-b70b-221663c79e0f service nova] Lock "06799031-9998-4829-8725-09526681c442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-bd4ebd56-4373-4a25-a09a-95389b9f7073 req-b35d371a-ee94-4ec0-b70b-221663c79e0f service nova] [instance: 06799031-9998-4829-8725-09526681c442] No waiting events found dispatching network-vif-plugged-037999da-478f-48ea-8d99-2c86b18842e8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:55:45 user nova-compute[75378]: WARNING nova.compute.manager [req-bd4ebd56-4373-4a25-a09a-95389b9f7073 req-b35d371a-ee94-4ec0-b70b-221663c79e0f service nova] [instance: 06799031-9998-4829-8725-09526681c442] Received unexpected event network-vif-plugged-037999da-478f-48ea-8d99-2c86b18842e8 for instance with vm_state building and task_state spawning.
Nov 09 03:55:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "dad51975-3054-4265-866e-63b1fa778472" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "dad51975-3054-4265-866e-63b1fa778472" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG nova.objects.instance [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lazy-loading 'flavor' on Instance uuid dad51975-3054-4265-866e-63b1fa778472 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "dad51975-3054-4265-866e-63b1fa778472" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "dad51975-3054-4265-866e-63b1fa778472" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "dad51975-3054-4265-866e-63b1fa778472" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:46 user nova-compute[75378]: INFO nova.compute.manager [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Attaching volume 3cd22c26-57f0-43da-813c-8bce1616195d to /dev/vdb
Nov 09 03:55:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG os_brick.utils [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0afd241-b1bd-4757-879d-be90e829b3d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4b2aa0-27b3-4af9-b164-195898777a7c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d5b26b-76da-4c50-a9ae-6db26b2e777d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c340ba8-43e5-4e00-909b-fa32c9fe7e21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:55:46 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:55:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc136c36-00d0-445f-b736-172aa6d9afd6]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG os_brick.utils [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:55:46 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Updating existing volume attachment record: 048dae48-8264-42b5-b8cd-b2e975a07c83 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:55:47 user nova-compute[75378]: DEBUG nova.compute.manager [req-6a522b32-e70f-4636-a91e-b5e863ef7cd0 req-f23f9899-7d91-444c-a458-389cec66d3c6 service nova] [instance: 06799031-9998-4829-8725-09526681c442] Received event network-vif-plugged-037999da-478f-48ea-8d99-2c86b18842e8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:55:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6a522b32-e70f-4636-a91e-b5e863ef7cd0 req-f23f9899-7d91-444c-a458-389cec66d3c6 service nova] Acquiring lock "06799031-9998-4829-8725-09526681c442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6a522b32-e70f-4636-a91e-b5e863ef7cd0 req-f23f9899-7d91-444c-a458-389cec66d3c6 service nova] Lock "06799031-9998-4829-8725-09526681c442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6a522b32-e70f-4636-a91e-b5e863ef7cd0 req-f23f9899-7d91-444c-a458-389cec66d3c6 service nova] Lock "06799031-9998-4829-8725-09526681c442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:47 user nova-compute[75378]: DEBUG nova.compute.manager [req-6a522b32-e70f-4636-a91e-b5e863ef7cd0 req-f23f9899-7d91-444c-a458-389cec66d3c6 service nova] [instance: 06799031-9998-4829-8725-09526681c442] No waiting events found dispatching network-vif-plugged-037999da-478f-48ea-8d99-2c86b18842e8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:55:47 user nova-compute[75378]: WARNING nova.compute.manager [req-6a522b32-e70f-4636-a91e-b5e863ef7cd0 req-f23f9899-7d91-444c-a458-389cec66d3c6 service nova] [instance: 06799031-9998-4829-8725-09526681c442] Received unexpected event network-vif-plugged-037999da-478f-48ea-8d99-2c86b18842e8 for instance with vm_state building and task_state spawning.
Nov 09 03:55:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:55:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:55:47 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 06799031-9998-4829-8725-09526681c442] Instance spawned successfully.
Nov 09 03:55:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:55:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:55:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:55:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:55:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:55:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:55:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:55:47 user nova-compute[75378]: INFO nova.compute.manager [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Took 6.98 seconds to spawn the instance on the hypervisor.
Nov 09 03:55:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:55:47 user nova-compute[75378]: INFO nova.compute.manager [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Took 8.17 seconds to build instance.
Nov 09 03:55:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ef4c6c57-8304-4413-9dfe-f64a61381f25 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "06799031-9998-4829-8725-09526681c442" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.283s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:47 user nova-compute[75378]: INFO nova.compute.manager [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Detaching volume 47f376dc-cf4e-4738-9306-6b1eb440f6e8
Nov 09 03:55:48 user nova-compute[75378]: INFO nova.virt.block_device [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Attempting to driver detach volume 47f376dc-cf4e-4738-9306-6b1eb440f6e8 from mountpoint /dev/vdb
Nov 09 03:55:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Attempting to detach device vdb from instance ed92e04a-56ec-42f1-bed3-8b28a37d1475 from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 03:55:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:55:48 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:55:48 user nova-compute[75378]:   <source dev="/dev/sdb"/>
Nov 09 03:55:48 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:55:48 user nova-compute[75378]:   <serial>47f376dc-cf4e-4738-9306-6b1eb440f6e8</serial>
Nov 09 03:55:48 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 03:55:48 user nova-compute[75378]: </disk>
Nov 09 03:55:48 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:55:48 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Successfully detached device vdb from instance ed92e04a-56ec-42f1-bed3-8b28a37d1475 from the persistent domain config.
Nov 09 03:55:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ed92e04a-56ec-42f1-bed3-8b28a37d1475 from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 03:55:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:55:48 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:55:48 user nova-compute[75378]:   <source dev="/dev/sdb"/>
Nov 09 03:55:48 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:55:48 user nova-compute[75378]:   <serial>47f376dc-cf4e-4738-9306-6b1eb440f6e8</serial>
Nov 09 03:55:48 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 03:55:48 user nova-compute[75378]: </disk>
Nov 09 03:55:48 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:55:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ed92e04a-56ec-42f1-bed3-8b28a37d1475 {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 03:55:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Acquiring lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:57 user nova-compute[75378]: DEBUG nova.compute.manager [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:55:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:57 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:55:57 user nova-compute[75378]: INFO nova.compute.claims [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Claim successful on node user
Nov 09 03:55:57 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:55:57 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:55:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:58 user nova-compute[75378]: DEBUG nova.compute.manager [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:55:58 user nova-compute[75378]: DEBUG nova.compute.manager [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:55:58 user nova-compute[75378]: DEBUG nova.network.neutron [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:55:58 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:55:58 user nova-compute[75378]: DEBUG nova.compute.manager [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:55:58 user nova-compute[75378]: DEBUG nova.policy [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1681626725044d1cba836a92d5fe3827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4984a96b0a47cba8fa82f19c985e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:55:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:55:58 user nova-compute[75378]: DEBUG nova.compute.manager [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:55:58 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:55:58 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Creating image(s)
Nov 09 03:55:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "/opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "/opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.190s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.215s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7/disk 1073741824" returned: 0 in 0.061s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:58 user nova-compute[75378]: DEBUG nova.network.neutron [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Successfully created port: 4d8c1e56-cb99-46c4-9452-ae66293d6d34 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:55:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.201s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:59 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:55:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:55:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:55:59 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Cannot resize image /opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:55:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:55:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Ensure instance console log exists: /opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:55:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:55:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:55:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:55:59 user nova-compute[75378]: DEBUG nova.network.neutron [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Successfully updated port: 4d8c1e56-cb99-46c4-9452-ae66293d6d34 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:55:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Acquiring lock "refresh_cache-5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:55:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Acquired lock "refresh_cache-5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:55:59 user nova-compute[75378]: DEBUG nova.network.neutron [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:55:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-2820b561-4ade-447c-967e-88a458e58b57 req-bfd6331b-8faa-4541-ab23-218a9f285313 service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Received event network-changed-4d8c1e56-cb99-46c4-9452-ae66293d6d34 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:55:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-2820b561-4ade-447c-967e-88a458e58b57 req-bfd6331b-8faa-4541-ab23-218a9f285313 service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Refreshing instance network info cache due to event network-changed-4d8c1e56-cb99-46c4-9452-ae66293d6d34. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:55:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2820b561-4ade-447c-967e-88a458e58b57 req-bfd6331b-8faa-4541-ab23-218a9f285313 service nova] Acquiring lock "refresh_cache-5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:55:59 user nova-compute[75378]: DEBUG nova.network.neutron [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.network.neutron [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Updating instance_info_cache with network_info: [{"id": "4d8c1e56-cb99-46c4-9452-ae66293d6d34", "address": "fa:16:3e:e8:5c:92", "network": {"id": "c24e97e2-0bda-4032-839f-897e81cb118e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1098129296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b4984a96b0a47cba8fa82f19c985e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8c1e56-cb", "ovs_interfaceid": "4d8c1e56-cb99-46c4-9452-ae66293d6d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Releasing lock "refresh_cache-5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.compute.manager [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Instance network_info: |[{"id": "4d8c1e56-cb99-46c4-9452-ae66293d6d34", "address": "fa:16:3e:e8:5c:92", "network": {"id": "c24e97e2-0bda-4032-839f-897e81cb118e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1098129296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b4984a96b0a47cba8fa82f19c985e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8c1e56-cb", "ovs_interfaceid": "4d8c1e56-cb99-46c4-9452-ae66293d6d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2820b561-4ade-447c-967e-88a458e58b57 req-bfd6331b-8faa-4541-ab23-218a9f285313 service nova] Acquired lock "refresh_cache-5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.network.neutron [req-2820b561-4ade-447c-967e-88a458e58b57 req-bfd6331b-8faa-4541-ab23-218a9f285313 service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Refreshing network info cache for port 4d8c1e56-cb99-46c4-9452-ae66293d6d34 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Start _get_guest_xml network_info=[{"id": "4d8c1e56-cb99-46c4-9452-ae66293d6d34", "address": "fa:16:3e:e8:5c:92", "network": {"id": "c24e97e2-0bda-4032-839f-897e81cb118e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1098129296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b4984a96b0a47cba8fa82f19c985e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8c1e56-cb", "ovs_interfaceid": "4d8c1e56-cb99-46c4-9452-ae66293d6d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:56:00 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:56:00 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1660193592',display_name='tempest-VolumesActionsTest-instance-1660193592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1660193592',id=34,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b4984a96b0a47cba8fa82f19c985e50',ramdisk_id='',reservation_id='r-sl60ravp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-650140927',owner_user_name='tempest-VolumesActionsTest-650140927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:55:58Z,user_data=None,user_id='1681626725044d1cba836a92d5fe3827',uuid=5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d8c1e56-cb99-46c4-9452-ae66293d6d34", "address": "fa:16:3e:e8:5c:92", "network": {"id": "c24e97e2-0bda-4032-839f-897e81cb118e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1098129296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b4984a96b0a47cba8fa82f19c985e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8c1e56-cb", "ovs_interfaceid": "4d8c1e56-cb99-46c4-9452-ae66293d6d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Converting VIF {"id": "4d8c1e56-cb99-46c4-9452-ae66293d6d34", "address": "fa:16:3e:e8:5c:92", "network": {"id": "c24e97e2-0bda-4032-839f-897e81cb118e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1098129296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b4984a96b0a47cba8fa82f19c985e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8c1e56-cb", "ovs_interfaceid": "4d8c1e56-cb99-46c4-9452-ae66293d6d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:5c:92,bridge_name='br-int',has_traffic_filtering=True,id=4d8c1e56-cb99-46c4-9452-ae66293d6d34,network=Network(c24e97e2-0bda-4032-839f-897e81cb118e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8c1e56-cb') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.objects.instance [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:56:00 user nova-compute[75378]:   <uuid>5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7</uuid>
Nov 09 03:56:00 user nova-compute[75378]:   <name>instance-00000022</name>
Nov 09 03:56:00 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:56:00 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:56:00 user nova-compute[75378]:   <metadata>
Nov 09 03:56:00 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:56:00 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:56:00 user nova-compute[75378]:       <nova:name>tempest-VolumesActionsTest-instance-1660193592</nova:name>
Nov 09 03:56:00 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:56:00</nova:creationTime>
Nov 09 03:56:00 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:56:00 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:56:00 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:56:00 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:56:00 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:56:00 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:56:00 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:56:00 user nova-compute[75378]:       <nova:owner>
Nov 09 03:56:00 user nova-compute[75378]:         <nova:user uuid="1681626725044d1cba836a92d5fe3827">tempest-VolumesActionsTest-650140927-project-member</nova:user>
Nov 09 03:56:00 user nova-compute[75378]:         <nova:project uuid="7b4984a96b0a47cba8fa82f19c985e50">tempest-VolumesActionsTest-650140927</nova:project>
Nov 09 03:56:00 user nova-compute[75378]:       </nova:owner>
Nov 09 03:56:00 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:56:00 user nova-compute[75378]:       <nova:ports>
Nov 09 03:56:00 user nova-compute[75378]:         <nova:port uuid="4d8c1e56-cb99-46c4-9452-ae66293d6d34">
Nov 09 03:56:00 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 09 03:56:00 user nova-compute[75378]:         </nova:port>
Nov 09 03:56:00 user nova-compute[75378]:       </nova:ports>
Nov 09 03:56:00 user nova-compute[75378]:     </nova:instance>
Nov 09 03:56:00 user nova-compute[75378]:   </metadata>
Nov 09 03:56:00 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:56:00 user nova-compute[75378]:     <system>
Nov 09 03:56:00 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:56:00 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:56:00 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:56:00 user nova-compute[75378]:       <entry name="serial">5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7</entry>
Nov 09 03:56:00 user nova-compute[75378]:       <entry name="uuid">5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7</entry>
Nov 09 03:56:00 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:56:00 user nova-compute[75378]:     </system>
Nov 09 03:56:00 user nova-compute[75378]:   </sysinfo>
Nov 09 03:56:00 user nova-compute[75378]:   <os>
Nov 09 03:56:00 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:56:00 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:56:00 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:56:00 user nova-compute[75378]:   </os>
Nov 09 03:56:00 user nova-compute[75378]:   <features>
Nov 09 03:56:00 user nova-compute[75378]:     <acpi/>
Nov 09 03:56:00 user nova-compute[75378]:     <apic/>
Nov 09 03:56:00 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:56:00 user nova-compute[75378]:   </features>
Nov 09 03:56:00 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:56:00 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:56:00 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:56:00 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:56:00 user nova-compute[75378]:   </clock>
Nov 09 03:56:00 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:56:00 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:56:00 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:56:00 user nova-compute[75378]:   </cpu>
Nov 09 03:56:00 user nova-compute[75378]:   <devices>
Nov 09 03:56:00 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:56:00 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:56:00 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7/disk"/>
Nov 09 03:56:00 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:56:00 user nova-compute[75378]:     </disk>
Nov 09 03:56:00 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:56:00 user nova-compute[75378]:       <mac address="fa:16:3e:e8:5c:92"/>
Nov 09 03:56:00 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:56:00 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:56:00 user nova-compute[75378]:       <target dev="tap4d8c1e56-cb"/>
Nov 09 03:56:00 user nova-compute[75378]:     </interface>
Nov 09 03:56:00 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:56:00 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7/console.log" append="off"/>
Nov 09 03:56:00 user nova-compute[75378]:     </serial>
Nov 09 03:56:00 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:56:00 user nova-compute[75378]:     <video>
Nov 09 03:56:00 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:56:00 user nova-compute[75378]:     </video>
Nov 09 03:56:00 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:56:00 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:56:00 user nova-compute[75378]:     </rng>
Nov 09 03:56:00 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:56:00 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:56:00 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:56:00 user nova-compute[75378]:     </memballoon>
Nov 09 03:56:00 user nova-compute[75378]:   </devices>
Nov 09 03:56:00 user nova-compute[75378]: </domain>
Nov 09 03:56:00 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1660193592',display_name='tempest-VolumesActionsTest-instance-1660193592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1660193592',id=34,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b4984a96b0a47cba8fa82f19c985e50',ramdisk_id='',reservation_id='r-sl60ravp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-650140927',owner_user_name='tempest-VolumesActionsTest-650140927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:55:58Z,user_data=None,user_id='1681626725044d1cba836a92d5fe3827',uuid=5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d8c1e56-cb99-46c4-9452-ae66293d6d34", "address": "fa:16:3e:e8:5c:92", "network": {"id": "c24e97e2-0bda-4032-839f-897e81cb118e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1098129296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b4984a96b0a47cba8fa82f19c985e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8c1e56-cb", "ovs_interfaceid": "4d8c1e56-cb99-46c4-9452-ae66293d6d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Converting VIF {"id": "4d8c1e56-cb99-46c4-9452-ae66293d6d34", "address": "fa:16:3e:e8:5c:92", "network": {"id": "c24e97e2-0bda-4032-839f-897e81cb118e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1098129296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b4984a96b0a47cba8fa82f19c985e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8c1e56-cb", "ovs_interfaceid": "4d8c1e56-cb99-46c4-9452-ae66293d6d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:5c:92,bridge_name='br-int',has_traffic_filtering=True,id=4d8c1e56-cb99-46c4-9452-ae66293d6d34,network=Network(c24e97e2-0bda-4032-839f-897e81cb118e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8c1e56-cb') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG os_vif [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:5c:92,bridge_name='br-int',has_traffic_filtering=True,id=4d8c1e56-cb99-46c4-9452-ae66293d6d34,network=Network(c24e97e2-0bda-4032-839f-897e81cb118e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8c1e56-cb') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02510e4e-7d26-54bf-9acf-59d004d046f3', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d8c1e56-cb, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d8c1e56-cb, col_values=(('qos', UUID('7cf5adf6-2fad-4a30-9fd0-bd841936c9ac')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d8c1e56-cb, col_values=(('external_ids', {'iface-id': '4d8c1e56-cb99-46c4-9452-ae66293d6d34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:5c:92', 'vm-uuid': '5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:00 user nova-compute[75378]: INFO os_vif [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:5c:92,bridge_name='br-int',has_traffic_filtering=True,id=4d8c1e56-cb99-46c4-9452-ae66293d6d34,network=Network(c24e97e2-0bda-4032-839f-897e81cb118e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8c1e56-cb')
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] No VIF found with MAC fa:16:3e:e8:5c:92, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.network.neutron [req-2820b561-4ade-447c-967e-88a458e58b57 req-bfd6331b-8faa-4541-ab23-218a9f285313 service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Updated VIF entry in instance network info cache for port 4d8c1e56-cb99-46c4-9452-ae66293d6d34. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG nova.network.neutron [req-2820b561-4ade-447c-967e-88a458e58b57 req-bfd6331b-8faa-4541-ab23-218a9f285313 service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Updating instance_info_cache with network_info: [{"id": "4d8c1e56-cb99-46c4-9452-ae66293d6d34", "address": "fa:16:3e:e8:5c:92", "network": {"id": "c24e97e2-0bda-4032-839f-897e81cb118e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1098129296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b4984a96b0a47cba8fa82f19c985e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8c1e56-cb", "ovs_interfaceid": "4d8c1e56-cb99-46c4-9452-ae66293d6d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:56:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2820b561-4ade-447c-967e-88a458e58b57 req-bfd6331b-8faa-4541-ab23-218a9f285313 service nova] Releasing lock "refresh_cache-5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:56:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:02 user nova-compute[75378]: DEBUG nova.compute.manager [req-4892347b-1e0a-4a8d-963e-0400b58046b8 req-99d58ab6-c73c-4ff7-9aa5-1c4956a316ec service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Received event network-vif-plugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:56:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4892347b-1e0a-4a8d-963e-0400b58046b8 req-99d58ab6-c73c-4ff7-9aa5-1c4956a316ec service nova] Acquiring lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:56:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4892347b-1e0a-4a8d-963e-0400b58046b8 req-99d58ab6-c73c-4ff7-9aa5-1c4956a316ec service nova] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:56:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4892347b-1e0a-4a8d-963e-0400b58046b8 req-99d58ab6-c73c-4ff7-9aa5-1c4956a316ec service nova] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:56:02 user nova-compute[75378]: DEBUG nova.compute.manager [req-4892347b-1e0a-4a8d-963e-0400b58046b8 req-99d58ab6-c73c-4ff7-9aa5-1c4956a316ec service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] No waiting events found dispatching network-vif-plugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:56:02 user nova-compute[75378]: WARNING nova.compute.manager [req-4892347b-1e0a-4a8d-963e-0400b58046b8 req-99d58ab6-c73c-4ff7-9aa5-1c4956a316ec service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Received unexpected event network-vif-plugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 for instance with vm_state building and task_state spawning.
Nov 09 03:56:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTRnNyVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:56:03 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:56:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:56:03 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:56:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:56:03 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64b2fbc-cf78-4030-8f0f-2bf4c8822dac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:56:03 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b2e858-9e04-4ed7-bed6-2acc0a1f905e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1] added
Nov 09 03:56:03 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9646a31a-e546-4c2b-aca8-50ac0e681f78]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bba4759-1df3-47c1-a5fe-fb9c5f0c063c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zTRnNyVX {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zTRnNyVX" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19d8ad2-7ab8-4b8c-aece-d653b693dc1a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zTRnNyVX'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[753deb9b-d58d-4f88-a2b6-77e4c09edeec]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7039baca-037a-4fc6-8ebf-483af28b1b0d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:56:03 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:56:03 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:56:03 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:56:03 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:56:03 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:56:03 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:56:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG nova.compute.manager [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:56:04 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Instance spawned successfully.
Nov 09 03:56:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c5f57a-4fbf-4332-9f19-f7953ef3f578]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1, portal: 172.16.0.220,3260]
Nov 09 03:56:04 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1, portal: 172.16.0.220,3260] successful.
Nov 09 03:56:04 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b385356c-1c60-4811-af64-bacbf70b9855]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-52639c79-d572-445c-ba74-2426acd6e00d req-4ca54508-cf3d-4ffa-b33e-3b19d3213eb5 service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Received event network-vif-plugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-52639c79-d572-445c-ba74-2426acd6e00d req-4ca54508-cf3d-4ffa-b33e-3b19d3213eb5 service nova] Acquiring lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-52639c79-d572-445c-ba74-2426acd6e00d req-4ca54508-cf3d-4ffa-b33e-3b19d3213eb5 service nova] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-52639c79-d572-445c-ba74-2426acd6e00d req-4ca54508-cf3d-4ffa-b33e-3b19d3213eb5 service nova] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-52639c79-d572-445c-ba74-2426acd6e00d req-4ca54508-cf3d-4ffa-b33e-3b19d3213eb5 service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] No waiting events found dispatching network-vif-plugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:56:04 user nova-compute[75378]: WARNING nova.compute.manager [req-52639c79-d572-445c-ba74-2426acd6e00d req-4ca54508-cf3d-4ffa-b33e-3b19d3213eb5 service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Received unexpected event network-vif-plugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 for instance with vm_state building and task_state spawning.
Nov 09 03:56:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b7c7c1-8e89-4f77-b4ca-ca73cd2c6fec]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:56:04 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:56:04 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:56:04 user nova-compute[75378]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 (non-flash)
Nov 09 03:56:04 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:56:04 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:56:04 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:56:04 user nova-compute[75378]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 (non-flash)
Nov 09 03:56:04 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:04 user nova-compute[75378]: INFO nova.compute.manager [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 09 03:56:04 user nova-compute[75378]: DEBUG nova.compute.manager [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa100b9-8a44-4c1d-ad24-9a73237538ab]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:56:04 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTRnNyVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:56:04 user nova-compute[75378]: INFO nova.compute.manager [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Took 6.83 seconds to build instance.
Nov 09 03:56:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-bd97c945-36de-4951-9bba-5335a57a481f tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.990s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:56:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:56:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26461396166363338', 'path': '/dev/sde'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:56:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461396166363338', 'path': '/dev/sde'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:56:05 user nova-compute[75378]: DEBUG nova.objects.instance [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lazy-loading 'flavor' on Instance uuid c63e2993-88fd-447b-82b7-e1d2fcd8d7da {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:56:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 03:56:05 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:56:05 user nova-compute[75378]:   <source dev="/dev/sde"/>
Nov 09 03:56:05 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:56:05 user nova-compute[75378]:   <serial>f9eb4ea7-b16d-4a99-9aaa-f58352774ba1</serial>
Nov 09 03:56:05 user nova-compute[75378]: </disk>
Nov 09 03:56:05 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 03:56:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:56:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:56:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] No VIF found with MAC fa:16:3e:e1:1d:ed, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:56:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2ab5ed43-9a44-470e-8a90-da82377736ef tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.122s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:56:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:08 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ed92e04a-56ec-42f1-bed3-8b28a37d1475 is timed out.
Nov 09 03:56:08 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Successfully detached device vdb from instance ed92e04a-56ec-42f1-bed3-8b28a37d1475 from the live domain config.
Nov 09 03:56:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FvGRQISs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:56:08 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:56:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[173ec191-2892-4351-bfe4-655283e14f92]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:56:08 user nova-compute[75378]: No targets found.
Nov 09 03:56:08 user nova-compute[75378]: iSNS:
Nov 09 03:56:08 user nova-compute[75378]: No targets found.
Nov 09 03:56:08 user nova-compute[75378]: STATIC:
Nov 09 03:56:08 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1
Nov 09 03:56:08 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:56:08 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:56:08 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8
Nov 09 03:56:08 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:56:08 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:56:08 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 03:56:08 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:56:08 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:56:08 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522
Nov 09 03:56:08 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:56:08 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:56:08 user nova-compute[75378]: FIRMWARE:
Nov 09 03:56:08 user nova-compute[75378]: No targets found.
Nov 09 03:56:08 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:56:08 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:56:08 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe3d7f6-28dd-4d71-a916-ace8fcdf9450]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff09148-3a6d-4a72-9cab-dfffe888c8b7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:56:08 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:56:08 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:56:08 user nova-compute[75378]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 (non-flash)
Nov 09 03:56:08 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:56:08 user nova-compute[75378]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 (non-flash)
Nov 09 03:56:08 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:56:08 user nova-compute[75378]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 (non-flash)
Nov 09 03:56:08 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c428d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8'): ({'sdb'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Removing single pathed devices sdb {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd59e913-eb6f-4c71-b037-729337300fbb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee6e2e3-6aa3-4788-bc23-dc84df1d57ab]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Flushing IO for device /dev/sdb {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a69d75-b9c2-4c85-809f-f2ad49651a86]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4265e61-0ae1-4dc3-8427-42730d701255]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86777b1-4b7e-4502-a238-ff7a0a4340dd]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:56:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:09 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:09 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb369427-8447-4a07-9ce4-dcfa27e364b3]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:09 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8, portal: 172.16.0.220,3260]
Nov 09 03:56:09 user nova-compute[75378]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8, portal: 172.16.0.220,3260] successful.
Nov 09 03:56:09 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:56:09 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:09 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47f376dc-cf4e-4738-9306-6b1eb440f6e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:09 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a51f686-6384-4be3-9494-2183d9a26ac9]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:09 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:56:09 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:56:09 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] <== disconnect_volume: return (389ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:56:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:56:10 user nova-compute[75378]: DEBUG nova.objects.instance [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lazy-loading 'flavor' on Instance uuid ed92e04a-56ec-42f1-bed3-8b28a37d1475 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:56:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c62b8094-ff5c-4c75-9c59-395151ae6bba tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.275s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:56:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPvguTnQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:56:14 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:56:14 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:56:14 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76b6aa1-26cb-435c-acd2-d016892bc6f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:56:14 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d8139f-452c-48fa-9e5a-1c9d66080f24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d] added
Nov 09 03:56:14 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6139cac7-571d-4897-b6f7-69420c2d4dc3]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec2b3be-4aa6-40f3-bfd9-7c8a29217476]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cPvguTnQ {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cPvguTnQ" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c148f84-7ab0-4abe-bed5-46ad56af5b0b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cPvguTnQ'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b409bd-3360-4290-b6e8-68ca875fd9fe]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[210a9b07-c9ce-4254-bfa6-19699b9768d3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:56:14 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:56:14 user nova-compute[75378]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 (non-flash)
Nov 09 03:56:14 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:56:14 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:56:14 user nova-compute[75378]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 (non-flash)
Nov 09 03:56:14 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd75931-70b4-47f4-8af4-847fbf7980a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d, portal: 172.16.0.220,3260]
Nov 09 03:56:14 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d, portal: 172.16.0.220,3260] successful.
Nov 09 03:56:14 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[135af171-8c65-476e-8edf-370260a6ba93]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[252effff-e506-4010-a7d1-3ca848836813]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:56:14 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:56:14 user nova-compute[75378]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 (non-flash)
Nov 09 03:56:14 user nova-compute[75378]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d (non-flash)
Nov 09 03:56:14 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:56:14 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:56:14 user nova-compute[75378]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 (non-flash)
Nov 09 03:56:14 user nova-compute[75378]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d (non-flash)
Nov 09 03:56:14 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b20484-7e3e-4d64-aa7a-ce60b1c5594d]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:56:14 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: None {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:56:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:15 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:56:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPvguTnQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:56:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:56:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23164323238656161', 'path': '/dev/sdb'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:56:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164323238656161', 'path': '/dev/sdb'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:56:15 user nova-compute[75378]: DEBUG nova.objects.instance [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lazy-loading 'flavor' on Instance uuid dad51975-3054-4265-866e-63b1fa778472 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:56:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 03:56:16 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:56:16 user nova-compute[75378]:   <source dev="/dev/sdb"/>
Nov 09 03:56:16 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:56:16 user nova-compute[75378]:   <serial>3cd22c26-57f0-43da-813c-8bce1616195d</serial>
Nov 09 03:56:16 user nova-compute[75378]: </disk>
Nov 09 03:56:16 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 03:56:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:56:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:56:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] No VIF found with MAC fa:16:3e:18:d4:b6, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:56:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3fc80e36-d4dd-4a5c-aca4-63d73459e35b tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "dad51975-3054-4265-866e-63b1fa778472" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.045s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:56:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-9b47a44f-5776-4f71-a8c6-3b29957eb75a req-10a2038a-c131-4233-9c92-f60e4c0c7c47 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received event network-changed-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:56:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-9b47a44f-5776-4f71-a8c6-3b29957eb75a req-10a2038a-c131-4233-9c92-f60e4c0c7c47 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Refreshing instance network info cache due to event network-changed-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:56:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9b47a44f-5776-4f71-a8c6-3b29957eb75a req-10a2038a-c131-4233-9c92-f60e4c0c7c47 service nova] Acquiring lock "refresh_cache-dad51975-3054-4265-866e-63b1fa778472" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:56:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9b47a44f-5776-4f71-a8c6-3b29957eb75a req-10a2038a-c131-4233-9c92-f60e4c0c7c47 service nova] Acquired lock "refresh_cache-dad51975-3054-4265-866e-63b1fa778472" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:56:19 user nova-compute[75378]: DEBUG nova.network.neutron [req-9b47a44f-5776-4f71-a8c6-3b29957eb75a req-10a2038a-c131-4233-9c92-f60e4c0c7c47 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Refreshing network info cache for port aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:56:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:19 user nova-compute[75378]: DEBUG nova.network.neutron [req-9b47a44f-5776-4f71-a8c6-3b29957eb75a req-10a2038a-c131-4233-9c92-f60e4c0c7c47 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Updated VIF entry in instance network info cache for port aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:56:19 user nova-compute[75378]: DEBUG nova.network.neutron [req-9b47a44f-5776-4f71-a8c6-3b29957eb75a req-10a2038a-c131-4233-9c92-f60e4c0c7c47 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Updating instance_info_cache with network_info: [{"id": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "address": "fa:16:3e:18:d4:b6", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeca0fbf-0f", "ovs_interfaceid": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:56:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9b47a44f-5776-4f71-a8c6-3b29957eb75a req-10a2038a-c131-4233-9c92-f60e4c0c7c47 service nova] Releasing lock "refresh_cache-dad51975-3054-4265-866e-63b1fa778472" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:56:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:21 user nova-compute[75378]: DEBUG nova.compute.manager [req-2760c727-c448-4ddd-bd29-73a5def9fbcc req-63d3e8f4-901d-4496-b5d0-bac92e228938 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received event network-changed-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:56:21 user nova-compute[75378]: DEBUG nova.compute.manager [req-2760c727-c448-4ddd-bd29-73a5def9fbcc req-63d3e8f4-901d-4496-b5d0-bac92e228938 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Refreshing instance network info cache due to event network-changed-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:56:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2760c727-c448-4ddd-bd29-73a5def9fbcc req-63d3e8f4-901d-4496-b5d0-bac92e228938 service nova] Acquiring lock "refresh_cache-dad51975-3054-4265-866e-63b1fa778472" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:56:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2760c727-c448-4ddd-bd29-73a5def9fbcc req-63d3e8f4-901d-4496-b5d0-bac92e228938 service nova] Acquired lock "refresh_cache-dad51975-3054-4265-866e-63b1fa778472" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:56:21 user nova-compute[75378]: DEBUG nova.network.neutron [req-2760c727-c448-4ddd-bd29-73a5def9fbcc req-63d3e8f4-901d-4496-b5d0-bac92e228938 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Refreshing network info cache for port aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:56:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:22 user nova-compute[75378]: DEBUG nova.network.neutron [req-2760c727-c448-4ddd-bd29-73a5def9fbcc req-63d3e8f4-901d-4496-b5d0-bac92e228938 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Updated VIF entry in instance network info cache for port aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:56:22 user nova-compute[75378]: DEBUG nova.network.neutron [req-2760c727-c448-4ddd-bd29-73a5def9fbcc req-63d3e8f4-901d-4496-b5d0-bac92e228938 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Updating instance_info_cache with network_info: [{"id": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "address": "fa:16:3e:18:d4:b6", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeca0fbf-0f", "ovs_interfaceid": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:56:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2760c727-c448-4ddd-bd29-73a5def9fbcc req-63d3e8f4-901d-4496-b5d0-bac92e228938 service nova] Releasing lock "refresh_cache-dad51975-3054-4265-866e-63b1fa778472" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:56:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-da351b51-bf10-4d7b-8625-8d6a227b3119 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "dad51975-3054-4265-866e-63b1fa778472" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:56:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-da351b51-bf10-4d7b-8625-8d6a227b3119 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "dad51975-3054-4265-866e-63b1fa778472" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:56:22 user nova-compute[75378]: INFO nova.compute.manager [None req-da351b51-bf10-4d7b-8625-8d6a227b3119 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Rebooting instance
Nov 09 03:56:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-da351b51-bf10-4d7b-8625-8d6a227b3119 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "refresh_cache-dad51975-3054-4265-866e-63b1fa778472" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:56:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-da351b51-bf10-4d7b-8625-8d6a227b3119 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquired lock "refresh_cache-dad51975-3054-4265-866e-63b1fa778472" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:56:22 user nova-compute[75378]: DEBUG nova.network.neutron [None req-da351b51-bf10-4d7b-8625-8d6a227b3119 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:56:22 user nova-compute[75378]: DEBUG nova.network.neutron [None req-da351b51-bf10-4d7b-8625-8d6a227b3119 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Updating instance_info_cache with network_info: [{"id": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "address": "fa:16:3e:18:d4:b6", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeca0fbf-0f", "ovs_interfaceid": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:56:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-da351b51-bf10-4d7b-8625-8d6a227b3119 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Releasing lock "refresh_cache-dad51975-3054-4265-866e-63b1fa778472" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:56:22 user nova-compute[75378]: DEBUG nova.compute.manager [None req-da351b51-bf10-4d7b-8625-8d6a227b3119 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:56:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-e407421d-af54-4bc0-b16b-70cfeb8d81f8 req-39511287-f226-4e36-9a2f-758350b0800a service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received event network-vif-unplugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:56:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e407421d-af54-4bc0-b16b-70cfeb8d81f8 req-39511287-f226-4e36-9a2f-758350b0800a service nova] Acquiring lock "dad51975-3054-4265-866e-63b1fa778472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:56:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e407421d-af54-4bc0-b16b-70cfeb8d81f8 req-39511287-f226-4e36-9a2f-758350b0800a service nova] Lock "dad51975-3054-4265-866e-63b1fa778472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:56:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e407421d-af54-4bc0-b16b-70cfeb8d81f8 req-39511287-f226-4e36-9a2f-758350b0800a service nova] Lock "dad51975-3054-4265-866e-63b1fa778472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:56:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-e407421d-af54-4bc0-b16b-70cfeb8d81f8 req-39511287-f226-4e36-9a2f-758350b0800a service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] No waiting events found dispatching network-vif-unplugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:56:25 user nova-compute[75378]: WARNING nova.compute.manager [req-e407421d-af54-4bc0-b16b-70cfeb8d81f8 req-39511287-f226-4e36-9a2f-758350b0800a service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received unexpected event network-vif-unplugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 for instance with vm_state active and task_state reboot_started.
Nov 09 03:56:26 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-da351b51-bf10-4d7b-8625-8d6a227b3119 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Instance shutdown successfully.
Nov 09 03:56:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-9b4027ac-c4a6-4c75-ac4e-29fe3fff53f6 req-40b9ce59-9e6a-4bf1-bd3e-70059831e2ef service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received event network-vif-plugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:56:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9b4027ac-c4a6-4c75-ac4e-29fe3fff53f6 req-40b9ce59-9e6a-4bf1-bd3e-70059831e2ef service nova] Acquiring lock "dad51975-3054-4265-866e-63b1fa778472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:56:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9b4027ac-c4a6-4c75-ac4e-29fe3fff53f6 req-40b9ce59-9e6a-4bf1-bd3e-70059831e2ef service nova] Lock "dad51975-3054-4265-866e-63b1fa778472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:56:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9b4027ac-c4a6-4c75-ac4e-29fe3fff53f6 req-40b9ce59-9e6a-4bf1-bd3e-70059831e2ef service nova] Lock "dad51975-3054-4265-866e-63b1fa778472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:56:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-9b4027ac-c4a6-4c75-ac4e-29fe3fff53f6 req-40b9ce59-9e6a-4bf1-bd3e-70059831e2ef service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] No waiting events found dispatching network-vif-plugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:56:27 user nova-compute[75378]: WARNING nova.compute.manager [req-9b4027ac-c4a6-4c75-ac4e-29fe3fff53f6 req-40b9ce59-9e6a-4bf1-bd3e-70059831e2ef service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received unexpected event network-vif-plugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 for instance with vm_state active and task_state reboot_started.
Nov 09 03:56:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-f50f95d7-3eb9-480b-9ff7-32a09f8bfb89 req-c630609e-3afa-4785-8b3d-2f438ccba09c service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received event network-vif-plugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:56:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f50f95d7-3eb9-480b-9ff7-32a09f8bfb89 req-c630609e-3afa-4785-8b3d-2f438ccba09c service nova] Acquiring lock "dad51975-3054-4265-866e-63b1fa778472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:56:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f50f95d7-3eb9-480b-9ff7-32a09f8bfb89 req-c630609e-3afa-4785-8b3d-2f438ccba09c service nova] Lock "dad51975-3054-4265-866e-63b1fa778472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:56:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f50f95d7-3eb9-480b-9ff7-32a09f8bfb89 req-c630609e-3afa-4785-8b3d-2f438ccba09c service nova] Lock "dad51975-3054-4265-866e-63b1fa778472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:56:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-f50f95d7-3eb9-480b-9ff7-32a09f8bfb89 req-c630609e-3afa-4785-8b3d-2f438ccba09c service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] No waiting events found dispatching network-vif-plugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:56:29 user nova-compute[75378]: WARNING nova.compute.manager [req-f50f95d7-3eb9-480b-9ff7-32a09f8bfb89 req-c630609e-3afa-4785-8b3d-2f438ccba09c service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received unexpected event network-vif-plugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 for instance with vm_state active and task_state reboot_started.
Nov 09 03:56:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-f50f95d7-3eb9-480b-9ff7-32a09f8bfb89 req-c630609e-3afa-4785-8b3d-2f438ccba09c service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received event network-vif-plugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:56:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f50f95d7-3eb9-480b-9ff7-32a09f8bfb89 req-c630609e-3afa-4785-8b3d-2f438ccba09c service nova] Acquiring lock "dad51975-3054-4265-866e-63b1fa778472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:56:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f50f95d7-3eb9-480b-9ff7-32a09f8bfb89 req-c630609e-3afa-4785-8b3d-2f438ccba09c service nova] Lock "dad51975-3054-4265-866e-63b1fa778472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:56:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f50f95d7-3eb9-480b-9ff7-32a09f8bfb89 req-c630609e-3afa-4785-8b3d-2f438ccba09c service nova] Lock "dad51975-3054-4265-866e-63b1fa778472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:56:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-f50f95d7-3eb9-480b-9ff7-32a09f8bfb89 req-c630609e-3afa-4785-8b3d-2f438ccba09c service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] No waiting events found dispatching network-vif-plugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:56:29 user nova-compute[75378]: WARNING nova.compute.manager [req-f50f95d7-3eb9-480b-9ff7-32a09f8bfb89 req-c630609e-3afa-4785-8b3d-2f438ccba09c service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received unexpected event network-vif-plugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 for instance with vm_state active and task_state reboot_started.
Nov 09 03:56:29 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: dad51975-3054-4265-866e-63b1fa778472] Instance running successfully.
Nov 09 03:56:29 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-da351b51-bf10-4d7b-8625-8d6a227b3119 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Instance soft rebooted successfully.
Nov 09 03:56:29 user nova-compute[75378]: DEBUG nova.compute.manager [None req-da351b51-bf10-4d7b-8625-8d6a227b3119 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:56:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-da351b51-bf10-4d7b-8625-8d6a227b3119 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "dad51975-3054-4265-866e-63b1fa778472" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.472s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:56:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:33 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:56:34 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:56:34 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:56:34 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Rebuilding the list of instances to heal {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 03:56:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-7d051405-6b57-4db2-9533-c2f4e87134d8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:56:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-7d051405-6b57-4db2-9533-c2f4e87134d8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:56:34 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 03:56:34 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lazy-loading 'info_cache' on Instance uuid 7d051405-6b57-4db2-9533-c2f4e87134d8 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:56:35 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Updating instance_info_cache with network_info: [{"id": "90598abb-8896-4b67-9871-b78f46b1fdfe", "address": "fa:16:3e:ed:1b:d3", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90598abb-88", "ovs_interfaceid": "90598abb-8896-4b67-9871-b78f46b1fdfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:56:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-7d051405-6b57-4db2-9533-c2f4e87134d8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:56:35 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 03:56:35 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:56:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:37 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:56:37 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:56:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:56:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:56:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:56:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:56:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:56:38 user nova-compute[75378]: INFO nova.compute.manager [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Terminating instance
Nov 09 03:56:38 user nova-compute[75378]: DEBUG nova.compute.manager [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:56:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:38 user nova-compute[75378]: DEBUG nova.compute.manager [req-ccfb552f-39e2-4117-8db5-60f74a66936a req-00132db1-3d0d-49de-b243-b76e9a8d93c4 service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Received event network-vif-unplugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:56:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ccfb552f-39e2-4117-8db5-60f74a66936a req-00132db1-3d0d-49de-b243-b76e9a8d93c4 service nova] Acquiring lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:56:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ccfb552f-39e2-4117-8db5-60f74a66936a req-00132db1-3d0d-49de-b243-b76e9a8d93c4 service nova] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:56:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ccfb552f-39e2-4117-8db5-60f74a66936a req-00132db1-3d0d-49de-b243-b76e9a8d93c4 service nova] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:56:38 user nova-compute[75378]: DEBUG nova.compute.manager [req-ccfb552f-39e2-4117-8db5-60f74a66936a req-00132db1-3d0d-49de-b243-b76e9a8d93c4 service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] No waiting events found dispatching network-vif-unplugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:56:38 user nova-compute[75378]: DEBUG nova.compute.manager [req-ccfb552f-39e2-4117-8db5-60f74a66936a req-00132db1-3d0d-49de-b243-b76e9a8d93c4 service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Received event network-vif-unplugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:56:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:56:39 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Instance destroyed successfully.
Nov 09 03:56:39 user nova-compute[75378]: DEBUG nova.objects.instance [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lazy-loading 'resources' on Instance uuid ed92e04a-56ec-42f1-bed3-8b28a37d1475 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T03:49:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1692964339',display_name='tempest-ServerActionsTestOtherA-server-1723417932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1692964339',id=26,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhe/OL3GXNicZULwBkt8Xad1DZCqYW1OnSvQiEJGYeRe8spVLTNCFMHzUuOG0YSKEEvn+VmZdKf+HgwcnEgeHc+Tl5vJDf5cNrLcH5ndE+P65ps69IZ1N9WZloB873P4Q==',key_name='tempest-keypair-1978093987',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:53:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='548993d280024b60b3778b026177e356',ramdisk_id='',reservation_id='r-fcsl00x6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2010465588',owner_user_name='tempest-ServerActionsTestOtherA-2010465588-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d4f0858695e4509a6b0ab99a8212571',uuid=ed92e04a-56ec-42f1-bed3-8b28a37d1475,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "address": "fa:16:3e:08:70:32", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0923686-86", "ovs_interfaceid": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converting VIF {"id": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "address": "fa:16:3e:08:70:32", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0923686-86", "ovs_interfaceid": "f0923686-86a8-4a1d-a8a9-f59a6aff0b13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:70:32,bridge_name='br-int',has_traffic_filtering=True,id=f0923686-86a8-4a1d-a8a9-f59a6aff0b13,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0923686-86') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG os_vif [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:70:32,bridge_name='br-int',has_traffic_filtering=True,id=f0923686-86a8-4a1d-a8a9-f59a6aff0b13,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0923686-86') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0923686-86, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9ede180-1963-4237-ba3b-fd14eca6b896) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:39 user nova-compute[75378]: INFO os_vif [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:70:32,bridge_name='br-int',has_traffic_filtering=True,id=f0923686-86a8-4a1d-a8a9-f59a6aff0b13,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0923686-86')
Nov 09 03:56:39 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Deleting instance files /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475_del
Nov 09 03:56:39 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Deletion of /opt/stack/data/nova/instances/ed92e04a-56ec-42f1-bed3-8b28a37d1475_del complete
Nov 09 03:56:39 user nova-compute[75378]: INFO nova.compute.manager [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 09 03:56:39 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:56:40 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Error from libvirt while getting description of instance-0000001a: [Error Code 42] Domain not found: no domain with matching uuid 'ed92e04a-56ec-42f1-bed3-8b28a37d1475' (instance-0000001a): libvirt.libvirtError: Domain not found: no domain with matching uuid 'ed92e04a-56ec-42f1-bed3-8b28a37d1475' (instance-0000001a)
Nov 09 03:56:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:40 user nova-compute[75378]: DEBUG nova.compute.manager [req-49bed2f1-ea9b-4b37-8466-67c211aff839 req-4ea440d0-59e5-49d4-8212-066197108e0a service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Received event network-vif-deleted-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:56:40 user nova-compute[75378]: INFO nova.compute.manager [req-49bed2f1-ea9b-4b37-8466-67c211aff839 req-4ea440d0-59e5-49d4-8212-066197108e0a service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Neutron deleted interface f0923686-86a8-4a1d-a8a9-f59a6aff0b13; detaching it from the instance and deleting it from the info cache
Nov 09 03:56:40 user nova-compute[75378]: DEBUG nova.network.neutron [req-49bed2f1-ea9b-4b37-8466-67c211aff839 req-4ea440d0-59e5-49d4-8212-066197108e0a service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:56:40 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:56:40 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Took 0.85 seconds to deallocate network for instance.
Nov 09 03:56:40 user nova-compute[75378]: DEBUG nova.compute.manager [req-49bed2f1-ea9b-4b37-8466-67c211aff839 req-4ea440d0-59e5-49d4-8212-066197108e0a service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Detach interface failed, port_id=f0923686-86a8-4a1d-a8a9-f59a6aff0b13, reason: Instance ed92e04a-56ec-42f1-bed3-8b28a37d1475 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 03:56:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:56:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:56:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:41 user nova-compute[75378]: DEBUG nova.compute.manager [req-000db3dc-0909-4d8b-9d47-8e1131f87c3b req-c113297f-e539-4694-b9b3-f8ab2d2158af service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Received event network-vif-plugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:56:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-000db3dc-0909-4d8b-9d47-8e1131f87c3b req-c113297f-e539-4694-b9b3-f8ab2d2158af service nova] Acquiring lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:56:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-000db3dc-0909-4d8b-9d47-8e1131f87c3b req-c113297f-e539-4694-b9b3-f8ab2d2158af service nova] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:56:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-000db3dc-0909-4d8b-9d47-8e1131f87c3b req-c113297f-e539-4694-b9b3-f8ab2d2158af service nova] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:56:41 user nova-compute[75378]: DEBUG nova.compute.manager [req-000db3dc-0909-4d8b-9d47-8e1131f87c3b req-c113297f-e539-4694-b9b3-f8ab2d2158af service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] No waiting events found dispatching network-vif-plugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:56:41 user nova-compute[75378]: WARNING nova.compute.manager [req-000db3dc-0909-4d8b-9d47-8e1131f87c3b req-c113297f-e539-4694-b9b3-f8ab2d2158af service nova] [instance: ed92e04a-56ec-42f1-bed3-8b28a37d1475] Received unexpected event network-vif-plugged-f0923686-86a8-4a1d-a8a9-f59a6aff0b13 for instance with vm_state deleted and task_state None.
Nov 09 03:56:41 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:56:41 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:56:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.511s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:56:41 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Deleted allocations for instance ed92e04a-56ec-42f1-bed3-8b28a37d1475
Nov 09 03:56:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dc427190-2413-4d51-ae9e-d29b94ff7302 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "ed92e04a-56ec-42f1-bed3-8b28a37d1475" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.690s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:56:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:56:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:56:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:56:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:56:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:56:43 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:56:43 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:56:43 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7685MB free_disk=25.064495086669922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:56:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:56:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:56:43 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7d051405-6b57-4db2-9533-c2f4e87134d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:56:43 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2c2acb48-972a-41d7-987e-48e79b3bef93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:56:43 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 013db901-fbee-4593-a14f-95a03e79fad0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:56:43 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 11f18164-9676-4a8a-91be-8bd87673ec5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:56:43 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c63e2993-88fd-447b-82b7-e1d2fcd8d7da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:56:43 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance dad51975-3054-4265-866e-63b1fa778472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:56:43 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9a841180-ac54-4c2a-9e82-4affb78d3fc9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:56:43 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 06799031-9998-4829-8725-09526681c442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:56:43 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:56:43 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:56:43 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:56:43 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:56:43 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:56:43 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:56:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:56:44 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:56:44 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:56:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:56 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:56:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:56:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:22 user nova-compute[75378]: INFO nova.compute.manager [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Detaching volume f9eb4ea7-b16d-4a99-9aaa-f58352774ba1
Nov 09 03:57:23 user nova-compute[75378]: INFO nova.virt.block_device [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Attempting to driver detach volume f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 from mountpoint /dev/vdb
Nov 09 03:57:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Attempting to detach device vdb from instance c63e2993-88fd-447b-82b7-e1d2fcd8d7da from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 03:57:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:57:23 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:57:23 user nova-compute[75378]:   <source dev="/dev/sde"/>
Nov 09 03:57:23 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:57:23 user nova-compute[75378]:   <serial>f9eb4ea7-b16d-4a99-9aaa-f58352774ba1</serial>
Nov 09 03:57:23 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 03:57:23 user nova-compute[75378]: </disk>
Nov 09 03:57:23 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:57:23 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Successfully detached device vdb from instance c63e2993-88fd-447b-82b7-e1d2fcd8d7da from the persistent domain config.
Nov 09 03:57:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c63e2993-88fd-447b-82b7-e1d2fcd8d7da from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 03:57:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:57:23 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:57:23 user nova-compute[75378]:   <source dev="/dev/sde"/>
Nov 09 03:57:23 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:57:23 user nova-compute[75378]:   <serial>f9eb4ea7-b16d-4a99-9aaa-f58352774ba1</serial>
Nov 09 03:57:23 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 03:57:23 user nova-compute[75378]: </disk>
Nov 09 03:57:23 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:57:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c63e2993-88fd-447b-82b7-e1d2fcd8d7da {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 03:57:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:28 user nova-compute[75378]: INFO nova.compute.manager [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Rescuing
Nov 09 03:57:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "refresh_cache-9a841180-ac54-4c2a-9e82-4affb78d3fc9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:57:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquired lock "refresh_cache-9a841180-ac54-4c2a-9e82-4affb78d3fc9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:57:28 user nova-compute[75378]: DEBUG nova.network.neutron [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:57:29 user nova-compute[75378]: DEBUG nova.network.neutron [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Updating instance_info_cache with network_info: [{"id": "04953f29-39ff-47d1-ba38-55faaa6369ce", "address": "fa:16:3e:7b:a8:05", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04953f29-39", "ovs_interfaceid": "04953f29-39ff-47d1-ba38-55faaa6369ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:57:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Releasing lock "refresh_cache-9a841180-ac54-4c2a-9e82-4affb78d3fc9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:57:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:57:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-b2a5d990-8b85-43a3-8613-20501f188b43 req-c545cc2a-48f9-4b9d-9f34-2800cbd378ea service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received event network-vif-unplugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:57:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b2a5d990-8b85-43a3-8613-20501f188b43 req-c545cc2a-48f9-4b9d-9f34-2800cbd378ea service nova] Acquiring lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b2a5d990-8b85-43a3-8613-20501f188b43 req-c545cc2a-48f9-4b9d-9f34-2800cbd378ea service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b2a5d990-8b85-43a3-8613-20501f188b43 req-c545cc2a-48f9-4b9d-9f34-2800cbd378ea service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-b2a5d990-8b85-43a3-8613-20501f188b43 req-c545cc2a-48f9-4b9d-9f34-2800cbd378ea service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] No waiting events found dispatching network-vif-unplugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:57:29 user nova-compute[75378]: WARNING nova.compute.manager [req-b2a5d990-8b85-43a3-8613-20501f188b43 req-c545cc2a-48f9-4b9d-9f34-2800cbd378ea service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received unexpected event network-vif-unplugged-04953f29-39ff-47d1-ba38-55faaa6369ce for instance with vm_state active and task_state rescuing.
Nov 09 03:57:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:30 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Instance destroyed successfully.
Nov 09 03:57:30 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Attempting a stable device rescue
Nov 09 03:57:30 user nova-compute[75378]: DEBUG nova.compute.manager [req-d8e757e3-190c-45e0-ae91-117bd49f3dd6 req-ac4cb730-0e94-4285-842f-404d64be0a2c service nova] [instance: 06799031-9998-4829-8725-09526681c442] Received event network-changed-037999da-478f-48ea-8d99-2c86b18842e8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:57:30 user nova-compute[75378]: DEBUG nova.compute.manager [req-d8e757e3-190c-45e0-ae91-117bd49f3dd6 req-ac4cb730-0e94-4285-842f-404d64be0a2c service nova] [instance: 06799031-9998-4829-8725-09526681c442] Refreshing instance network info cache due to event network-changed-037999da-478f-48ea-8d99-2c86b18842e8. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:57:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d8e757e3-190c-45e0-ae91-117bd49f3dd6 req-ac4cb730-0e94-4285-842f-404d64be0a2c service nova] Acquiring lock "refresh_cache-06799031-9998-4829-8725-09526681c442" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:57:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d8e757e3-190c-45e0-ae91-117bd49f3dd6 req-ac4cb730-0e94-4285-842f-404d64be0a2c service nova] Acquired lock "refresh_cache-06799031-9998-4829-8725-09526681c442" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:57:30 user nova-compute[75378]: DEBUG nova.network.neutron [req-d8e757e3-190c-45e0-ae91-117bd49f3dd6 req-ac4cb730-0e94-4285-842f-404d64be0a2c service nova] [instance: 06799031-9998-4829-8725-09526681c442] Refreshing network info cache for port 037999da-478f-48ea-8d99-2c86b18842e8 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:57:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75378) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 09 03:57:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Instance directory exists: not creating {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 03:57:30 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Creating image(s)
Nov 09 03:57:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a841180-ac54-4c2a-9e82-4affb78d3fc9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "/opt/stack/data/nova/instances/9a841180-ac54-4c2a-9e82-4affb78d3fc9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "/opt/stack/data/nova/instances/9a841180-ac54-4c2a-9e82-4affb78d3fc9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:30 user nova-compute[75378]: DEBUG nova.objects.instance [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9a841180-ac54-4c2a-9e82-4affb78d3fc9 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:57:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "d0b653d45eba3f0f4806dcb3e3c2dde64056dcfc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "d0b653d45eba3f0f4806dcb3e3c2dde64056dcfc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0b653d45eba3f0f4806dcb3e3c2dde64056dcfc.part --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0b653d45eba3f0f4806dcb3e3c2dde64056dcfc.part --force-share --output=json" returned: 0 in 0.231s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:31 user nova-compute[75378]: DEBUG nova.virt.images [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] 41c480be-97d6-456f-9db8-b96a93eb18dd was qcow2, converting to raw {{(pid=75378) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 03:57:31 user nova-compute[75378]: DEBUG nova.privsep.utils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75378) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 03:57:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d0b653d45eba3f0f4806dcb3e3c2dde64056dcfc.part /opt/stack/data/nova/instances/_base/d0b653d45eba3f0f4806dcb3e3c2dde64056dcfc.converted {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:31 user nova-compute[75378]: DEBUG nova.compute.manager [req-61253467-8064-4c3d-868c-32a3a7eec0eb req-63bbac5e-93f6-4190-85b8-58e02daeb585 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received event network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:57:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-61253467-8064-4c3d-868c-32a3a7eec0eb req-63bbac5e-93f6-4190-85b8-58e02daeb585 service nova] Acquiring lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-61253467-8064-4c3d-868c-32a3a7eec0eb req-63bbac5e-93f6-4190-85b8-58e02daeb585 service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-61253467-8064-4c3d-868c-32a3a7eec0eb req-63bbac5e-93f6-4190-85b8-58e02daeb585 service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:31 user nova-compute[75378]: DEBUG nova.compute.manager [req-61253467-8064-4c3d-868c-32a3a7eec0eb req-63bbac5e-93f6-4190-85b8-58e02daeb585 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] No waiting events found dispatching network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:57:31 user nova-compute[75378]: WARNING nova.compute.manager [req-61253467-8064-4c3d-868c-32a3a7eec0eb req-63bbac5e-93f6-4190-85b8-58e02daeb585 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received unexpected event network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce for instance with vm_state active and task_state rescuing.
Nov 09 03:57:32 user nova-compute[75378]: DEBUG nova.network.neutron [req-d8e757e3-190c-45e0-ae91-117bd49f3dd6 req-ac4cb730-0e94-4285-842f-404d64be0a2c service nova] [instance: 06799031-9998-4829-8725-09526681c442] Updated VIF entry in instance network info cache for port 037999da-478f-48ea-8d99-2c86b18842e8. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:57:32 user nova-compute[75378]: DEBUG nova.network.neutron [req-d8e757e3-190c-45e0-ae91-117bd49f3dd6 req-ac4cb730-0e94-4285-842f-404d64be0a2c service nova] [instance: 06799031-9998-4829-8725-09526681c442] Updating instance_info_cache with network_info: [{"id": "037999da-478f-48ea-8d99-2c86b18842e8", "address": "fa:16:3e:41:3b:05", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037999da-47", "ovs_interfaceid": "037999da-478f-48ea-8d99-2c86b18842e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:57:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d8e757e3-190c-45e0-ae91-117bd49f3dd6 req-ac4cb730-0e94-4285-842f-404d64be0a2c service nova] Releasing lock "refresh_cache-06799031-9998-4829-8725-09526681c442" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:57:32 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:57:32 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Cleaning up deleted instances {{(pid=75378) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 03:57:32 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] There are 0 instances to clean {{(pid=75378) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 03:57:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d0b653d45eba3f0f4806dcb3e3c2dde64056dcfc.part /opt/stack/data/nova/instances/_base/d0b653d45eba3f0f4806dcb3e3c2dde64056dcfc.converted" returned: 0 in 0.623s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0b653d45eba3f0f4806dcb3e3c2dde64056dcfc.converted --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0b653d45eba3f0f4806dcb3e3c2dde64056dcfc.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "d0b653d45eba3f0f4806dcb3e3c2dde64056dcfc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.287s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "d0b653d45eba3f0f4806dcb3e3c2dde64056dcfc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "d0b653d45eba3f0f4806dcb3e3c2dde64056dcfc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0b653d45eba3f0f4806dcb3e3c2dde64056dcfc --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0b653d45eba3f0f4806dcb3e3c2dde64056dcfc --force-share --output=json" returned: 0 in 0.185s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d0b653d45eba3f0f4806dcb3e3c2dde64056dcfc,backing_fmt=raw /opt/stack/data/nova/instances/9a841180-ac54-4c2a-9e82-4affb78d3fc9/disk.rescue {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d0b653d45eba3f0f4806dcb3e3c2dde64056dcfc,backing_fmt=raw /opt/stack/data/nova/instances/9a841180-ac54-4c2a-9e82-4affb78d3fc9/disk.rescue" returned: 0 in 0.059s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "d0b653d45eba3f0f4806dcb3e3c2dde64056dcfc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:32 user nova-compute[75378]: DEBUG nova.objects.instance [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'migration_context' on Instance uuid 9a841180-ac54-4c2a-9e82-4affb78d3fc9 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:57:32 user nova-compute[75378]: DEBUG nova.objects.base [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Object Instance<9a841180-ac54-4c2a-9e82-4affb78d3fc9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:57:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:57:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Start _get_guest_xml network_info=[{"id": "04953f29-39ff-47d1-ba38-55faaa6369ce", "address": "fa:16:3e:7b:a8:05", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "vif_mac": "fa:16:3e:7b:a8:05"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04953f29-39", "ovs_interfaceid": "04953f29-39ff-47d1-ba38-55faaa6369ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '41c480be-97d6-456f-9db8-b96a93eb18dd', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQFhmJSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '9a841180-ac54-4c2a-9e82-4affb78d3fc9', 'attached_at': '', 'detached_at': '', 'volume_id': '1afb52f3-a9af-40ce-9187-72f736022522', 'serial': '1afb52f3-a9af-40ce-9187-72f736022522'}, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': '2e185329-48c0-4d75-95a2-e4ff611294cb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:57:32 user nova-compute[75378]: DEBUG nova.objects.instance [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'resources' on Instance uuid 9a841180-ac54-4c2a-9e82-4affb78d3fc9 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.objects.base [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Object Instance<9a841180-ac54-4c2a-9e82-4affb78d3fc9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.objects.instance [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'numa_topology' on Instance uuid 9a841180-ac54-4c2a-9e82-4affb78d3fc9 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.objects.base [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Object Instance<9a841180-ac54-4c2a-9e82-4affb78d3fc9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:57:33 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:57:33 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.objects.instance [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9a841180-ac54-4c2a-9e82-4affb78d3fc9 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.objects.base [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Object Instance<9a841180-ac54-4c2a-9e82-4affb78d3fc9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQFhmJSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:57:33 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:57:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:57:33 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:57:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:57:33 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:57:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a787e0-4e67-4198-8083-f47107e98fd7]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = dQFhmJSy\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 09 03:57:33 user nova-compute[75378]: node.name = iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522
Nov 09 03:57:33 user nova-compute[75378]: node.tpgt = -1
Nov 09 03:57:33 user nova-compute[75378]: node.startup = automatic
Nov 09 03:57:33 user nova-compute[75378]: node.leading_login = No
Nov 09 03:57:33 user nova-compute[75378]: iface.iscsi_ifacename = default
Nov 09 03:57:33 user nova-compute[75378]: iface.net_ifacename = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.ipaddress = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.prefix_len = 0
Nov 09 03:57:33 user nova-compute[75378]: iface.hwaddress = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.transport_name = tcp
Nov 09 03:57:33 user nova-compute[75378]: iface.initiatorname = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.state = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.vlan_id = 0
Nov 09 03:57:33 user nova-compute[75378]: iface.vlan_priority = 0
Nov 09 03:57:33 user nova-compute[75378]: iface.vlan_state = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.iface_num = 0
Nov 09 03:57:33 user nova-compute[75378]: iface.mtu = 0
Nov 09 03:57:33 user nova-compute[75378]: iface.port = 0
Nov 09 03:57:33 user nova-compute[75378]: iface.bootproto = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.subnet_mask = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.gateway = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.dhcp_alt_client_id_state = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.dhcp_alt_client_id = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.dhcp_dns = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.dhcp_learn_iqn = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.dhcp_req_vendor_id_state = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.dhcp_vendor_id_state = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.dhcp_vendor_id = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.dhcp_slp_da = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.fragmentation = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.gratuitous_arp = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.incoming_forwarding = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.tos_state = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.tos = 0
Nov 09 03:57:33 user nova-compute[75378]: iface.ttl = 0
Nov 09 03:57:33 user nova-compute[75378]: iface.delayed_ack = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.tcp_nagle = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.tcp_wsf_state = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.tcp_wsf = 0
Nov 09 03:57:33 user nova-compute[75378]: iface.tcp_timer_scale = 0
Nov 09 03:57:33 user nova-compute[75378]: iface.tcp_timestamp = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.redirect = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.def_task_mgmt_timeout = 0
Nov 09 03:57:33 user nova-compute[75378]: iface.header_digest = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.data_digest = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.immediate_data = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.initial_r2t = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.data_seq_inorder = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.data_pdu_inorder = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.erl = 0
Nov 09 03:57:33 user nova-compute[75378]: iface.max_receive_data_len = 0
Nov 09 03:57:33 user nova-compute[75378]: iface.first_burst_len = 0
Nov 09 03:57:33 user nova-compute[75378]: iface.max_outstanding_r2t = 0
Nov 09 03:57:33 user nova-compute[75378]: iface.max_burst_len = 0
Nov 09 03:57:33 user nova-compute[75378]: iface.chap_auth = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.bidi_chap = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.strict_login_compliance = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.discovery_auth = <empty>
Nov 09 03:57:33 user nova-compute[75378]: iface.discovery_logout = <empty>
Nov 09 03:57:33 user nova-compute[75378]: node.discovery_address = <empty>
Nov 09 03:57:33 user nova-compute[75378]: node.discovery_port = 0
Nov 09 03:57:33 user nova-compute[75378]: node.discovery_type = static
Nov 09 03:57:33 user nova-compute[75378]: node.session.initial_cmdsn = 0
Nov 09 03:57:33 user nova-compute[75378]: node.session.initial_login_retry_max = 8
Nov 09 03:57:33 user nova-compute[75378]: node.session.xmit_thread_priority = -20
Nov 09 03:57:33 user nova-compute[75378]: node.session.cmds_max = 128
Nov 09 03:57:33 user nova-compute[75378]: node.session.queue_depth = 32
Nov 09 03:57:33 user nova-compute[75378]: node.session.nr_sessions = 1
Nov 09 03:57:33 user nova-compute[75378]: node.session.auth.authmethod = CHAP
Nov 09 03:57:33 user nova-compute[75378]: node.session.auth.username = dQFhmJSy
Nov 09 03:57:33 user nova-compute[75378]: node.session.auth.password = ***
Nov 09 03:57:33 user nova-compute[75378]: node.session.auth.username_in = <empty>
Nov 09 03:57:33 user nova-compute[75378]: node.session.auth.password_in = <empty>
Nov 09 03:57:33 user nova-compute[75378]: node.session.auth.chap_algs = MD5
Nov 09 03:57:33 user nova-compute[75378]: node.session.timeo.replacement_timeout = 120
Nov 09 03:57:33 user nova-compute[75378]: node.session.err_timeo.abort_timeout = 15
Nov 09 03:57:33 user nova-compute[75378]: node.session.err_timeo.lu_reset_timeout = 30
Nov 09 03:57:33 user nova-compute[75378]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 09 03:57:33 user nova-compute[75378]: node.session.err_timeo.host_reset_timeout = 60
Nov 09 03:57:33 user nova-compute[75378]: node.session.iscsi.FastAbort = Yes
Nov 09 03:57:33 user nova-compute[75378]: node.session.iscsi.InitialR2T = No
Nov 09 03:57:33 user nova-compute[75378]: node.session.iscsi.ImmediateData = Yes
Nov 09 03:57:33 user nova-compute[75378]: node.session.iscsi.FirstBurstLength = 262144
Nov 09 03:57:33 user nova-compute[75378]: node.session.iscsi.MaxBurstLength = 16776192
Nov 09 03:57:33 user nova-compute[75378]: node.session.iscsi.DefaultTime2Retain = 0
Nov 09 03:57:33 user nova-compute[75378]: node.session.iscsi.DefaultTime2Wait = 2
Nov 09 03:57:33 user nova-compute[75378]: node.session.iscsi.MaxConnections = 1
Nov 09 03:57:33 user nova-compute[75378]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 09 03:57:33 user nova-compute[75378]: node.session.iscsi.ERL = 0
Nov 09 03:57:33 user nova-compute[75378]: node.session.scan = manual
Nov 09 03:57:33 user nova-compute[75378]: node.session.reopen_max = 0
Nov 09 03:57:33 user nova-compute[75378]: node.conn[0].address = 172.16.0.220
Nov 09 03:57:33 user nova-compute[75378]: node.conn[0].port = 3260
Nov 09 03:57:33 user nova-compute[75378]: node.conn[0].startup = manual
Nov 09 03:57:33 user nova-compute[75378]: node.conn[0].tcp.window_size = 524288
Nov 09 03:57:33 user nova-compute[75378]: node.conn[0].tcp.type_of_service = 0
Nov 09 03:57:33 user nova-compute[75378]: node.conn[0].timeo.logout_timeout = 15
Nov 09 03:57:33 user nova-compute[75378]: node.conn[0].timeo.login_timeout = 15
Nov 09 03:57:33 user nova-compute[75378]: node.conn[0].timeo.auth_timeout = 45
Nov 09 03:57:33 user nova-compute[75378]: node.conn[0].timeo.noop_out_interval = 5
Nov 09 03:57:33 user nova-compute[75378]: node.conn[0].timeo.noop_out_timeout = 5
Nov 09 03:57:33 user nova-compute[75378]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 09 03:57:33 user nova-compute[75378]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 09 03:57:33 user nova-compute[75378]: node.conn[0].iscsi.HeaderDigest = None
Nov 09 03:57:33 user nova-compute[75378]: node.conn[0].iscsi.DataDigest = None
Nov 09 03:57:33 user nova-compute[75378]: node.conn[0].iscsi.IFMarker = No
Nov 09 03:57:33 user nova-compute[75378]: node.conn[0].iscsi.OFMarker = No
Nov 09 03:57:33 user nova-compute[75378]: # END RECORD
Nov 09 03:57:33 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc93676-7706-4a48-891d-3f4602b55600]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b1845e-57d4-4063-993d-a3138362d471]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQFhmJSy {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQFhmJSy" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc8c8fe-8c5e-47ba-9537-1435f0cbdda5]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dQFhmJSy'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebc19ff-4fb4-4b52-a004-c6b842f180dd]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5fc0b7-3df7-43a8-831d-c4734683f249]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:57:33 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:57:33 user nova-compute[75378]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 (non-flash)
Nov 09 03:57:33 user nova-compute[75378]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d (non-flash)
Nov 09 03:57:33 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:57:33 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:57:33 user nova-compute[75378]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 (non-flash)
Nov 09 03:57:33 user nova-compute[75378]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d (non-flash)
Nov 09 03:57:33 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.169s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] HCTL ('35', '0', '0', 0) found on session 33 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7c1fca-f81f-4940-a369-4ab72562f044]: (4, ('0 0 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Searching for a device in session 33 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQFhmJSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.202s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] <== connect_volume: return (204ms) {'type': 'block', 'scsi_wwn': '26637666139393537', 'path': '/dev/sdd'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637666139393537', 'path': '/dev/sdd'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:54:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2019851881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2019851881',id=32,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:55:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c2176531ffa4cf7bec818309e39ab8d',ramdisk_id='',reservation_id='r-6tm4rcnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:55:39Z,user_data=None,user_id='57efcfeacd7f4daf916e7dd04e11d8f2',uuid=9a841180-ac54-4c2a-9e82-4affb78d3fc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04953f29-39ff-47d1-ba38-55faaa6369ce", "address": "fa:16:3e:7b:a8:05", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "vif_mac": "fa:16:3e:7b:a8:05"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04953f29-39", "ovs_interfaceid": "04953f29-39ff-47d1-ba38-55faaa6369ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converting VIF {"id": "04953f29-39ff-47d1-ba38-55faaa6369ce", "address": "fa:16:3e:7b:a8:05", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "vif_mac": "fa:16:3e:7b:a8:05"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04953f29-39", "ovs_interfaceid": "04953f29-39ff-47d1-ba38-55faaa6369ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:a8:05,bridge_name='br-int',has_traffic_filtering=True,id=04953f29-39ff-47d1-ba38-55faaa6369ce,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04953f29-39') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.objects.instance [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a841180-ac54-4c2a-9e82-4affb78d3fc9 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.objects.base [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Object Instance<9a841180-ac54-4c2a-9e82-4affb78d3fc9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:57:33 user nova-compute[75378]:   <uuid>9a841180-ac54-4c2a-9e82-4affb78d3fc9</uuid>
Nov 09 03:57:33 user nova-compute[75378]:   <name>instance-00000020</name>
Nov 09 03:57:33 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:57:33 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:57:33 user nova-compute[75378]:   <metadata>
Nov 09 03:57:33 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:57:33 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:57:33 user nova-compute[75378]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2019851881</nova:name>
Nov 09 03:57:33 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:57:33</nova:creationTime>
Nov 09 03:57:33 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:57:33 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:57:33 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:57:33 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:57:33 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:57:33 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:57:33 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:57:33 user nova-compute[75378]:       <nova:owner>
Nov 09 03:57:33 user nova-compute[75378]:         <nova:user uuid="57efcfeacd7f4daf916e7dd04e11d8f2">tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member</nova:user>
Nov 09 03:57:33 user nova-compute[75378]:         <nova:project uuid="4c2176531ffa4cf7bec818309e39ab8d">tempest-ServerBootFromVolumeStableRescueTest-1679422577</nova:project>
Nov 09 03:57:33 user nova-compute[75378]:       </nova:owner>
Nov 09 03:57:33 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:57:33 user nova-compute[75378]:       <nova:ports>
Nov 09 03:57:33 user nova-compute[75378]:         <nova:port uuid="04953f29-39ff-47d1-ba38-55faaa6369ce">
Nov 09 03:57:33 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 03:57:33 user nova-compute[75378]:         </nova:port>
Nov 09 03:57:33 user nova-compute[75378]:       </nova:ports>
Nov 09 03:57:33 user nova-compute[75378]:     </nova:instance>
Nov 09 03:57:33 user nova-compute[75378]:   </metadata>
Nov 09 03:57:33 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:57:33 user nova-compute[75378]:     <system>
Nov 09 03:57:33 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:57:33 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:57:33 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:57:33 user nova-compute[75378]:       <entry name="serial">9a841180-ac54-4c2a-9e82-4affb78d3fc9</entry>
Nov 09 03:57:33 user nova-compute[75378]:       <entry name="uuid">9a841180-ac54-4c2a-9e82-4affb78d3fc9</entry>
Nov 09 03:57:33 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:57:33 user nova-compute[75378]:     </system>
Nov 09 03:57:33 user nova-compute[75378]:   </sysinfo>
Nov 09 03:57:33 user nova-compute[75378]:   <os>
Nov 09 03:57:33 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:57:33 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:57:33 user nova-compute[75378]:   </os>
Nov 09 03:57:33 user nova-compute[75378]:   <features>
Nov 09 03:57:33 user nova-compute[75378]:     <acpi/>
Nov 09 03:57:33 user nova-compute[75378]:     <apic/>
Nov 09 03:57:33 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:57:33 user nova-compute[75378]:   </features>
Nov 09 03:57:33 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:57:33 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:57:33 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:57:33 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:57:33 user nova-compute[75378]:   </clock>
Nov 09 03:57:33 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:57:33 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:57:33 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:57:33 user nova-compute[75378]:   </cpu>
Nov 09 03:57:33 user nova-compute[75378]:   <devices>
Nov 09 03:57:33 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 03:57:33 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:57:33 user nova-compute[75378]:       <source dev="/dev/sdd"/>
Nov 09 03:57:33 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:57:33 user nova-compute[75378]:       <serial>1afb52f3-a9af-40ce-9187-72f736022522</serial>
Nov 09 03:57:33 user nova-compute[75378]:     </disk>
Nov 09 03:57:33 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:57:33 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:57:33 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/9a841180-ac54-4c2a-9e82-4affb78d3fc9/disk.rescue"/>
Nov 09 03:57:33 user nova-compute[75378]:       <target dev="vdb" bus="virtio"/>
Nov 09 03:57:33 user nova-compute[75378]:       <boot order="1"/>
Nov 09 03:57:33 user nova-compute[75378]:     </disk>
Nov 09 03:57:33 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:57:33 user nova-compute[75378]:       <mac address="fa:16:3e:7b:a8:05"/>
Nov 09 03:57:33 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:57:33 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:57:33 user nova-compute[75378]:       <target dev="tap04953f29-39"/>
Nov 09 03:57:33 user nova-compute[75378]:     </interface>
Nov 09 03:57:33 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:57:33 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/9a841180-ac54-4c2a-9e82-4affb78d3fc9/console.log" append="off"/>
Nov 09 03:57:33 user nova-compute[75378]:     </serial>
Nov 09 03:57:33 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:57:33 user nova-compute[75378]:     <video>
Nov 09 03:57:33 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:57:33 user nova-compute[75378]:     </video>
Nov 09 03:57:33 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:57:33 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:57:33 user nova-compute[75378]:     </rng>
Nov 09 03:57:33 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:57:33 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:57:33 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:57:33 user nova-compute[75378]:     </memballoon>
Nov 09 03:57:33 user nova-compute[75378]:   </devices>
Nov 09 03:57:33 user nova-compute[75378]: </domain>
Nov 09 03:57:33 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:57:33 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Instance destroyed successfully.
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:57:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] No VIF found with MAC fa:16:3e:7b:a8:05, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:57:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:35 user nova-compute[75378]: DEBUG nova.compute.manager [req-9a10fa97-a65c-4eb7-9428-6a959a2e5672 req-0cdf0a14-16e1-417e-9101-d5b952fce2a3 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received event network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:57:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9a10fa97-a65c-4eb7-9428-6a959a2e5672 req-0cdf0a14-16e1-417e-9101-d5b952fce2a3 service nova] Acquiring lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9a10fa97-a65c-4eb7-9428-6a959a2e5672 req-0cdf0a14-16e1-417e-9101-d5b952fce2a3 service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9a10fa97-a65c-4eb7-9428-6a959a2e5672 req-0cdf0a14-16e1-417e-9101-d5b952fce2a3 service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:35 user nova-compute[75378]: DEBUG nova.compute.manager [req-9a10fa97-a65c-4eb7-9428-6a959a2e5672 req-0cdf0a14-16e1-417e-9101-d5b952fce2a3 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] No waiting events found dispatching network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:57:35 user nova-compute[75378]: WARNING nova.compute.manager [req-9a10fa97-a65c-4eb7-9428-6a959a2e5672 req-0cdf0a14-16e1-417e-9101-d5b952fce2a3 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received unexpected event network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce for instance with vm_state active and task_state rescuing.
Nov 09 03:57:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:35 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:57:35 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:57:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-2c2acb48-972a-41d7-987e-48e79b3bef93" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:57:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-2c2acb48-972a-41d7-987e-48e79b3bef93" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:57:35 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 03:57:35 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Updating instance_info_cache with network_info: [{"id": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "address": "fa:16:3e:02:bc:fb", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d7d7ee-d1", "ovs_interfaceid": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:57:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-2c2acb48-972a-41d7-987e-48e79b3bef93" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:57:35 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 03:57:35 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:57:36 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:57:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG nova.compute.manager [req-cf19fe67-6607-44dd-a316-9c39014855e6 req-856f3361-417c-4858-afaf-92eeb43914cf service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received event network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cf19fe67-6607-44dd-a316-9c39014855e6 req-856f3361-417c-4858-afaf-92eeb43914cf service nova] Acquiring lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cf19fe67-6607-44dd-a316-9c39014855e6 req-856f3361-417c-4858-afaf-92eeb43914cf service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cf19fe67-6607-44dd-a316-9c39014855e6 req-856f3361-417c-4858-afaf-92eeb43914cf service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG nova.compute.manager [req-cf19fe67-6607-44dd-a316-9c39014855e6 req-856f3361-417c-4858-afaf-92eeb43914cf service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] No waiting events found dispatching network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:57:37 user nova-compute[75378]: WARNING nova.compute.manager [req-cf19fe67-6607-44dd-a316-9c39014855e6 req-856f3361-417c-4858-afaf-92eeb43914cf service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received unexpected event network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce for instance with vm_state active and task_state rescuing.
Nov 09 03:57:37 user nova-compute[75378]: DEBUG nova.compute.manager [None req-0cba5dba-fd44-4d04-84ef-253ac3535f97 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "06799031-9998-4829-8725-09526681c442" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "06799031-9998-4829-8725-09526681c442" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG nova.objects.instance [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lazy-loading 'flavor' on Instance uuid 06799031-9998-4829-8725-09526681c442 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "06799031-9998-4829-8725-09526681c442" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "06799031-9998-4829-8725-09526681c442" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "06799031-9998-4829-8725-09526681c442" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:37 user nova-compute[75378]: INFO nova.compute.manager [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Attaching volume 7f29cbb5-01fa-4fc0-a79f-8716980ba171 to /dev/vdb
Nov 09 03:57:37 user nova-compute[75378]: DEBUG os_brick.utils [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[89faf507-cbaa-4198-bc16-ebd3856c7b65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e302c29e-c257-48e0-9adf-e1ee0f11e9ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b68c56c-d662-4429-b7e3-3f817ca32551]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a252232e-0109-4a8c-a65d-ad2ba89d708c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:57:37 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:57:37 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f2a12a-803d-4670-9218-e947a6209498]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG os_brick.utils [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:57:37 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Updating existing volume attachment record: a7be039b-c8fe-48fc-94a7-ce99208c2ff9 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:57:38 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:57:38 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:57:39 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:57:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:40 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:57:41 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:57:41 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:57:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:41 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:57:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a841180-ac54-4c2a-9e82-4affb78d3fc9/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a841180-ac54-4c2a-9e82-4affb78d3fc9/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a841180-ac54-4c2a-9e82-4affb78d3fc9/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a841180-ac54-4c2a-9e82-4affb78d3fc9/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:43 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c63e2993-88fd-447b-82b7-e1d2fcd8d7da is timed out.
Nov 09 03:57:43 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Successfully detached device vdb from instance c63e2993-88fd-447b-82b7-e1d2fcd8d7da from the live domain config.
Nov 09 03:57:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTRnNyVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:57:43 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:57:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ff89c1-b57b-4479-a9d9-919aaacaeb18]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:57:43 user nova-compute[75378]: No targets found.
Nov 09 03:57:43 user nova-compute[75378]: iSNS:
Nov 09 03:57:43 user nova-compute[75378]: No targets found.
Nov 09 03:57:43 user nova-compute[75378]: STATIC:
Nov 09 03:57:43 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1
Nov 09 03:57:43 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:57:43 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:57:43 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d
Nov 09 03:57:43 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:57:43 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:57:43 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 03:57:43 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:57:43 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:57:43 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522
Nov 09 03:57:43 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:57:43 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:57:43 user nova-compute[75378]: FIRMWARE:
Nov 09 03:57:43 user nova-compute[75378]: No targets found.
Nov 09 03:57:43 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:57:43 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:57:43 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[18745c8f-16d8-4141-82c9-9299eeaea3bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c183551-f2e4-43d8-afa9-bd386d8627f7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:57:43 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:57:43 user nova-compute[75378]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 (non-flash)
Nov 09 03:57:43 user nova-compute[75378]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d (non-flash)
Nov 09 03:57:43 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:57:43 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:57:43 user nova-compute[75378]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 (non-flash)
Nov 09 03:57:43 user nova-compute[75378]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d (non-flash)
Nov 09 03:57:43 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3b044e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1'): ({'sde'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Removing single pathed devices sde {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c35048-1aca-4115-be31-3d3c7657f21b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c630277-f0bf-47a2-a3dc-5090e595c9fb]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Flushing IO for device /dev/sde {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[86544da0-e19b-4c62-99e1-8897a489206b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8d53f6-56b2-4b5a-9c2d-8f38264625d5]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] SCSI volumes sde have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35c8027-8c9d-42bd-b83a-b0b61d871870]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[81345496-7863-43d8-8dba-915d9b0fcbb7]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1, portal: 172.16.0.220,3260]
Nov 09 03:57:44 user nova-compute[75378]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1, portal: 172.16.0.220,3260] successful.
Nov 09 03:57:44 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cadea9-0795-4653-97fc-81ed6877e906]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.469s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] <== disconnect_volume: return (471ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:45 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:57:45 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:57:45 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7850MB free_disk=24.99285888671875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG nova.objects.instance [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lazy-loading 'flavor' on Instance uuid c63e2993-88fd-447b-82b7-e1d2fcd8d7da {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-92228ee5-7ee9-4b88-a14a-0ce74439ab3e tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.510s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.269s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:45 user nova-compute[75378]: INFO nova.compute.manager [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Terminating instance
Nov 09 03:57:45 user nova-compute[75378]: DEBUG nova.compute.manager [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7d051405-6b57-4db2-9533-c2f4e87134d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2c2acb48-972a-41d7-987e-48e79b3bef93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 013db901-fbee-4593-a14f-95a03e79fad0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 11f18164-9676-4a8a-91be-8bd87673ec5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance c63e2993-88fd-447b-82b7-e1d2fcd8d7da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance dad51975-3054-4265-866e-63b1fa778472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9a841180-ac54-4c2a-9e82-4affb78d3fc9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 06799031-9998-4829-8725-09526681c442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing inventories for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Updating ProviderTree inventory for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Updating inventory in ProviderTree for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 03:57:45 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing aggregate associations for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8, aggregates: None {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-25ebdb40-ce6e-4034-9646-0b43e8ad624a req-1a27ba68-279a-48c5-8e7d-4454c79f4af9 service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Received event network-vif-unplugged-02b1dc3d-7065-4313-898c-0cf171da746a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-25ebdb40-ce6e-4034-9646-0b43e8ad624a req-1a27ba68-279a-48c5-8e7d-4454c79f4af9 service nova] Acquiring lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-25ebdb40-ce6e-4034-9646-0b43e8ad624a req-1a27ba68-279a-48c5-8e7d-4454c79f4af9 service nova] Lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-25ebdb40-ce6e-4034-9646-0b43e8ad624a req-1a27ba68-279a-48c5-8e7d-4454c79f4af9 service nova] Lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-25ebdb40-ce6e-4034-9646-0b43e8ad624a req-1a27ba68-279a-48c5-8e7d-4454c79f4af9 service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] No waiting events found dispatching network-vif-unplugged-02b1dc3d-7065-4313-898c-0cf171da746a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-25ebdb40-ce6e-4034-9646-0b43e8ad624a req-1a27ba68-279a-48c5-8e7d-4454c79f4af9 service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Received event network-vif-unplugged-02b1dc3d-7065-4313-898c-0cf171da746a for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing trait associations for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8, traits: HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:46 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Instance destroyed successfully.
Nov 09 03:57:46 user nova-compute[75378]: DEBUG nova.objects.instance [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lazy-loading 'resources' on Instance uuid c63e2993-88fd-447b-82b7-e1d2fcd8d7da {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1615970580',display_name='tempest-VolumesSnapshotTestJSON-instance-1615970580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1615970580',id=30,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIrRjGV/tZcW85MWznr84qH4O3jQrxBAKYOH4WfPBXxATGXlPvh5HVGj/JjyDDAaD+KHqdRKp4QCEaK7HfeZSRarebu6Pis6rTyPzT1Ezc9+a6wY58qN7PV/PCHBjaJYg==',key_name='tempest-keypair-822910912',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:53:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='294bd41e27d9485f845906fed03ba98e',ramdisk_id='',reservation_id='r-7b0vlj8n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1705070970',owner_user_name='tempest-VolumesSnapshotTestJSON-1705070970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e20cee1117e645709251b4b5a6ccb075',uuid=c63e2993-88fd-447b-82b7-e1d2fcd8d7da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02b1dc3d-7065-4313-898c-0cf171da746a", "address": "fa:16:3e:e1:1d:ed", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b1dc3d-70", "ovs_interfaceid": "02b1dc3d-7065-4313-898c-0cf171da746a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Converting VIF {"id": "02b1dc3d-7065-4313-898c-0cf171da746a", "address": "fa:16:3e:e1:1d:ed", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02b1dc3d-70", "ovs_interfaceid": "02b1dc3d-7065-4313-898c-0cf171da746a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:1d:ed,bridge_name='br-int',has_traffic_filtering=True,id=02b1dc3d-7065-4313-898c-0cf171da746a,network=Network(0a93a88f-39de-4b68-9674-7ed7dfe24759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02b1dc3d-70') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG os_vif [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:1d:ed,bridge_name='br-int',has_traffic_filtering=True,id=02b1dc3d-7065-4313-898c-0cf171da746a,network=Network(0a93a88f-39de-4b68-9674-7ed7dfe24759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02b1dc3d-70') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02b1dc3d-70, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a78ad41-1047-4cc8-a5e1-f3f467417e7a) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:46 user nova-compute[75378]: INFO os_vif [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:1d:ed,bridge_name='br-int',has_traffic_filtering=True,id=02b1dc3d-7065-4313-898c-0cf171da746a,network=Network(0a93a88f-39de-4b68-9674-7ed7dfe24759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02b1dc3d-70')
Nov 09 03:57:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zTRnNyVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:57:46 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:57:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e18ab11-adc7-4418-97fc-dde330ba7b51]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:57:46 user nova-compute[75378]: No targets found.
Nov 09 03:57:46 user nova-compute[75378]: iSNS:
Nov 09 03:57:46 user nova-compute[75378]: No targets found.
Nov 09 03:57:46 user nova-compute[75378]: STATIC:
Nov 09 03:57:46 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d
Nov 09 03:57:46 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:57:46 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:57:46 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 03:57:46 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:57:46 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:57:46 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522
Nov 09 03:57:46 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:57:46 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:57:46 user nova-compute[75378]: FIRMWARE:
Nov 09 03:57:46 user nova-compute[75378]: No targets found.
Nov 09 03:57:46 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:57:46 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:57:46 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9eb4ea7-b16d-4a99-9aaa-f58352774ba1', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50cc54b-654d-41fc-aa60-318a4618516d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.161s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[789df2ac-dffb-4ecc-a723-c41a31d462c7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:57:46 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:57:46 user nova-compute[75378]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d (non-flash)
Nov 09 03:57:46 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:57:46 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:57:46 user nova-compute[75378]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d (non-flash)
Nov 09 03:57:46 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c5f2290>, {}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Disconnecting from: [] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.111s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] <== disconnect_volume: return (113ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:57:46 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Deleting instance files /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da_del
Nov 09 03:57:46 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Deletion of /opt/stack/data/nova/instances/c63e2993-88fd-447b-82b7-e1d2fcd8d7da_del complete
Nov 09 03:57:46 user nova-compute[75378]: INFO nova.compute.manager [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 09 03:57:46 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:57:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:47 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:57:47 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Took 1.01 seconds to deallocate network for instance.
Nov 09 03:57:47 user nova-compute[75378]: WARNING nova.volume.cinder [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Attachment 3c3973d9-c0cf-40f9-b29d-bc320af56a86 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3c3973d9-c0cf-40f9-b29d-bc320af56a86. (HTTP 404) (Request-ID: req-5441aa7d-ccd4-47ab-9b0a-4b34287b7a7d)
Nov 09 03:57:47 user nova-compute[75378]: INFO nova.compute.manager [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Took 0.05 seconds to detach 1 volumes for instance.
Nov 09 03:57:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG nova.compute.manager [req-22731523-08da-4c58-8118-027ceb3af573 req-0ccb1cfe-159e-4095-b0d1-68b83e0c06d4 service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Received event network-vif-plugged-02b1dc3d-7065-4313-898c-0cf171da746a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-22731523-08da-4c58-8118-027ceb3af573 req-0ccb1cfe-159e-4095-b0d1-68b83e0c06d4 service nova] Acquiring lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-22731523-08da-4c58-8118-027ceb3af573 req-0ccb1cfe-159e-4095-b0d1-68b83e0c06d4 service nova] Lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-22731523-08da-4c58-8118-027ceb3af573 req-0ccb1cfe-159e-4095-b0d1-68b83e0c06d4 service nova] Lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG nova.compute.manager [req-22731523-08da-4c58-8118-027ceb3af573 req-0ccb1cfe-159e-4095-b0d1-68b83e0c06d4 service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] No waiting events found dispatching network-vif-plugged-02b1dc3d-7065-4313-898c-0cf171da746a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:57:48 user nova-compute[75378]: WARNING nova.compute.manager [req-22731523-08da-4c58-8118-027ceb3af573 req-0ccb1cfe-159e-4095-b0d1-68b83e0c06d4 service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Received unexpected event network-vif-plugged-02b1dc3d-7065-4313-898c-0cf171da746a for instance with vm_state deleted and task_state None.
Nov 09 03:57:48 user nova-compute[75378]: DEBUG nova.compute.manager [req-22731523-08da-4c58-8118-027ceb3af573 req-0ccb1cfe-159e-4095-b0d1-68b83e0c06d4 service nova] [instance: c63e2993-88fd-447b-82b7-e1d2fcd8d7da] Received event network-vif-deleted-02b1dc3d-7065-4313-898c-0cf171da746a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:48 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Deleted allocations for instance c63e2993-88fd-447b-82b7-e1d2fcd8d7da
Nov 09 03:57:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Acquiring lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Acquiring lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:48 user nova-compute[75378]: INFO nova.compute.manager [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Terminating instance
Nov 09 03:57:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c0ace716-5c2c-48ff-87af-2b722c7d34b6 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "c63e2993-88fd-447b-82b7-e1d2fcd8d7da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.908s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:48 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Instance destroyed successfully.
Nov 09 03:57:48 user nova-compute[75378]: DEBUG nova.objects.instance [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lazy-loading 'resources' on Instance uuid 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1660193592',display_name='tempest-VolumesActionsTest-instance-1660193592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1660193592',id=34,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:56:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b4984a96b0a47cba8fa82f19c985e50',ramdisk_id='',reservation_id='r-sl60ravp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-650140927',owner_user_name='tempest-VolumesActionsTest-650140927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:56:04Z,user_data=None,user_id='1681626725044d1cba836a92d5fe3827',uuid=5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d8c1e56-cb99-46c4-9452-ae66293d6d34", "address": "fa:16:3e:e8:5c:92", "network": {"id": "c24e97e2-0bda-4032-839f-897e81cb118e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1098129296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b4984a96b0a47cba8fa82f19c985e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8c1e56-cb", "ovs_interfaceid": "4d8c1e56-cb99-46c4-9452-ae66293d6d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Converting VIF {"id": "4d8c1e56-cb99-46c4-9452-ae66293d6d34", "address": "fa:16:3e:e8:5c:92", "network": {"id": "c24e97e2-0bda-4032-839f-897e81cb118e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1098129296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b4984a96b0a47cba8fa82f19c985e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8c1e56-cb", "ovs_interfaceid": "4d8c1e56-cb99-46c4-9452-ae66293d6d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:57:48 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:5c:92,bridge_name='br-int',has_traffic_filtering=True,id=4d8c1e56-cb99-46c4-9452-ae66293d6d34,network=Network(c24e97e2-0bda-4032-839f-897e81cb118e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8c1e56-cb') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:57:49 user nova-compute[75378]: DEBUG os_vif [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:5c:92,bridge_name='br-int',has_traffic_filtering=True,id=4d8c1e56-cb99-46c4-9452-ae66293d6d34,network=Network(c24e97e2-0bda-4032-839f-897e81cb118e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8c1e56-cb') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:57:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d8c1e56-cb, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:57:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:57:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cf5adf6-2fad-4a30-9fd0-bd841936c9ac) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:57:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:49 user nova-compute[75378]: INFO os_vif [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:5c:92,bridge_name='br-int',has_traffic_filtering=True,id=4d8c1e56-cb99-46c4-9452-ae66293d6d34,network=Network(c24e97e2-0bda-4032-839f-897e81cb118e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8c1e56-cb')
Nov 09 03:57:49 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Deleting instance files /opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7_del
Nov 09 03:57:49 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Deletion of /opt/stack/data/nova/instances/5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7_del complete
Nov 09 03:57:49 user nova-compute[75378]: INFO nova.compute.manager [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 09 03:57:49 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:57:49 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:57:49 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:57:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:57:50 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Took 0.88 seconds to deallocate network for instance.
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Received event network-vif-unplugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] Acquiring lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] No waiting events found dispatching network-vif-unplugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:57:50 user nova-compute[75378]: WARNING nova.compute.manager [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Received unexpected event network-vif-unplugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 for instance with vm_state deleted and task_state None.
Nov 09 03:57:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Received event network-vif-plugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] Acquiring lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] No waiting events found dispatching network-vif-plugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:57:50 user nova-compute[75378]: WARNING nova.compute.manager [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Received unexpected event network-vif-plugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 for instance with vm_state deleted and task_state None.
Nov 09 03:57:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Received event network-vif-plugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] Acquiring lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] No waiting events found dispatching network-vif-plugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:57:50 user nova-compute[75378]: WARNING nova.compute.manager [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Received unexpected event network-vif-plugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 for instance with vm_state deleted and task_state None.
Nov 09 03:57:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Received event network-vif-plugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] Acquiring lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] No waiting events found dispatching network-vif-plugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:57:50 user nova-compute[75378]: WARNING nova.compute.manager [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Received unexpected event network-vif-plugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 for instance with vm_state deleted and task_state None.
Nov 09 03:57:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Received event network-vif-unplugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] Acquiring lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] No waiting events found dispatching network-vif-unplugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:57:50 user nova-compute[75378]: WARNING nova.compute.manager [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Received unexpected event network-vif-unplugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 for instance with vm_state deleted and task_state None.
Nov 09 03:57:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Received event network-vif-plugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] Acquiring lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] No waiting events found dispatching network-vif-plugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:57:50 user nova-compute[75378]: WARNING nova.compute.manager [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Received unexpected event network-vif-plugged-4d8c1e56-cb99-46c4-9452-ae66293d6d34 for instance with vm_state deleted and task_state None.
Nov 09 03:57:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-3a4067b2-8727-4dfd-beb4-56937e399532 req-6042847d-4521-404d-94e2-491c0652f22a service nova] [instance: 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7] Received event network-vif-deleted-4d8c1e56-cb99-46c4-9452-ae66293d6d34 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:50 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Deleted allocations for instance 5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7
Nov 09 03:57:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9a695c49-1abe-4500-ae76-9b593e08a8b3 tempest-VolumesActionsTest-650140927 tempest-VolumesActionsTest-650140927-project-member] Lock "5d36bb05-f4fc-470d-ac65-e6ba55b3b4d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.299s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquiring lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:56 user nova-compute[75378]: DEBUG nova.compute.manager [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:57:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:56 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:57:56 user nova-compute[75378]: INFO nova.compute.claims [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Claim successful on node user
Nov 09 03:57:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:57 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:57:57 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:57:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:57 user nova-compute[75378]: DEBUG nova.compute.manager [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:57:57 user nova-compute[75378]: DEBUG nova.compute.manager [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:57:57 user nova-compute[75378]: DEBUG nova.network.neutron [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:57:57 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:57:57 user nova-compute[75378]: DEBUG nova.compute.manager [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:57:57 user nova-compute[75378]: DEBUG nova.policy [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9656d7c2a654cfbb156aebf1c69fc3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d99bb19e6343af92da922122e2a440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:57:57 user nova-compute[75378]: DEBUG nova.compute.manager [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:57:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:57:57 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Creating image(s)
Nov 09 03:57:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "/opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "/opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.228s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.286s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk 1073741824" returned: 0 in 0.077s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.372s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:58 user nova-compute[75378]: DEBUG nova.network.neutron [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Successfully created port: fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:57:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.277s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:58 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:57:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:57:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:57:58 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Cannot resize image /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:57:58 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:57:58 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Ensure instance console log exists: /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:57:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:57:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:57:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75378) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.network.neutron [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Successfully updated port: fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquiring lock "refresh_cache-eb8117df-cf63-4bc9-9691-4828ff7f5a8e" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquired lock "refresh_cache-eb8117df-cf63-4bc9-9691-4828ff7f5a8e" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.network.neutron [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-5e0d6829-ba17-415b-9609-3daefdbbcdeb req-7c177e76-31bc-45ec-88f3-eedd7fb53434 service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Received event network-changed-fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-5e0d6829-ba17-415b-9609-3daefdbbcdeb req-7c177e76-31bc-45ec-88f3-eedd7fb53434 service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Refreshing instance network info cache due to event network-changed-fb8b1969-9e49-47a4-a528-43c6673bd63d. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5e0d6829-ba17-415b-9609-3daefdbbcdeb req-7c177e76-31bc-45ec-88f3-eedd7fb53434 service nova] Acquiring lock "refresh_cache-eb8117df-cf63-4bc9-9691-4828ff7f5a8e" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.network.neutron [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.network.neutron [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Updating instance_info_cache with network_info: [{"id": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "address": "fa:16:3e:5b:d9:0b", "network": {"id": "45fb3f32-bd04-41a3-bbf0-0d85276e8495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1831642379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52d99bb19e6343af92da922122e2a440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8b1969-9e", "ovs_interfaceid": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Releasing lock "refresh_cache-eb8117df-cf63-4bc9-9691-4828ff7f5a8e" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Instance network_info: |[{"id": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "address": "fa:16:3e:5b:d9:0b", "network": {"id": "45fb3f32-bd04-41a3-bbf0-0d85276e8495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1831642379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52d99bb19e6343af92da922122e2a440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8b1969-9e", "ovs_interfaceid": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5e0d6829-ba17-415b-9609-3daefdbbcdeb req-7c177e76-31bc-45ec-88f3-eedd7fb53434 service nova] Acquired lock "refresh_cache-eb8117df-cf63-4bc9-9691-4828ff7f5a8e" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.network.neutron [req-5e0d6829-ba17-415b-9609-3daefdbbcdeb req-7c177e76-31bc-45ec-88f3-eedd7fb53434 service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Refreshing network info cache for port fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Start _get_guest_xml network_info=[{"id": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "address": "fa:16:3e:5b:d9:0b", "network": {"id": "45fb3f32-bd04-41a3-bbf0-0d85276e8495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1831642379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52d99bb19e6343af92da922122e2a440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8b1969-9e", "ovs_interfaceid": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:57:59 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:57:59 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:57:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-492873150',display_name='tempest-TestServerVolumeAttachmentScenario-server-492873150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-492873150',id=35,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8v4TOeuCX3JxKCmIDwWB7PrtGuDTnKc7Ba5YKPUKZb6kmeJMQSkseFsZy8ewmy3BelALwGirxlOK5xvpXphkaxfHiTI/GjoACZFJAKPKNouONzKDoWshQrNyiKsgj/Pg==',key_name='tempest-keypair-603782745',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52d99bb19e6343af92da922122e2a440',ramdisk_id='',reservation_id='r-ppmf0hbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-352447538',owner_user_name='tempest-TestServerVolumeAttachmentScenario-352447538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9656d7c2a654cfbb156aebf1c69fc3a',uuid=eb8117df-cf63-4bc9-9691-4828ff7f5a8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "address": "fa:16:3e:5b:d9:0b", "network": {"id": "45fb3f32-bd04-41a3-bbf0-0d85276e8495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1831642379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52d99bb19e6343af92da922122e2a440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8b1969-9e", "ovs_interfaceid": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Converting VIF {"id": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "address": "fa:16:3e:5b:d9:0b", "network": {"id": "45fb3f32-bd04-41a3-bbf0-0d85276e8495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1831642379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52d99bb19e6343af92da922122e2a440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8b1969-9e", "ovs_interfaceid": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:d9:0b,bridge_name='br-int',has_traffic_filtering=True,id=fb8b1969-9e49-47a4-a528-43c6673bd63d,network=Network(45fb3f32-bd04-41a3-bbf0-0d85276e8495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8b1969-9e') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.objects.instance [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lazy-loading 'pci_devices' on Instance uuid eb8117df-cf63-4bc9-9691-4828ff7f5a8e {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:57:59 user nova-compute[75378]:   <uuid>eb8117df-cf63-4bc9-9691-4828ff7f5a8e</uuid>
Nov 09 03:57:59 user nova-compute[75378]:   <name>instance-00000023</name>
Nov 09 03:57:59 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:57:59 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:57:59 user nova-compute[75378]:   <metadata>
Nov 09 03:57:59 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:57:59 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:57:59 user nova-compute[75378]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-492873150</nova:name>
Nov 09 03:57:59 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:57:59</nova:creationTime>
Nov 09 03:57:59 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:57:59 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:57:59 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:57:59 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:57:59 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:57:59 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:57:59 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:57:59 user nova-compute[75378]:       <nova:owner>
Nov 09 03:57:59 user nova-compute[75378]:         <nova:user uuid="f9656d7c2a654cfbb156aebf1c69fc3a">tempest-TestServerVolumeAttachmentScenario-352447538-project-member</nova:user>
Nov 09 03:57:59 user nova-compute[75378]:         <nova:project uuid="52d99bb19e6343af92da922122e2a440">tempest-TestServerVolumeAttachmentScenario-352447538</nova:project>
Nov 09 03:57:59 user nova-compute[75378]:       </nova:owner>
Nov 09 03:57:59 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:57:59 user nova-compute[75378]:       <nova:ports>
Nov 09 03:57:59 user nova-compute[75378]:         <nova:port uuid="fb8b1969-9e49-47a4-a528-43c6673bd63d">
Nov 09 03:57:59 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 09 03:57:59 user nova-compute[75378]:         </nova:port>
Nov 09 03:57:59 user nova-compute[75378]:       </nova:ports>
Nov 09 03:57:59 user nova-compute[75378]:     </nova:instance>
Nov 09 03:57:59 user nova-compute[75378]:   </metadata>
Nov 09 03:57:59 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:57:59 user nova-compute[75378]:     <system>
Nov 09 03:57:59 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:57:59 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:57:59 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:57:59 user nova-compute[75378]:       <entry name="serial">eb8117df-cf63-4bc9-9691-4828ff7f5a8e</entry>
Nov 09 03:57:59 user nova-compute[75378]:       <entry name="uuid">eb8117df-cf63-4bc9-9691-4828ff7f5a8e</entry>
Nov 09 03:57:59 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:57:59 user nova-compute[75378]:     </system>
Nov 09 03:57:59 user nova-compute[75378]:   </sysinfo>
Nov 09 03:57:59 user nova-compute[75378]:   <os>
Nov 09 03:57:59 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:57:59 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:57:59 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:57:59 user nova-compute[75378]:   </os>
Nov 09 03:57:59 user nova-compute[75378]:   <features>
Nov 09 03:57:59 user nova-compute[75378]:     <acpi/>
Nov 09 03:57:59 user nova-compute[75378]:     <apic/>
Nov 09 03:57:59 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:57:59 user nova-compute[75378]:   </features>
Nov 09 03:57:59 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:57:59 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:57:59 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:57:59 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:57:59 user nova-compute[75378]:   </clock>
Nov 09 03:57:59 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:57:59 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:57:59 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:57:59 user nova-compute[75378]:   </cpu>
Nov 09 03:57:59 user nova-compute[75378]:   <devices>
Nov 09 03:57:59 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:57:59 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:57:59 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk"/>
Nov 09 03:57:59 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:57:59 user nova-compute[75378]:     </disk>
Nov 09 03:57:59 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:57:59 user nova-compute[75378]:       <mac address="fa:16:3e:5b:d9:0b"/>
Nov 09 03:57:59 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:57:59 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:57:59 user nova-compute[75378]:       <target dev="tapfb8b1969-9e"/>
Nov 09 03:57:59 user nova-compute[75378]:     </interface>
Nov 09 03:57:59 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:57:59 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/console.log" append="off"/>
Nov 09 03:57:59 user nova-compute[75378]:     </serial>
Nov 09 03:57:59 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:57:59 user nova-compute[75378]:     <video>
Nov 09 03:57:59 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:57:59 user nova-compute[75378]:     </video>
Nov 09 03:57:59 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:57:59 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:57:59 user nova-compute[75378]:     </rng>
Nov 09 03:57:59 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:57:59 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:57:59 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:57:59 user nova-compute[75378]:     </memballoon>
Nov 09 03:57:59 user nova-compute[75378]:   </devices>
Nov 09 03:57:59 user nova-compute[75378]: </domain>
Nov 09 03:57:59 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:57:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-492873150',display_name='tempest-TestServerVolumeAttachmentScenario-server-492873150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-492873150',id=35,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8v4TOeuCX3JxKCmIDwWB7PrtGuDTnKc7Ba5YKPUKZb6kmeJMQSkseFsZy8ewmy3BelALwGirxlOK5xvpXphkaxfHiTI/GjoACZFJAKPKNouONzKDoWshQrNyiKsgj/Pg==',key_name='tempest-keypair-603782745',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52d99bb19e6343af92da922122e2a440',ramdisk_id='',reservation_id='r-ppmf0hbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-352447538',owner_user_name='tempest-TestServerVolumeAttachmentScenario-352447538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9656d7c2a654cfbb156aebf1c69fc3a',uuid=eb8117df-cf63-4bc9-9691-4828ff7f5a8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "address": "fa:16:3e:5b:d9:0b", "network": {"id": "45fb3f32-bd04-41a3-bbf0-0d85276e8495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1831642379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52d99bb19e6343af92da922122e2a440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8b1969-9e", "ovs_interfaceid": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Converting VIF {"id": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "address": "fa:16:3e:5b:d9:0b", "network": {"id": "45fb3f32-bd04-41a3-bbf0-0d85276e8495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1831642379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52d99bb19e6343af92da922122e2a440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8b1969-9e", "ovs_interfaceid": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:d9:0b,bridge_name='br-int',has_traffic_filtering=True,id=fb8b1969-9e49-47a4-a528-43c6673bd63d,network=Network(45fb3f32-bd04-41a3-bbf0-0d85276e8495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8b1969-9e') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG os_vif [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:d9:0b,bridge_name='br-int',has_traffic_filtering=True,id=fb8b1969-9e49-47a4-a528-43c6673bd63d,network=Network(45fb3f32-bd04-41a3-bbf0-0d85276e8495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8b1969-9e') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f83a83f9-9cc6-5c19-8e1e-f4873aabb611', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb8b1969-9e, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb8b1969-9e, col_values=(('qos', UUID('1238b4af-f95d-4d65-8d02-6d6ff4c1753e')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb8b1969-9e, col_values=(('external_ids', {'iface-id': 'fb8b1969-9e49-47a4-a528-43c6673bd63d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:d9:0b', 'vm-uuid': 'eb8117df-cf63-4bc9-9691-4828ff7f5a8e'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:57:59 user nova-compute[75378]: INFO os_vif [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:d9:0b,bridge_name='br-int',has_traffic_filtering=True,id=fb8b1969-9e49-47a4-a528-43c6673bd63d,network=Network(45fb3f32-bd04-41a3-bbf0-0d85276e8495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8b1969-9e')
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:57:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] No VIF found with MAC fa:16:3e:5b:d9:0b, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:58:00 user nova-compute[75378]: DEBUG nova.network.neutron [req-5e0d6829-ba17-415b-9609-3daefdbbcdeb req-7c177e76-31bc-45ec-88f3-eedd7fb53434 service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Updated VIF entry in instance network info cache for port fb8b1969-9e49-47a4-a528-43c6673bd63d. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:58:00 user nova-compute[75378]: DEBUG nova.network.neutron [req-5e0d6829-ba17-415b-9609-3daefdbbcdeb req-7c177e76-31bc-45ec-88f3-eedd7fb53434 service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Updating instance_info_cache with network_info: [{"id": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "address": "fa:16:3e:5b:d9:0b", "network": {"id": "45fb3f32-bd04-41a3-bbf0-0d85276e8495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1831642379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52d99bb19e6343af92da922122e2a440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8b1969-9e", "ovs_interfaceid": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:58:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5e0d6829-ba17-415b-9609-3daefdbbcdeb req-7c177e76-31bc-45ec-88f3-eedd7fb53434 service nova] Releasing lock "refresh_cache-eb8117df-cf63-4bc9-9691-4828ff7f5a8e" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:58:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:01 user nova-compute[75378]: DEBUG nova.compute.manager [req-5719c477-36c9-4736-8c16-b0ea466023fc req-cb0c5374-639f-4100-8d84-b982ba4a5df8 service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Received event network-vif-plugged-fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:58:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5719c477-36c9-4736-8c16-b0ea466023fc req-cb0c5374-639f-4100-8d84-b982ba4a5df8 service nova] Acquiring lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:58:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5719c477-36c9-4736-8c16-b0ea466023fc req-cb0c5374-639f-4100-8d84-b982ba4a5df8 service nova] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:58:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5719c477-36c9-4736-8c16-b0ea466023fc req-cb0c5374-639f-4100-8d84-b982ba4a5df8 service nova] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:58:01 user nova-compute[75378]: DEBUG nova.compute.manager [req-5719c477-36c9-4736-8c16-b0ea466023fc req-cb0c5374-639f-4100-8d84-b982ba4a5df8 service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] No waiting events found dispatching network-vif-plugged-fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:58:01 user nova-compute[75378]: WARNING nova.compute.manager [req-5719c477-36c9-4736-8c16-b0ea466023fc req-cb0c5374-639f-4100-8d84-b982ba4a5df8 service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Received unexpected event network-vif-plugged-fb8b1969-9e49-47a4-a528-43c6673bd63d for instance with vm_state building and task_state spawning.
Nov 09 03:58:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:03 user nova-compute[75378]: DEBUG nova.compute.manager [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:58:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:58:03 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Instance spawned successfully.
Nov 09 03:58:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:58:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:58:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:58:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:58:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:58:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:58:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:58:03 user nova-compute[75378]: INFO nova.compute.manager [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Took 6.30 seconds to spawn the instance on the hypervisor.
Nov 09 03:58:03 user nova-compute[75378]: DEBUG nova.compute.manager [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:58:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-e7ec3f05-5c31-466b-bda6-ff22a1e0003d req-1853fdc6-f2b0-4832-83f2-8772c87e5cab service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Received event network-vif-plugged-fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:58:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e7ec3f05-5c31-466b-bda6-ff22a1e0003d req-1853fdc6-f2b0-4832-83f2-8772c87e5cab service nova] Acquiring lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:58:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e7ec3f05-5c31-466b-bda6-ff22a1e0003d req-1853fdc6-f2b0-4832-83f2-8772c87e5cab service nova] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:58:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e7ec3f05-5c31-466b-bda6-ff22a1e0003d req-1853fdc6-f2b0-4832-83f2-8772c87e5cab service nova] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:58:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-e7ec3f05-5c31-466b-bda6-ff22a1e0003d req-1853fdc6-f2b0-4832-83f2-8772c87e5cab service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] No waiting events found dispatching network-vif-plugged-fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:58:03 user nova-compute[75378]: WARNING nova.compute.manager [req-e7ec3f05-5c31-466b-bda6-ff22a1e0003d req-1853fdc6-f2b0-4832-83f2-8772c87e5cab service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Received unexpected event network-vif-plugged-fb8b1969-9e49-47a4-a528-43c6673bd63d for instance with vm_state building and task_state spawning.
Nov 09 03:58:03 user nova-compute[75378]: INFO nova.compute.manager [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Took 7.31 seconds to build instance.
Nov 09 03:58:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-346f4b53-0d33-4f5b-9b8b-cfb329e1155e tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.476s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:58:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HynUKtrC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:58:05 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:58:05 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:58:05 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f495c90-de01-4495-957a-b8dd34f4516d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:58:05 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9251243-cda8-4753-8b84-a040ac55e93d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171] added
Nov 09 03:58:05 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82e79f7-67e1-4db2-807e-19858194e08d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df0761c-2858-4f7f-a9eb-1f8c24d567fd]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HynUKtrC {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HynUKtrC" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4973031-688f-4e0e-8644-9a99a6472de9]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HynUKtrC'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[839f7241-3aa0-47e5-85f2-9a09a8dc04a1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[044ce032-8af5-4b15-9682-8c167740a5d3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:58:05 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:58:05 user nova-compute[75378]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d (non-flash)
Nov 09 03:58:05 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:58:05 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:58:05 user nova-compute[75378]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d (non-flash)
Nov 09 03:58:05 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a69a73-88af-42b6-bac0-98112c84e771]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171, portal: 172.16.0.220,3260]
Nov 09 03:58:05 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171, portal: 172.16.0.220,3260] successful.
Nov 09 03:58:05 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e48d3f-a47e-4df0-870f-c6f4df4d61d3]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[349ff6d9-179d-4317-ad9f-e9a51e9f06b6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:58:05 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:58:05 user nova-compute[75378]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d (non-flash)
Nov 09 03:58:05 user nova-compute[75378]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)
Nov 09 03:58:05 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:58:05 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:58:05 user nova-compute[75378]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d (non-flash)
Nov 09 03:58:05 user nova-compute[75378]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)
Nov 09 03:58:05 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b2389b-d93c-4e02-93fb-e0d1bbb0503f]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:05 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: None {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:58:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:06 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:58:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HynUKtrC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:58:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:58:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23834396435623332', 'path': '/dev/sde'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:58:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834396435623332', 'path': '/dev/sde'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:58:06 user nova-compute[75378]: DEBUG nova.objects.instance [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lazy-loading 'flavor' on Instance uuid 06799031-9998-4829-8725-09526681c442 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:58:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 03:58:06 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:58:06 user nova-compute[75378]:   <source dev="/dev/sde"/>
Nov 09 03:58:06 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:58:06 user nova-compute[75378]:   <serial>7f29cbb5-01fa-4fc0-a79f-8716980ba171</serial>
Nov 09 03:58:06 user nova-compute[75378]: </disk>
Nov 09 03:58:06 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 03:58:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:58:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:58:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] No VIF found with MAC fa:16:3e:41:3b:05, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:58:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f0d523e2-beb7-4c01-8a47-7ecdc9f09efc tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "06799031-9998-4829-8725-09526681c442" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.775s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:58:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "1967e205-2619-498f-b115-d15bb82d6efa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:58:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "1967e205-2619-498f-b115-d15bb82d6efa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:58:10 user nova-compute[75378]: DEBUG nova.compute.manager [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:58:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:58:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:58:10 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:58:10 user nova-compute[75378]: INFO nova.compute.claims [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Claim successful on node user
Nov 09 03:58:11 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:58:11 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:58:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:58:11 user nova-compute[75378]: DEBUG nova.compute.manager [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:58:11 user nova-compute[75378]: DEBUG nova.compute.manager [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:58:11 user nova-compute[75378]: DEBUG nova.network.neutron [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:58:11 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:58:11 user nova-compute[75378]: DEBUG nova.compute.manager [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:58:11 user nova-compute[75378]: DEBUG nova.policy [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2afcdb0627e34b6e893b7981ea4615e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d990b7b4c19436d8cd8f43d8d0facb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:58:11 user nova-compute[75378]: DEBUG nova.compute.manager [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:58:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:58:11 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Creating image(s)
Nov 09 03:58:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "/opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:58:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "/opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:58:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "/opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:58:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.186s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:58:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:58:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.177s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa/disk 1073741824" returned: 0 in 0.061s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG nova.network.neutron [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Successfully created port: dedb00e6-5dfd-437b-a836-8ba236348811 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.182s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Cannot resize image /opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Ensure instance console log exists: /opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG nova.network.neutron [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Successfully updated port: dedb00e6-5dfd-437b-a836-8ba236348811 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "refresh_cache-1967e205-2619-498f-b115-d15bb82d6efa" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquired lock "refresh_cache-1967e205-2619-498f-b115-d15bb82d6efa" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG nova.network.neutron [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-06f73c67-30de-4b88-b4a6-2148fc58cc95 req-30dc521a-7094-4fdb-87e3-eadd25a0b407 service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Received event network-changed-dedb00e6-5dfd-437b-a836-8ba236348811 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-06f73c67-30de-4b88-b4a6-2148fc58cc95 req-30dc521a-7094-4fdb-87e3-eadd25a0b407 service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Refreshing instance network info cache due to event network-changed-dedb00e6-5dfd-437b-a836-8ba236348811. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-06f73c67-30de-4b88-b4a6-2148fc58cc95 req-30dc521a-7094-4fdb-87e3-eadd25a0b407 service nova] Acquiring lock "refresh_cache-1967e205-2619-498f-b115-d15bb82d6efa" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:58:12 user nova-compute[75378]: DEBUG nova.network.neutron [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.network.neutron [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Updating instance_info_cache with network_info: [{"id": "dedb00e6-5dfd-437b-a836-8ba236348811", "address": "fa:16:3e:9a:ca:d9", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdedb00e6-5d", "ovs_interfaceid": "dedb00e6-5dfd-437b-a836-8ba236348811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Releasing lock "refresh_cache-1967e205-2619-498f-b115-d15bb82d6efa" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.compute.manager [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Instance network_info: |[{"id": "dedb00e6-5dfd-437b-a836-8ba236348811", "address": "fa:16:3e:9a:ca:d9", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdedb00e6-5d", "ovs_interfaceid": "dedb00e6-5dfd-437b-a836-8ba236348811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-06f73c67-30de-4b88-b4a6-2148fc58cc95 req-30dc521a-7094-4fdb-87e3-eadd25a0b407 service nova] Acquired lock "refresh_cache-1967e205-2619-498f-b115-d15bb82d6efa" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.network.neutron [req-06f73c67-30de-4b88-b4a6-2148fc58cc95 req-30dc521a-7094-4fdb-87e3-eadd25a0b407 service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Refreshing network info cache for port dedb00e6-5dfd-437b-a836-8ba236348811 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Start _get_guest_xml network_info=[{"id": "dedb00e6-5dfd-437b-a836-8ba236348811", "address": "fa:16:3e:9a:ca:d9", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdedb00e6-5d", "ovs_interfaceid": "dedb00e6-5dfd-437b-a836-8ba236348811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:58:13 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:58:13 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-754031776',display_name='tempest-AttachVolumeNegativeTest-server-754031776',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-754031776',id=36,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhV2uvNvHOZuwr3xj2P9pJuzXRS9XfzEVc6/Jwj79Nxgu4d+2GIk4g31lN3OecirP2fHL4WPD7GQ+0IIfEQ83VuFIUJodQp0s/i63qOQQbJwgoJ6kyZ26QHTWoRy+saHg==',key_name='tempest-keypair-1871735098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d990b7b4c19436d8cd8f43d8d0facb9',ramdisk_id='',reservation_id='r-cl4hro47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-921155549',owner_user_name='tempest-AttachVolumeNegativeTest-921155549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afcdb0627e34b6e893b7981ea4615e3',uuid=1967e205-2619-498f-b115-d15bb82d6efa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dedb00e6-5dfd-437b-a836-8ba236348811", "address": "fa:16:3e:9a:ca:d9", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdedb00e6-5d", "ovs_interfaceid": "dedb00e6-5dfd-437b-a836-8ba236348811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converting VIF {"id": "dedb00e6-5dfd-437b-a836-8ba236348811", "address": "fa:16:3e:9a:ca:d9", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdedb00e6-5d", "ovs_interfaceid": "dedb00e6-5dfd-437b-a836-8ba236348811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ca:d9,bridge_name='br-int',has_traffic_filtering=True,id=dedb00e6-5dfd-437b-a836-8ba236348811,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdedb00e6-5d') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.objects.instance [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lazy-loading 'pci_devices' on Instance uuid 1967e205-2619-498f-b115-d15bb82d6efa {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:58:13 user nova-compute[75378]:   <uuid>1967e205-2619-498f-b115-d15bb82d6efa</uuid>
Nov 09 03:58:13 user nova-compute[75378]:   <name>instance-00000024</name>
Nov 09 03:58:13 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:58:13 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:58:13 user nova-compute[75378]:   <metadata>
Nov 09 03:58:13 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:58:13 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:58:13 user nova-compute[75378]:       <nova:name>tempest-AttachVolumeNegativeTest-server-754031776</nova:name>
Nov 09 03:58:13 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:58:13</nova:creationTime>
Nov 09 03:58:13 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:58:13 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:58:13 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:58:13 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:58:13 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:58:13 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:58:13 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:58:13 user nova-compute[75378]:       <nova:owner>
Nov 09 03:58:13 user nova-compute[75378]:         <nova:user uuid="2afcdb0627e34b6e893b7981ea4615e3">tempest-AttachVolumeNegativeTest-921155549-project-member</nova:user>
Nov 09 03:58:13 user nova-compute[75378]:         <nova:project uuid="6d990b7b4c19436d8cd8f43d8d0facb9">tempest-AttachVolumeNegativeTest-921155549</nova:project>
Nov 09 03:58:13 user nova-compute[75378]:       </nova:owner>
Nov 09 03:58:13 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:58:13 user nova-compute[75378]:       <nova:ports>
Nov 09 03:58:13 user nova-compute[75378]:         <nova:port uuid="dedb00e6-5dfd-437b-a836-8ba236348811">
Nov 09 03:58:13 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 03:58:13 user nova-compute[75378]:         </nova:port>
Nov 09 03:58:13 user nova-compute[75378]:       </nova:ports>
Nov 09 03:58:13 user nova-compute[75378]:     </nova:instance>
Nov 09 03:58:13 user nova-compute[75378]:   </metadata>
Nov 09 03:58:13 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:58:13 user nova-compute[75378]:     <system>
Nov 09 03:58:13 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:58:13 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:58:13 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:58:13 user nova-compute[75378]:       <entry name="serial">1967e205-2619-498f-b115-d15bb82d6efa</entry>
Nov 09 03:58:13 user nova-compute[75378]:       <entry name="uuid">1967e205-2619-498f-b115-d15bb82d6efa</entry>
Nov 09 03:58:13 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:58:13 user nova-compute[75378]:     </system>
Nov 09 03:58:13 user nova-compute[75378]:   </sysinfo>
Nov 09 03:58:13 user nova-compute[75378]:   <os>
Nov 09 03:58:13 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:58:13 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:58:13 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:58:13 user nova-compute[75378]:   </os>
Nov 09 03:58:13 user nova-compute[75378]:   <features>
Nov 09 03:58:13 user nova-compute[75378]:     <acpi/>
Nov 09 03:58:13 user nova-compute[75378]:     <apic/>
Nov 09 03:58:13 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:58:13 user nova-compute[75378]:   </features>
Nov 09 03:58:13 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:58:13 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:58:13 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:58:13 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:58:13 user nova-compute[75378]:   </clock>
Nov 09 03:58:13 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:58:13 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:58:13 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:58:13 user nova-compute[75378]:   </cpu>
Nov 09 03:58:13 user nova-compute[75378]:   <devices>
Nov 09 03:58:13 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:58:13 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:58:13 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa/disk"/>
Nov 09 03:58:13 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:58:13 user nova-compute[75378]:     </disk>
Nov 09 03:58:13 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:58:13 user nova-compute[75378]:       <mac address="fa:16:3e:9a:ca:d9"/>
Nov 09 03:58:13 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:58:13 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:58:13 user nova-compute[75378]:       <target dev="tapdedb00e6-5d"/>
Nov 09 03:58:13 user nova-compute[75378]:     </interface>
Nov 09 03:58:13 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:58:13 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa/console.log" append="off"/>
Nov 09 03:58:13 user nova-compute[75378]:     </serial>
Nov 09 03:58:13 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:58:13 user nova-compute[75378]:     <video>
Nov 09 03:58:13 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:58:13 user nova-compute[75378]:     </video>
Nov 09 03:58:13 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:58:13 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:58:13 user nova-compute[75378]:     </rng>
Nov 09 03:58:13 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:58:13 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:58:13 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:58:13 user nova-compute[75378]:     </memballoon>
Nov 09 03:58:13 user nova-compute[75378]:   </devices>
Nov 09 03:58:13 user nova-compute[75378]: </domain>
Nov 09 03:58:13 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-754031776',display_name='tempest-AttachVolumeNegativeTest-server-754031776',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-754031776',id=36,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhV2uvNvHOZuwr3xj2P9pJuzXRS9XfzEVc6/Jwj79Nxgu4d+2GIk4g31lN3OecirP2fHL4WPD7GQ+0IIfEQ83VuFIUJodQp0s/i63qOQQbJwgoJ6kyZ26QHTWoRy+saHg==',key_name='tempest-keypair-1871735098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d990b7b4c19436d8cd8f43d8d0facb9',ramdisk_id='',reservation_id='r-cl4hro47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-921155549',owner_user_name='tempest-AttachVolumeNegativeTest-921155549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afcdb0627e34b6e893b7981ea4615e3',uuid=1967e205-2619-498f-b115-d15bb82d6efa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dedb00e6-5dfd-437b-a836-8ba236348811", "address": "fa:16:3e:9a:ca:d9", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdedb00e6-5d", "ovs_interfaceid": "dedb00e6-5dfd-437b-a836-8ba236348811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converting VIF {"id": "dedb00e6-5dfd-437b-a836-8ba236348811", "address": "fa:16:3e:9a:ca:d9", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdedb00e6-5d", "ovs_interfaceid": "dedb00e6-5dfd-437b-a836-8ba236348811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ca:d9,bridge_name='br-int',has_traffic_filtering=True,id=dedb00e6-5dfd-437b-a836-8ba236348811,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdedb00e6-5d') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG os_vif [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ca:d9,bridge_name='br-int',has_traffic_filtering=True,id=dedb00e6-5dfd-437b-a836-8ba236348811,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdedb00e6-5d') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f8e0236-0165-501b-aa97-d7e9e90a2ec2', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdedb00e6-5d, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdedb00e6-5d, col_values=(('qos', UUID('baf5b2e4-edbb-44fe-a5a5-bb7344d62cac')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdedb00e6-5d, col_values=(('external_ids', {'iface-id': 'dedb00e6-5dfd-437b-a836-8ba236348811', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:ca:d9', 'vm-uuid': '1967e205-2619-498f-b115-d15bb82d6efa'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:13 user nova-compute[75378]: INFO os_vif [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ca:d9,bridge_name='br-int',has_traffic_filtering=True,id=dedb00e6-5dfd-437b-a836-8ba236348811,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdedb00e6-5d')
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] No VIF found with MAC fa:16:3e:9a:ca:d9, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.network.neutron [req-06f73c67-30de-4b88-b4a6-2148fc58cc95 req-30dc521a-7094-4fdb-87e3-eadd25a0b407 service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Updated VIF entry in instance network info cache for port dedb00e6-5dfd-437b-a836-8ba236348811. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG nova.network.neutron [req-06f73c67-30de-4b88-b4a6-2148fc58cc95 req-30dc521a-7094-4fdb-87e3-eadd25a0b407 service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Updating instance_info_cache with network_info: [{"id": "dedb00e6-5dfd-437b-a836-8ba236348811", "address": "fa:16:3e:9a:ca:d9", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdedb00e6-5d", "ovs_interfaceid": "dedb00e6-5dfd-437b-a836-8ba236348811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:58:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-06f73c67-30de-4b88-b4a6-2148fc58cc95 req-30dc521a-7094-4fdb-87e3-eadd25a0b407 service nova] Releasing lock "refresh_cache-1967e205-2619-498f-b115-d15bb82d6efa" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:58:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-521a29b1-dada-4a3f-b65b-85829c0b06d2 req-ce4cff42-f2de-4415-8880-2639c8424e24 service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Received event network-vif-plugged-dedb00e6-5dfd-437b-a836-8ba236348811 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:58:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-521a29b1-dada-4a3f-b65b-85829c0b06d2 req-ce4cff42-f2de-4415-8880-2639c8424e24 service nova] Acquiring lock "1967e205-2619-498f-b115-d15bb82d6efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:58:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-521a29b1-dada-4a3f-b65b-85829c0b06d2 req-ce4cff42-f2de-4415-8880-2639c8424e24 service nova] Lock "1967e205-2619-498f-b115-d15bb82d6efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:58:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-521a29b1-dada-4a3f-b65b-85829c0b06d2 req-ce4cff42-f2de-4415-8880-2639c8424e24 service nova] Lock "1967e205-2619-498f-b115-d15bb82d6efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:58:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-521a29b1-dada-4a3f-b65b-85829c0b06d2 req-ce4cff42-f2de-4415-8880-2639c8424e24 service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] No waiting events found dispatching network-vif-plugged-dedb00e6-5dfd-437b-a836-8ba236348811 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:58:14 user nova-compute[75378]: WARNING nova.compute.manager [req-521a29b1-dada-4a3f-b65b-85829c0b06d2 req-ce4cff42-f2de-4415-8880-2639c8424e24 service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Received unexpected event network-vif-plugged-dedb00e6-5dfd-437b-a836-8ba236348811 for instance with vm_state building and task_state spawning.
Nov 09 03:58:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-4412e22c-5118-4573-97af-e2cdbccb270e req-57f3cfb1-d6c7-4c14-90b4-6effcd7e6e94 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received event network-changed-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:58:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-4412e22c-5118-4573-97af-e2cdbccb270e req-57f3cfb1-d6c7-4c14-90b4-6effcd7e6e94 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Refreshing instance network info cache due to event network-changed-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:58:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4412e22c-5118-4573-97af-e2cdbccb270e req-57f3cfb1-d6c7-4c14-90b4-6effcd7e6e94 service nova] Acquiring lock "refresh_cache-dad51975-3054-4265-866e-63b1fa778472" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:58:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4412e22c-5118-4573-97af-e2cdbccb270e req-57f3cfb1-d6c7-4c14-90b4-6effcd7e6e94 service nova] Acquired lock "refresh_cache-dad51975-3054-4265-866e-63b1fa778472" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:58:14 user nova-compute[75378]: DEBUG nova.network.neutron [req-4412e22c-5118-4573-97af-e2cdbccb270e req-57f3cfb1-d6c7-4c14-90b4-6effcd7e6e94 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Refreshing network info cache for port aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:58:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:15 user nova-compute[75378]: DEBUG nova.network.neutron [req-4412e22c-5118-4573-97af-e2cdbccb270e req-57f3cfb1-d6c7-4c14-90b4-6effcd7e6e94 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Updated VIF entry in instance network info cache for port aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:58:15 user nova-compute[75378]: DEBUG nova.network.neutron [req-4412e22c-5118-4573-97af-e2cdbccb270e req-57f3cfb1-d6c7-4c14-90b4-6effcd7e6e94 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Updating instance_info_cache with network_info: [{"id": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "address": "fa:16:3e:18:d4:b6", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeca0fbf-0f", "ovs_interfaceid": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:58:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4412e22c-5118-4573-97af-e2cdbccb270e req-57f3cfb1-d6c7-4c14-90b4-6effcd7e6e94 service nova] Releasing lock "refresh_cache-dad51975-3054-4265-866e-63b1fa778472" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:58:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "dad51975-3054-4265-866e-63b1fa778472" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:58:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "dad51975-3054-4265-866e-63b1fa778472" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:58:15 user nova-compute[75378]: INFO nova.compute.manager [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Detaching volume 3cd22c26-57f0-43da-813c-8bce1616195d
Nov 09 03:58:15 user nova-compute[75378]: INFO nova.virt.block_device [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Attempting to driver detach volume 3cd22c26-57f0-43da-813c-8bce1616195d from mountpoint /dev/vdb
Nov 09 03:58:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Attempting to detach device vdb from instance dad51975-3054-4265-866e-63b1fa778472 from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 03:58:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:58:15 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:58:15 user nova-compute[75378]:   <source dev="/dev/sdb"/>
Nov 09 03:58:15 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:58:15 user nova-compute[75378]:   <serial>3cd22c26-57f0-43da-813c-8bce1616195d</serial>
Nov 09 03:58:15 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 03:58:15 user nova-compute[75378]: </disk>
Nov 09 03:58:15 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:58:15 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Successfully detached device vdb from instance dad51975-3054-4265-866e-63b1fa778472 from the persistent domain config.
Nov 09 03:58:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dad51975-3054-4265-866e-63b1fa778472 from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 03:58:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 03:58:15 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:58:15 user nova-compute[75378]:   <source dev="/dev/sdb"/>
Nov 09 03:58:15 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 03:58:15 user nova-compute[75378]:   <serial>3cd22c26-57f0-43da-813c-8bce1616195d</serial>
Nov 09 03:58:15 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 03:58:15 user nova-compute[75378]: </disk>
Nov 09 03:58:15 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 03:58:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dad51975-3054-4265-866e-63b1fa778472 {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 03:58:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:16 user nova-compute[75378]: DEBUG nova.compute.manager [req-166bf208-5520-4b97-a4ed-f7f46b992659 req-367d0a67-360f-411d-b03a-a1581cfdb7f8 service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Received event network-vif-plugged-dedb00e6-5dfd-437b-a836-8ba236348811 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:58:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-166bf208-5520-4b97-a4ed-f7f46b992659 req-367d0a67-360f-411d-b03a-a1581cfdb7f8 service nova] Acquiring lock "1967e205-2619-498f-b115-d15bb82d6efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:58:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-166bf208-5520-4b97-a4ed-f7f46b992659 req-367d0a67-360f-411d-b03a-a1581cfdb7f8 service nova] Lock "1967e205-2619-498f-b115-d15bb82d6efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:58:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-166bf208-5520-4b97-a4ed-f7f46b992659 req-367d0a67-360f-411d-b03a-a1581cfdb7f8 service nova] Lock "1967e205-2619-498f-b115-d15bb82d6efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:58:16 user nova-compute[75378]: DEBUG nova.compute.manager [req-166bf208-5520-4b97-a4ed-f7f46b992659 req-367d0a67-360f-411d-b03a-a1581cfdb7f8 service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] No waiting events found dispatching network-vif-plugged-dedb00e6-5dfd-437b-a836-8ba236348811 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:58:16 user nova-compute[75378]: WARNING nova.compute.manager [req-166bf208-5520-4b97-a4ed-f7f46b992659 req-367d0a67-360f-411d-b03a-a1581cfdb7f8 service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Received unexpected event network-vif-plugged-dedb00e6-5dfd-437b-a836-8ba236348811 for instance with vm_state building and task_state spawning.
Nov 09 03:58:16 user nova-compute[75378]: DEBUG nova.compute.manager [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:58:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:58:16 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Instance spawned successfully.
Nov 09 03:58:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:58:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:58:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:58:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:58:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:58:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:58:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:58:16 user nova-compute[75378]: DEBUG nova.compute.manager [req-49ae18fb-02d2-43a7-a7d0-6c06c75ef5d3 req-2b20dab4-728b-4678-bac3-7a8af34b1b9c service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received event network-changed-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:58:16 user nova-compute[75378]: DEBUG nova.compute.manager [req-49ae18fb-02d2-43a7-a7d0-6c06c75ef5d3 req-2b20dab4-728b-4678-bac3-7a8af34b1b9c service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Refreshing instance network info cache due to event network-changed-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:58:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-49ae18fb-02d2-43a7-a7d0-6c06c75ef5d3 req-2b20dab4-728b-4678-bac3-7a8af34b1b9c service nova] Acquiring lock "refresh_cache-dad51975-3054-4265-866e-63b1fa778472" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:58:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-49ae18fb-02d2-43a7-a7d0-6c06c75ef5d3 req-2b20dab4-728b-4678-bac3-7a8af34b1b9c service nova] Acquired lock "refresh_cache-dad51975-3054-4265-866e-63b1fa778472" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:58:16 user nova-compute[75378]: DEBUG nova.network.neutron [req-49ae18fb-02d2-43a7-a7d0-6c06c75ef5d3 req-2b20dab4-728b-4678-bac3-7a8af34b1b9c service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Refreshing network info cache for port aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:58:17 user nova-compute[75378]: INFO nova.compute.manager [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 09 03:58:17 user nova-compute[75378]: DEBUG nova.compute.manager [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:58:17 user nova-compute[75378]: INFO nova.compute.manager [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Took 6.25 seconds to build instance.
Nov 09 03:58:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-2060b07f-3986-4284-9c82-5e5d1608413d tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "1967e205-2619-498f-b115-d15bb82d6efa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.346s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:58:17 user nova-compute[75378]: DEBUG nova.network.neutron [req-49ae18fb-02d2-43a7-a7d0-6c06c75ef5d3 req-2b20dab4-728b-4678-bac3-7a8af34b1b9c service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Updated VIF entry in instance network info cache for port aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:58:17 user nova-compute[75378]: DEBUG nova.network.neutron [req-49ae18fb-02d2-43a7-a7d0-6c06c75ef5d3 req-2b20dab4-728b-4678-bac3-7a8af34b1b9c service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Updating instance_info_cache with network_info: [{"id": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "address": "fa:16:3e:18:d4:b6", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeca0fbf-0f", "ovs_interfaceid": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:58:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-49ae18fb-02d2-43a7-a7d0-6c06c75ef5d3 req-2b20dab4-728b-4678-bac3-7a8af34b1b9c service nova] Releasing lock "refresh_cache-dad51975-3054-4265-866e-63b1fa778472" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:58:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:58:36 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dad51975-3054-4265-866e-63b1fa778472 is timed out.
Nov 09 03:58:36 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Successfully detached device vdb from instance dad51975-3054-4265-866e-63b1fa778472 from the live domain config.
Nov 09 03:58:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPvguTnQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:58:36 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:58:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f604962c-9d2c-45de-bcf5-c3d2aad21b9e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 03:58:36 user nova-compute[75378]: No targets found.
Nov 09 03:58:36 user nova-compute[75378]: iSNS:
Nov 09 03:58:36 user nova-compute[75378]: No targets found.
Nov 09 03:58:36 user nova-compute[75378]: STATIC:
Nov 09 03:58:36 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d
Nov 09 03:58:36 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:58:36 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:58:36 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 03:58:36 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:58:36 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:58:36 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171
Nov 09 03:58:36 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:58:36 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:58:36 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522
Nov 09 03:58:36 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 03:58:36 user nova-compute[75378]:                 Iface Name: default
Nov 09 03:58:36 user nova-compute[75378]: FIRMWARE:
Nov 09 03:58:36 user nova-compute[75378]: No targets found.
Nov 09 03:58:36 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 03:58:36 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 03:58:36 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ddcd91-615e-4ee9-88dc-59a80b9e0694]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e5d00b-b5d4-42e4-9f0c-660759d4b4f0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:58:36 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:58:36 user nova-compute[75378]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d (non-flash)
Nov 09 03:58:36 user nova-compute[75378]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)
Nov 09 03:58:36 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:58:36 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:58:36 user nova-compute[75378]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d (non-flash)
Nov 09 03:58:36 user nova-compute[75378]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)
Nov 09 03:58:36 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3b044f1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d'): ({'sdb'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Removing single pathed devices sdb {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd729422-c7e4-4057-a267-be882ce549bc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b0dfda-5d33-4ef4-9008-022e28ed3cf1]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Flushing IO for device /dev/sdb {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9ee67a-02e0-4bc3-84a2-668dcdd9dc63]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77401ca-33c6-4fb9-8d00-4a8a2574ae06]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d296455-f34e-4d30-bdd0-b87df964933b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2126ca9d-8053-4993-b9bc-f4bb22e0539c]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d, portal: 172.16.0.220,3260]
Nov 09 03:58:36 user nova-compute[75378]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d, portal: 172.16.0.220,3260] successful.
Nov 09 03:58:36 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cd22c26-57f0-43da-813c-8bce1616195d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[05148a92-dee4-4281-8297-4343680c2f0e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] <== disconnect_volume: return (342ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 03:58:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:37 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:58:37 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:58:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-013db901-fbee-4593-a14f-95a03e79fad0" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:58:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-013db901-fbee-4593-a14f-95a03e79fad0" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:58:37 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 03:58:37 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Updating instance_info_cache with network_info: [{"id": "5650a4a6-f99d-42e2-8b94-f18562892154", "address": "fa:16:3e:7f:95:df", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5650a4a6-f9", "ovs_interfaceid": "5650a4a6-f99d-42e2-8b94-f18562892154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:58:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-013db901-fbee-4593-a14f-95a03e79fad0" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:58:37 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 03:58:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:39 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:58:39 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:58:39 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:58:40 user nova-compute[75378]: DEBUG nova.objects.instance [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lazy-loading 'flavor' on Instance uuid dad51975-3054-4265-866e-63b1fa778472 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:58:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-566b40ee-606b-4810-ada4-123fa02be674 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "dad51975-3054-4265-866e-63b1fa778472" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.626s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:58:41 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:58:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:42 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:58:43 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:58:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:58:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:58:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:58:43 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:58:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:58:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a841180-ac54-4c2a-9e82-4affb78d3fc9/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a841180-ac54-4c2a-9e82-4affb78d3fc9/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a841180-ac54-4c2a-9e82-4affb78d3fc9/disk.rescue --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a841180-ac54-4c2a-9e82-4affb78d3fc9/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:58:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:45 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:45 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:45 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:45 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:45 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:45 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:45 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:45 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:45 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:45 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:58:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:46 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:58:46 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:58:46 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7660MB free_disk=24.977657318115234GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:58:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:58:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:58:47 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7d051405-6b57-4db2-9533-c2f4e87134d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:58:47 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2c2acb48-972a-41d7-987e-48e79b3bef93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:58:47 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 013db901-fbee-4593-a14f-95a03e79fad0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:58:47 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 11f18164-9676-4a8a-91be-8bd87673ec5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:58:47 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance dad51975-3054-4265-866e-63b1fa778472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:58:47 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9a841180-ac54-4c2a-9e82-4affb78d3fc9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:58:47 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 06799031-9998-4829-8725-09526681c442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:58:47 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance eb8117df-cf63-4bc9-9691-4828ff7f5a8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:58:47 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 1967e205-2619-498f-b115-d15bb82d6efa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:58:47 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:58:47 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:58:47 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:58:47 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:58:47 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:58:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:58:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:48 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:58:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:58:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:58:51 user nova-compute[75378]: DEBUG nova.compute.manager [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:58:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:58:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:58:51 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:58:51 user nova-compute[75378]: INFO nova.compute.claims [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Claim successful on node user
Nov 09 03:58:51 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:58:51 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:58:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:58:51 user nova-compute[75378]: DEBUG nova.compute.manager [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:58:51 user nova-compute[75378]: DEBUG nova.compute.manager [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:58:51 user nova-compute[75378]: DEBUG nova.network.neutron [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:58:51 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:58:51 user nova-compute[75378]: DEBUG nova.compute.manager [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:58:51 user nova-compute[75378]: DEBUG nova.policy [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d4f0858695e4509a6b0ab99a8212571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548993d280024b60b3778b026177e356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:58:51 user nova-compute[75378]: INFO nova.virt.block_device [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Booting with volume a973b815-15ca-43a6-acba-896d722ff723 at /dev/vda
Nov 09 03:58:51 user nova-compute[75378]: DEBUG os_brick.utils [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:58:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:52 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3337c4ff-bf71-4d2c-a791-b7b6f5532f10]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:52 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e7d115-59ce-4241-9d52-a953a268575a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:58:52 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[13acffdb-a102-4c73-9a97-124b95d000b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:52 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4de80cf-f7a1-4ca6-811d-ff9cb357fb8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:58:52 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:58:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:58:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:58:52 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:58:52 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[af573339-1637-401c-8d74-56f84e25dbdb]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:58:52 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:58:52 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:58:52 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:58:52 user nova-compute[75378]: DEBUG os_brick.utils [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:58:52 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Updating existing volume attachment record: 65b02c43-2d17-4b2f-ae49-f6844e204c20 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:58:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:52 user nova-compute[75378]: DEBUG nova.network.neutron [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Successfully created port: 971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:58:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:58:53 user nova-compute[75378]: DEBUG nova.network.neutron [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Successfully updated port: 971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:58:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "refresh_cache-9dcaeb12-99bc-48f0-aec9-3de2a3770e01" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:58:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquired lock "refresh_cache-9dcaeb12-99bc-48f0-aec9-3de2a3770e01" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:58:53 user nova-compute[75378]: DEBUG nova.network.neutron [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:58:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-d2309b8a-c425-47f4-89d6-f2e6c81dcb6b req-e1c88c51-0a4c-47b6-b0bf-cf4879fba335 service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Received event network-changed-971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:58:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-d2309b8a-c425-47f4-89d6-f2e6c81dcb6b req-e1c88c51-0a4c-47b6-b0bf-cf4879fba335 service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Refreshing instance network info cache due to event network-changed-971f6712-c5e7-4bb6-846d-e165e70fd45a. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:58:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d2309b8a-c425-47f4-89d6-f2e6c81dcb6b req-e1c88c51-0a4c-47b6-b0bf-cf4879fba335 service nova] Acquiring lock "refresh_cache-9dcaeb12-99bc-48f0-aec9-3de2a3770e01" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:58:53 user nova-compute[75378]: DEBUG nova.network.neutron [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:58:53 user nova-compute[75378]: DEBUG nova.network.neutron [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Updating instance_info_cache with network_info: [{"id": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "address": "fa:16:3e:68:d1:1a", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971f6712-c5", "ovs_interfaceid": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:58:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Releasing lock "refresh_cache-9dcaeb12-99bc-48f0-aec9-3de2a3770e01" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:58:53 user nova-compute[75378]: DEBUG nova.compute.manager [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Instance network_info: |[{"id": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "address": "fa:16:3e:68:d1:1a", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971f6712-c5", "ovs_interfaceid": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:58:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d2309b8a-c425-47f4-89d6-f2e6c81dcb6b req-e1c88c51-0a4c-47b6-b0bf-cf4879fba335 service nova] Acquired lock "refresh_cache-9dcaeb12-99bc-48f0-aec9-3de2a3770e01" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:58:53 user nova-compute[75378]: DEBUG nova.network.neutron [req-d2309b8a-c425-47f4-89d6-f2e6c81dcb6b req-e1c88c51-0a4c-47b6-b0bf-cf4879fba335 service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Refreshing network info cache for port 971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:58:54 user nova-compute[75378]: DEBUG nova.network.neutron [req-d2309b8a-c425-47f4-89d6-f2e6c81dcb6b req-e1c88c51-0a4c-47b6-b0bf-cf4879fba335 service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Updated VIF entry in instance network info cache for port 971f6712-c5e7-4bb6-846d-e165e70fd45a. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:58:54 user nova-compute[75378]: DEBUG nova.network.neutron [req-d2309b8a-c425-47f4-89d6-f2e6c81dcb6b req-e1c88c51-0a4c-47b6-b0bf-cf4879fba335 service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Updating instance_info_cache with network_info: [{"id": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "address": "fa:16:3e:68:d1:1a", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971f6712-c5", "ovs_interfaceid": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:58:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d2309b8a-c425-47f4-89d6-f2e6c81dcb6b req-e1c88c51-0a4c-47b6-b0bf-cf4879fba335 service nova] Releasing lock "refresh_cache-9dcaeb12-99bc-48f0-aec9-3de2a3770e01" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:58:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:59:01 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:59:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:59:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 03:59:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:59:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:59:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "19359be7-5789-4d89-bc5a-c6c5ccd52211" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "19359be7-5789-4d89-bc5a-c6c5ccd52211" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:10 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 03:59:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:10 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 03:59:10 user nova-compute[75378]: INFO nova.compute.claims [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Claim successful on node user
Nov 09 03:59:11 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:59:11 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:59:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:11 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 03:59:11 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 03:59:11 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 03:59:11 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 03:59:11 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 03:59:11 user nova-compute[75378]: DEBUG nova.policy [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e20cee1117e645709251b4b5a6ccb075', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294bd41e27d9485f845906fed03ba98e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 03:59:11 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:59:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:59:11 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Creating image(s)
Nov 09 03:59:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "/opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "/opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "/opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk 1073741824" returned: 0 in 0.054s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:12 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Successfully created port: 7bcc909c-9b09-409b-8aab-a9f095514e2d {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 03:59:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.201s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:12 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Checking if we can resize image /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 03:59:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:12 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Cannot resize image /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 03:59:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 03:59:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Ensure instance console log exists: /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:59:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Successfully updated port: 7bcc909c-9b09-409b-8aab-a9f095514e2d {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "refresh_cache-19359be7-5789-4d89-bc5a-c6c5ccd52211" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquired lock "refresh_cache-19359be7-5789-4d89-bc5a-c6c5ccd52211" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.compute.manager [req-02e9ca14-002a-4a15-bea5-8362c9dfaead req-71b32588-6686-48ba-9b9d-a7698a3ef1c5 service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Received event network-changed-7bcc909c-9b09-409b-8aab-a9f095514e2d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.compute.manager [req-02e9ca14-002a-4a15-bea5-8362c9dfaead req-71b32588-6686-48ba-9b9d-a7698a3ef1c5 service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Refreshing instance network info cache due to event network-changed-7bcc909c-9b09-409b-8aab-a9f095514e2d. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-02e9ca14-002a-4a15-bea5-8362c9dfaead req-71b32588-6686-48ba-9b9d-a7698a3ef1c5 service nova] Acquiring lock "refresh_cache-19359be7-5789-4d89-bc5a-c6c5ccd52211" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Updating instance_info_cache with network_info: [{"id": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "address": "fa:16:3e:3a:3e:05", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc909c-9b", "ovs_interfaceid": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Releasing lock "refresh_cache-19359be7-5789-4d89-bc5a-c6c5ccd52211" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Instance network_info: |[{"id": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "address": "fa:16:3e:3a:3e:05", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc909c-9b", "ovs_interfaceid": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-02e9ca14-002a-4a15-bea5-8362c9dfaead req-71b32588-6686-48ba-9b9d-a7698a3ef1c5 service nova] Acquired lock "refresh_cache-19359be7-5789-4d89-bc5a-c6c5ccd52211" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.network.neutron [req-02e9ca14-002a-4a15-bea5-8362c9dfaead req-71b32588-6686-48ba-9b9d-a7698a3ef1c5 service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Refreshing network info cache for port 7bcc909c-9b09-409b-8aab-a9f095514e2d {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Start _get_guest_xml network_info=[{"id": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "address": "fa:16:3e:3a:3e:05", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc909c-9b", "ovs_interfaceid": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:59:13 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:59:13 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1103060003',display_name='tempest-VolumesSnapshotTestJSON-instance-1103060003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1103060003',id=38,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBisGsfyiju0+J1AHKLS6GQEWztscCWC3D0QrQbh95VyBSPp5Thn5+SL30M7VGPkqNDtxz926SzNR0yHZ6qy5irp47vGnO2PLyx2fn9ZLWmK/h7OnxQThqcHfk54eSP26A==',key_name='tempest-keypair-1211870534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='294bd41e27d9485f845906fed03ba98e',ramdisk_id='',reservation_id='r-gimqy5jf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1705070970',owner_user_name='tempest-VolumesSnapshotTestJSON-1705070970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:59:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e20cee1117e645709251b4b5a6ccb075',uuid=19359be7-5789-4d89-bc5a-c6c5ccd52211,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "address": "fa:16:3e:3a:3e:05", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc909c-9b", "ovs_interfaceid": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Converting VIF {"id": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "address": "fa:16:3e:3a:3e:05", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc909c-9b", "ovs_interfaceid": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:3e:05,bridge_name='br-int',has_traffic_filtering=True,id=7bcc909c-9b09-409b-8aab-a9f095514e2d,network=Network(0a93a88f-39de-4b68-9674-7ed7dfe24759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcc909c-9b') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.objects.instance [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lazy-loading 'pci_devices' on Instance uuid 19359be7-5789-4d89-bc5a-c6c5ccd52211 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:59:13 user nova-compute[75378]:   <uuid>19359be7-5789-4d89-bc5a-c6c5ccd52211</uuid>
Nov 09 03:59:13 user nova-compute[75378]:   <name>instance-00000026</name>
Nov 09 03:59:13 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:59:13 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:59:13 user nova-compute[75378]:   <metadata>
Nov 09 03:59:13 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:59:13 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:59:13 user nova-compute[75378]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1103060003</nova:name>
Nov 09 03:59:13 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:59:13</nova:creationTime>
Nov 09 03:59:13 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:59:13 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:59:13 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:59:13 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:59:13 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:59:13 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:59:13 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:59:13 user nova-compute[75378]:       <nova:owner>
Nov 09 03:59:13 user nova-compute[75378]:         <nova:user uuid="e20cee1117e645709251b4b5a6ccb075">tempest-VolumesSnapshotTestJSON-1705070970-project-member</nova:user>
Nov 09 03:59:13 user nova-compute[75378]:         <nova:project uuid="294bd41e27d9485f845906fed03ba98e">tempest-VolumesSnapshotTestJSON-1705070970</nova:project>
Nov 09 03:59:13 user nova-compute[75378]:       </nova:owner>
Nov 09 03:59:13 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 03:59:13 user nova-compute[75378]:       <nova:ports>
Nov 09 03:59:13 user nova-compute[75378]:         <nova:port uuid="7bcc909c-9b09-409b-8aab-a9f095514e2d">
Nov 09 03:59:13 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 09 03:59:13 user nova-compute[75378]:         </nova:port>
Nov 09 03:59:13 user nova-compute[75378]:       </nova:ports>
Nov 09 03:59:13 user nova-compute[75378]:     </nova:instance>
Nov 09 03:59:13 user nova-compute[75378]:   </metadata>
Nov 09 03:59:13 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:59:13 user nova-compute[75378]:     <system>
Nov 09 03:59:13 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:59:13 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:59:13 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:59:13 user nova-compute[75378]:       <entry name="serial">19359be7-5789-4d89-bc5a-c6c5ccd52211</entry>
Nov 09 03:59:13 user nova-compute[75378]:       <entry name="uuid">19359be7-5789-4d89-bc5a-c6c5ccd52211</entry>
Nov 09 03:59:13 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:59:13 user nova-compute[75378]:     </system>
Nov 09 03:59:13 user nova-compute[75378]:   </sysinfo>
Nov 09 03:59:13 user nova-compute[75378]:   <os>
Nov 09 03:59:13 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:59:13 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:59:13 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:59:13 user nova-compute[75378]:   </os>
Nov 09 03:59:13 user nova-compute[75378]:   <features>
Nov 09 03:59:13 user nova-compute[75378]:     <acpi/>
Nov 09 03:59:13 user nova-compute[75378]:     <apic/>
Nov 09 03:59:13 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:59:13 user nova-compute[75378]:   </features>
Nov 09 03:59:13 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:59:13 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:59:13 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:59:13 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:59:13 user nova-compute[75378]:   </clock>
Nov 09 03:59:13 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:59:13 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:59:13 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:59:13 user nova-compute[75378]:   </cpu>
Nov 09 03:59:13 user nova-compute[75378]:   <devices>
Nov 09 03:59:13 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 03:59:13 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 03:59:13 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk"/>
Nov 09 03:59:13 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:59:13 user nova-compute[75378]:     </disk>
Nov 09 03:59:13 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:59:13 user nova-compute[75378]:       <mac address="fa:16:3e:3a:3e:05"/>
Nov 09 03:59:13 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:59:13 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:59:13 user nova-compute[75378]:       <target dev="tap7bcc909c-9b"/>
Nov 09 03:59:13 user nova-compute[75378]:     </interface>
Nov 09 03:59:13 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:59:13 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/console.log" append="off"/>
Nov 09 03:59:13 user nova-compute[75378]:     </serial>
Nov 09 03:59:13 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:59:13 user nova-compute[75378]:     <video>
Nov 09 03:59:13 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:59:13 user nova-compute[75378]:     </video>
Nov 09 03:59:13 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:59:13 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:59:13 user nova-compute[75378]:     </rng>
Nov 09 03:59:13 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:59:13 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:59:13 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:59:13 user nova-compute[75378]:     </memballoon>
Nov 09 03:59:13 user nova-compute[75378]:   </devices>
Nov 09 03:59:13 user nova-compute[75378]: </domain>
Nov 09 03:59:13 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1103060003',display_name='tempest-VolumesSnapshotTestJSON-instance-1103060003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1103060003',id=38,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBisGsfyiju0+J1AHKLS6GQEWztscCWC3D0QrQbh95VyBSPp5Thn5+SL30M7VGPkqNDtxz926SzNR0yHZ6qy5irp47vGnO2PLyx2fn9ZLWmK/h7OnxQThqcHfk54eSP26A==',key_name='tempest-keypair-1211870534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='294bd41e27d9485f845906fed03ba98e',ramdisk_id='',reservation_id='r-gimqy5jf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1705070970',owner_user_name='tempest-VolumesSnapshotTestJSON-1705070970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:59:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e20cee1117e645709251b4b5a6ccb075',uuid=19359be7-5789-4d89-bc5a-c6c5ccd52211,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "address": "fa:16:3e:3a:3e:05", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc909c-9b", "ovs_interfaceid": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Converting VIF {"id": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "address": "fa:16:3e:3a:3e:05", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc909c-9b", "ovs_interfaceid": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:3e:05,bridge_name='br-int',has_traffic_filtering=True,id=7bcc909c-9b09-409b-8aab-a9f095514e2d,network=Network(0a93a88f-39de-4b68-9674-7ed7dfe24759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcc909c-9b') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG os_vif [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:3e:05,bridge_name='br-int',has_traffic_filtering=True,id=7bcc909c-9b09-409b-8aab-a9f095514e2d,network=Network(0a93a88f-39de-4b68-9674-7ed7dfe24759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcc909c-9b') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd2cfe6a-a649-5851-a03c-77da9bb6f67d', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bcc909c-9b, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7bcc909c-9b, col_values=(('qos', UUID('2294f6af-2e3d-4a6e-83d3-87edbf163583')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7bcc909c-9b, col_values=(('external_ids', {'iface-id': '7bcc909c-9b09-409b-8aab-a9f095514e2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:3e:05', 'vm-uuid': '19359be7-5789-4d89-bc5a-c6c5ccd52211'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:13 user nova-compute[75378]: INFO os_vif [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:3e:05,bridge_name='br-int',has_traffic_filtering=True,id=7bcc909c-9b09-409b-8aab-a9f095514e2d,network=Network(0a93a88f-39de-4b68-9674-7ed7dfe24759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcc909c-9b')
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:59:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] No VIF found with MAC fa:16:3e:3a:3e:05, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:59:14 user nova-compute[75378]: DEBUG nova.network.neutron [req-02e9ca14-002a-4a15-bea5-8362c9dfaead req-71b32588-6686-48ba-9b9d-a7698a3ef1c5 service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Updated VIF entry in instance network info cache for port 7bcc909c-9b09-409b-8aab-a9f095514e2d. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:59:14 user nova-compute[75378]: DEBUG nova.network.neutron [req-02e9ca14-002a-4a15-bea5-8362c9dfaead req-71b32588-6686-48ba-9b9d-a7698a3ef1c5 service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Updating instance_info_cache with network_info: [{"id": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "address": "fa:16:3e:3a:3e:05", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc909c-9b", "ovs_interfaceid": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:59:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-02e9ca14-002a-4a15-bea5-8362c9dfaead req-71b32588-6686-48ba-9b9d-a7698a3ef1c5 service nova] Releasing lock "refresh_cache-19359be7-5789-4d89-bc5a-c6c5ccd52211" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:59:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:15 user nova-compute[75378]: DEBUG nova.compute.manager [req-6d833101-db45-4834-bf9b-07e4d03d9d10 req-c3422051-1467-490a-a548-b64624856065 service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Received event network-vif-plugged-7bcc909c-9b09-409b-8aab-a9f095514e2d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:59:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6d833101-db45-4834-bf9b-07e4d03d9d10 req-c3422051-1467-490a-a548-b64624856065 service nova] Acquiring lock "19359be7-5789-4d89-bc5a-c6c5ccd52211-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6d833101-db45-4834-bf9b-07e4d03d9d10 req-c3422051-1467-490a-a548-b64624856065 service nova] Lock "19359be7-5789-4d89-bc5a-c6c5ccd52211-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6d833101-db45-4834-bf9b-07e4d03d9d10 req-c3422051-1467-490a-a548-b64624856065 service nova] Lock "19359be7-5789-4d89-bc5a-c6c5ccd52211-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:15 user nova-compute[75378]: DEBUG nova.compute.manager [req-6d833101-db45-4834-bf9b-07e4d03d9d10 req-c3422051-1467-490a-a548-b64624856065 service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] No waiting events found dispatching network-vif-plugged-7bcc909c-9b09-409b-8aab-a9f095514e2d {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:59:15 user nova-compute[75378]: WARNING nova.compute.manager [req-6d833101-db45-4834-bf9b-07e4d03d9d10 req-c3422051-1467-490a-a548-b64624856065 service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Received unexpected event network-vif-plugged-7bcc909c-9b09-409b-8aab-a9f095514e2d for instance with vm_state building and task_state spawning.
Nov 09 03:59:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:17 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:59:17 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:59:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-b6b67b01-9736-442a-955f-4d2d79bf3529 req-22904ac8-6344-41f9-9ef8-878de930fd8c service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Received event network-vif-plugged-7bcc909c-9b09-409b-8aab-a9f095514e2d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:59:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b6b67b01-9736-442a-955f-4d2d79bf3529 req-22904ac8-6344-41f9-9ef8-878de930fd8c service nova] Acquiring lock "19359be7-5789-4d89-bc5a-c6c5ccd52211-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b6b67b01-9736-442a-955f-4d2d79bf3529 req-22904ac8-6344-41f9-9ef8-878de930fd8c service nova] Lock "19359be7-5789-4d89-bc5a-c6c5ccd52211-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b6b67b01-9736-442a-955f-4d2d79bf3529 req-22904ac8-6344-41f9-9ef8-878de930fd8c service nova] Lock "19359be7-5789-4d89-bc5a-c6c5ccd52211-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-b6b67b01-9736-442a-955f-4d2d79bf3529 req-22904ac8-6344-41f9-9ef8-878de930fd8c service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] No waiting events found dispatching network-vif-plugged-7bcc909c-9b09-409b-8aab-a9f095514e2d {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:59:17 user nova-compute[75378]: WARNING nova.compute.manager [req-b6b67b01-9736-442a-955f-4d2d79bf3529 req-22904ac8-6344-41f9-9ef8-878de930fd8c service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Received unexpected event network-vif-plugged-7bcc909c-9b09-409b-8aab-a9f095514e2d for instance with vm_state building and task_state spawning.
Nov 09 03:59:17 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Instance spawned successfully.
Nov 09 03:59:17 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:59:17 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:59:17 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:59:17 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:59:17 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:59:17 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:59:17 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:59:17 user nova-compute[75378]: INFO nova.compute.manager [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Took 5.93 seconds to spawn the instance on the hypervisor.
Nov 09 03:59:17 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:59:17 user nova-compute[75378]: INFO nova.compute.manager [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Took 6.83 seconds to build instance.
Nov 09 03:59:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9f4da396-0f32-4df8-9d49-e9a89e417feb tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "19359be7-5789-4d89-bc5a-c6c5ccd52211" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.927s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.compute.manager [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 03:59:18 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Creating image(s)
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Did not create local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Ensure instance console log exists: /opt/stack/data/nova/instances/9dcaeb12-99bc-48f0-aec9-3de2a3770e01/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Start _get_guest_xml network_info=[{"id": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "address": "fa:16:3e:68:d1:1a", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971f6712-c5", "ovs_interfaceid": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPVFTdZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9dcaeb12-99bc-48f0-aec9-3de2a3770e01', 'attached_at': '', 'detached_at': '', 'volume_id': 'a973b815-15ca-43a6-acba-896d722ff723', 'serial': 'a973b815-15ca-43a6-acba-896d722ff723'}, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': '65b02c43-2d17-4b2f-ae49-f6844e204c20', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 03:59:18 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:59:18 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPVFTdZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:59:18 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:59:18 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 03:59:18 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[85199fc1-cb36-47a5-9e0f-c986f652acc3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 03:59:18 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61bd00a-798a-442a-aaec-8e90b6826056]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723] added
Nov 09 03:59:18 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[87501695-a461-4faf-ae21-7bf90a67184e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d40c0b-59e6-496e-88e7-930b9e085c66]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vPVFTdZG {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vPVFTdZG" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bada1637-3563-495f-92bd-f6b567572f59]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vPVFTdZG'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[455a2b6e-cc27-44f3-8247-78819502767e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fc23f5-68ee-4a3b-b5dc-6b871bcc2066]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:59:18 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:59:18 user nova-compute[75378]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)
Nov 09 03:59:18 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:59:18 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:59:18 user nova-compute[75378]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)
Nov 09 03:59:18 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[87beb509-213f-4c41-a2a3-4c5745b45a26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723, portal: 172.16.0.220,3260]
Nov 09 03:59:18 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723, portal: 172.16.0.220,3260] successful.
Nov 09 03:59:18 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2114b4a-1eea-408f-9906-1f4ef23f18e5]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3d0dc2-1f50-4d02-b0ec-9996e617ca81]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:59:18 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:59:18 user nova-compute[75378]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)
Nov 09 03:59:18 user nova-compute[75378]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 03:59:18 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 03:59:18 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 03:59:18 user nova-compute[75378]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)
Nov 09 03:59:18 user nova-compute[75378]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 03:59:18 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7d0c49-3926-49b6-9255-f44c73696b6f]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: None {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:59:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "dad51975-3054-4265-866e-63b1fa778472" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "dad51975-3054-4265-866e-63b1fa778472" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "dad51975-3054-4265-866e-63b1fa778472-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "dad51975-3054-4265-866e-63b1fa778472-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "dad51975-3054-4265-866e-63b1fa778472-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:19 user nova-compute[75378]: INFO nova.compute.manager [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Terminating instance
Nov 09 03:59:19 user nova-compute[75378]: DEBUG nova.compute.manager [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-faa54e56-f767-426b-9876-6a772c3a17ce req-0d742875-28c2-4718-b744-71dab1416005 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received event network-vif-unplugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-faa54e56-f767-426b-9876-6a772c3a17ce req-0d742875-28c2-4718-b744-71dab1416005 service nova] Acquiring lock "dad51975-3054-4265-866e-63b1fa778472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-faa54e56-f767-426b-9876-6a772c3a17ce req-0d742875-28c2-4718-b744-71dab1416005 service nova] Lock "dad51975-3054-4265-866e-63b1fa778472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-faa54e56-f767-426b-9876-6a772c3a17ce req-0d742875-28c2-4718-b744-71dab1416005 service nova] Lock "dad51975-3054-4265-866e-63b1fa778472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-faa54e56-f767-426b-9876-6a772c3a17ce req-0d742875-28c2-4718-b744-71dab1416005 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] No waiting events found dispatching network-vif-unplugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-faa54e56-f767-426b-9876-6a772c3a17ce req-0d742875-28c2-4718-b744-71dab1416005 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received event network-vif-unplugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPVFTdZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23233633336393938', 'path': '/dev/sdb'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233633336393938', 'path': '/dev/sdb'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:58:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-313014061',display_name='tempest-ServerActionsTestOtherA-server-313014061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-313014061',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFabS+mewwrg7oOEw/0EoMWlEwIz3NoSF6MUhLgvIEWjSZH9d/Fg8M+DuLJkZN6SKSXE9qeztuGxbDfpg7EHMNtmRvy2F5yoI+XGOsX3tR4ssTADXmphKv1NsnpmlrDrQg==',key_name='tempest-keypair-138130530',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548993d280024b60b3778b026177e356',ramdisk_id='',reservation_id='r-a17ajdc9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2010465588',owner_user_name='tempest-ServerActionsTestOtherA-2010465588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:58:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d4f0858695e4509a6b0ab99a8212571',uuid=9dcaeb12-99bc-48f0-aec9-3de2a3770e01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "address": "fa:16:3e:68:d1:1a", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971f6712-c5", "ovs_interfaceid": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converting VIF {"id": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "address": "fa:16:3e:68:d1:1a", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971f6712-c5", "ovs_interfaceid": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:d1:1a,bridge_name='br-int',has_traffic_filtering=True,id=971f6712-c5e7-4bb6-846d-e165e70fd45a,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap971f6712-c5') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG nova.objects.instance [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lazy-loading 'pci_devices' on Instance uuid 9dcaeb12-99bc-48f0-aec9-3de2a3770e01 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] End _get_guest_xml xml=<domain type="kvm">
Nov 09 03:59:19 user nova-compute[75378]:   <uuid>9dcaeb12-99bc-48f0-aec9-3de2a3770e01</uuid>
Nov 09 03:59:19 user nova-compute[75378]:   <name>instance-00000025</name>
Nov 09 03:59:19 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 03:59:19 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 03:59:19 user nova-compute[75378]:   <metadata>
Nov 09 03:59:19 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 03:59:19 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 03:59:19 user nova-compute[75378]:       <nova:name>tempest-ServerActionsTestOtherA-server-313014061</nova:name>
Nov 09 03:59:19 user nova-compute[75378]:       <nova:creationTime>2023-11-09 03:59:18</nova:creationTime>
Nov 09 03:59:19 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 03:59:19 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 03:59:19 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 03:59:19 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 03:59:19 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 03:59:19 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 03:59:19 user nova-compute[75378]:       </nova:flavor>
Nov 09 03:59:19 user nova-compute[75378]:       <nova:owner>
Nov 09 03:59:19 user nova-compute[75378]:         <nova:user uuid="5d4f0858695e4509a6b0ab99a8212571">tempest-ServerActionsTestOtherA-2010465588-project-member</nova:user>
Nov 09 03:59:19 user nova-compute[75378]:         <nova:project uuid="548993d280024b60b3778b026177e356">tempest-ServerActionsTestOtherA-2010465588</nova:project>
Nov 09 03:59:19 user nova-compute[75378]:       </nova:owner>
Nov 09 03:59:19 user nova-compute[75378]:       <nova:ports>
Nov 09 03:59:19 user nova-compute[75378]:         <nova:port uuid="971f6712-c5e7-4bb6-846d-e165e70fd45a">
Nov 09 03:59:19 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 09 03:59:19 user nova-compute[75378]:         </nova:port>
Nov 09 03:59:19 user nova-compute[75378]:       </nova:ports>
Nov 09 03:59:19 user nova-compute[75378]:     </nova:instance>
Nov 09 03:59:19 user nova-compute[75378]:   </metadata>
Nov 09 03:59:19 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 03:59:19 user nova-compute[75378]:     <system>
Nov 09 03:59:19 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 03:59:19 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 03:59:19 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 03:59:19 user nova-compute[75378]:       <entry name="serial">9dcaeb12-99bc-48f0-aec9-3de2a3770e01</entry>
Nov 09 03:59:19 user nova-compute[75378]:       <entry name="uuid">9dcaeb12-99bc-48f0-aec9-3de2a3770e01</entry>
Nov 09 03:59:19 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 03:59:19 user nova-compute[75378]:     </system>
Nov 09 03:59:19 user nova-compute[75378]:   </sysinfo>
Nov 09 03:59:19 user nova-compute[75378]:   <os>
Nov 09 03:59:19 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 03:59:19 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 03:59:19 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 03:59:19 user nova-compute[75378]:   </os>
Nov 09 03:59:19 user nova-compute[75378]:   <features>
Nov 09 03:59:19 user nova-compute[75378]:     <acpi/>
Nov 09 03:59:19 user nova-compute[75378]:     <apic/>
Nov 09 03:59:19 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 03:59:19 user nova-compute[75378]:   </features>
Nov 09 03:59:19 user nova-compute[75378]:   <clock offset="utc">
Nov 09 03:59:19 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 03:59:19 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 03:59:19 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 03:59:19 user nova-compute[75378]:   </clock>
Nov 09 03:59:19 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 03:59:19 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 03:59:19 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 03:59:19 user nova-compute[75378]:   </cpu>
Nov 09 03:59:19 user nova-compute[75378]:   <devices>
Nov 09 03:59:19 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 03:59:19 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 03:59:19 user nova-compute[75378]:       <source dev="/dev/sdb"/>
Nov 09 03:59:19 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 03:59:19 user nova-compute[75378]:       <serial>a973b815-15ca-43a6-acba-896d722ff723</serial>
Nov 09 03:59:19 user nova-compute[75378]:     </disk>
Nov 09 03:59:19 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 03:59:19 user nova-compute[75378]:       <mac address="fa:16:3e:68:d1:1a"/>
Nov 09 03:59:19 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:59:19 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 03:59:19 user nova-compute[75378]:       <target dev="tap971f6712-c5"/>
Nov 09 03:59:19 user nova-compute[75378]:     </interface>
Nov 09 03:59:19 user nova-compute[75378]:     <serial type="pty">
Nov 09 03:59:19 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/9dcaeb12-99bc-48f0-aec9-3de2a3770e01/console.log" append="off"/>
Nov 09 03:59:19 user nova-compute[75378]:     </serial>
Nov 09 03:59:19 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 03:59:19 user nova-compute[75378]:     <video>
Nov 09 03:59:19 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 03:59:19 user nova-compute[75378]:     </video>
Nov 09 03:59:19 user nova-compute[75378]:     <rng model="virtio">
Nov 09 03:59:19 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 03:59:19 user nova-compute[75378]:     </rng>
Nov 09 03:59:19 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 03:59:19 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 03:59:19 user nova-compute[75378]:       <stats period="10"/>
Nov 09 03:59:19 user nova-compute[75378]:     </memballoon>
Nov 09 03:59:19 user nova-compute[75378]:   </devices>
Nov 09 03:59:19 user nova-compute[75378]: </domain>
Nov 09 03:59:19 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:58:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-313014061',display_name='tempest-ServerActionsTestOtherA-server-313014061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-313014061',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFabS+mewwrg7oOEw/0EoMWlEwIz3NoSF6MUhLgvIEWjSZH9d/Fg8M+DuLJkZN6SKSXE9qeztuGxbDfpg7EHMNtmRvy2F5yoI+XGOsX3tR4ssTADXmphKv1NsnpmlrDrQg==',key_name='tempest-keypair-138130530',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='548993d280024b60b3778b026177e356',ramdisk_id='',reservation_id='r-a17ajdc9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2010465588',owner_user_name='tempest-ServerActionsTestOtherA-2010465588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T03:58:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d4f0858695e4509a6b0ab99a8212571',uuid=9dcaeb12-99bc-48f0-aec9-3de2a3770e01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "address": "fa:16:3e:68:d1:1a", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971f6712-c5", "ovs_interfaceid": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converting VIF {"id": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "address": "fa:16:3e:68:d1:1a", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971f6712-c5", "ovs_interfaceid": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:d1:1a,bridge_name='br-int',has_traffic_filtering=True,id=971f6712-c5e7-4bb6-846d-e165e70fd45a,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap971f6712-c5') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG os_vif [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:d1:1a,bridge_name='br-int',has_traffic_filtering=True,id=971f6712-c5e7-4bb6-846d-e165e70fd45a,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap971f6712-c5') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6196d541-9e87-5857-9610-e0707d80440d', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap971f6712-c5, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap971f6712-c5, col_values=(('qos', UUID('bf81237f-09ba-4c68-a40a-b98cb7d06e8a')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap971f6712-c5, col_values=(('external_ids', {'iface-id': '971f6712-c5e7-4bb6-846d-e165e70fd45a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:d1:1a', 'vm-uuid': '9dcaeb12-99bc-48f0-aec9-3de2a3770e01'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:19 user nova-compute[75378]: INFO os_vif [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:d1:1a,bridge_name='br-int',has_traffic_filtering=True,id=971f6712-c5e7-4bb6-846d-e165e70fd45a,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap971f6712-c5')
Nov 09 03:59:19 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] No VIF found with MAC fa:16:3e:68:d1:1a, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 03:59:19 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: dad51975-3054-4265-866e-63b1fa778472] Instance destroyed successfully.
Nov 09 03:59:19 user nova-compute[75378]: DEBUG nova.objects.instance [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lazy-loading 'resources' on Instance uuid dad51975-3054-4265-866e-63b1fa778472 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:53:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1516022386',display_name='tempest-TestMinimumBasicScenario-server-1516022386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1516022386',id=31,image_ref='2f041f51-ee71-45c4-8f3e-0fb1c98acb3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyv67vssOeK54qAWZF/k4AYOPOvPnW1WZG29d0czelV0KTeFlhrJn4uR3SgEpddKwTko+voJgQGBLPAiBklPeH/VIPj/HkZhhyo43ED47Xjto74eI7S/rK04aKd0FbnuQ==',key_name='tempest-TestMinimumBasicScenario-51380447',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:53:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a02ac142a06244ef9819e09b22e4a941',ramdisk_id='',reservation_id='r-wdzzcp5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2f041f51-ee71-45c4-8f3e-0fb1c98acb3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-322168895',owner_user_name='tempest-TestMinimumBasicScenario-322168895-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:56:30Z,user_data=None,user_id='b74e4631d102431f83fe51fc39a3768a',uuid=dad51975-3054-4265-866e-63b1fa778472,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "address": "fa:16:3e:18:d4:b6", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeca0fbf-0f", "ovs_interfaceid": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Converting VIF {"id": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "address": "fa:16:3e:18:d4:b6", "network": {"id": "5fa0c6e5-0332-4a5f-b866-8f823ceaa13a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-846462409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a02ac142a06244ef9819e09b22e4a941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeca0fbf-0f", "ovs_interfaceid": "aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:d4:b6,bridge_name='br-int',has_traffic_filtering=True,id=aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8,network=Network(5fa0c6e5-0332-4a5f-b866-8f823ceaa13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeca0fbf-0f') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG os_vif [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:d4:b6,bridge_name='br-int',has_traffic_filtering=True,id=aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8,network=Network(5fa0c6e5-0332-4a5f-b866-8f823ceaa13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeca0fbf-0f') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaeca0fbf-0f, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c66ae1ae-5070-4988-bfaf-bad6ebb37dff) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:59:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:19 user nova-compute[75378]: INFO os_vif [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:d4:b6,bridge_name='br-int',has_traffic_filtering=True,id=aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8,network=Network(5fa0c6e5-0332-4a5f-b866-8f823ceaa13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeca0fbf-0f')
Nov 09 03:59:19 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Deleting instance files /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472_del
Nov 09 03:59:19 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Deletion of /opt/stack/data/nova/instances/dad51975-3054-4265-866e-63b1fa778472_del complete
Nov 09 03:59:20 user nova-compute[75378]: INFO nova.compute.manager [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] [instance: dad51975-3054-4265-866e-63b1fa778472] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 09 03:59:20 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 03:59:20 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: dad51975-3054-4265-866e-63b1fa778472] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 03:59:20 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: dad51975-3054-4265-866e-63b1fa778472] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 03:59:20 user nova-compute[75378]: INFO nova.compute.manager [None req-cbc05c59-2ce6-4344-b536-5100e53b7e8f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Unrescuing
Nov 09 03:59:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cbc05c59-2ce6-4344-b536-5100e53b7e8f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "refresh_cache-9a841180-ac54-4c2a-9e82-4affb78d3fc9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:59:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cbc05c59-2ce6-4344-b536-5100e53b7e8f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquired lock "refresh_cache-9a841180-ac54-4c2a-9e82-4affb78d3fc9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:59:20 user nova-compute[75378]: DEBUG nova.network.neutron [None req-cbc05c59-2ce6-4344-b536-5100e53b7e8f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 03:59:20 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: dad51975-3054-4265-866e-63b1fa778472] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:59:20 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: dad51975-3054-4265-866e-63b1fa778472] Took 0.75 seconds to deallocate network for instance.
Nov 09 03:59:20 user nova-compute[75378]: DEBUG nova.compute.manager [req-22aa3c16-935f-49f9-b0d5-4b46bd052a16 req-7d48adca-4a55-43eb-af15-3bf29f608bc6 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received event network-vif-deleted-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:59:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:20 user nova-compute[75378]: DEBUG nova.network.neutron [None req-cbc05c59-2ce6-4344-b536-5100e53b7e8f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Updating instance_info_cache with network_info: [{"id": "04953f29-39ff-47d1-ba38-55faaa6369ce", "address": "fa:16:3e:7b:a8:05", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04953f29-39", "ovs_interfaceid": "04953f29-39ff-47d1-ba38-55faaa6369ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:59:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cbc05c59-2ce6-4344-b536-5100e53b7e8f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Releasing lock "refresh_cache-9a841180-ac54-4c2a-9e82-4affb78d3fc9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:59:20 user nova-compute[75378]: DEBUG nova.objects.instance [None req-cbc05c59-2ce6-4344-b536-5100e53b7e8f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'flavor' on Instance uuid 9a841180-ac54-4c2a-9e82-4affb78d3fc9 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.496s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:21 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Deleted allocations for instance dad51975-3054-4265-866e-63b1fa778472
Nov 09 03:59:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dbef550e-1894-4491-99f8-7c7602da4fc5 tempest-TestMinimumBasicScenario-322168895 tempest-TestMinimumBasicScenario-322168895-project-member] Lock "dad51975-3054-4265-866e-63b1fa778472" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.382s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG nova.compute.manager [req-4943f742-622d-412d-be19-6951ea6d4b8b req-4d04f1f1-d3d6-4926-9932-9144c25b0ff0 service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Received event network-vif-plugged-971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4943f742-622d-412d-be19-6951ea6d4b8b req-4d04f1f1-d3d6-4926-9932-9144c25b0ff0 service nova] Acquiring lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4943f742-622d-412d-be19-6951ea6d4b8b req-4d04f1f1-d3d6-4926-9932-9144c25b0ff0 service nova] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4943f742-622d-412d-be19-6951ea6d4b8b req-4d04f1f1-d3d6-4926-9932-9144c25b0ff0 service nova] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG nova.compute.manager [req-4943f742-622d-412d-be19-6951ea6d4b8b req-4d04f1f1-d3d6-4926-9932-9144c25b0ff0 service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] No waiting events found dispatching network-vif-plugged-971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:59:21 user nova-compute[75378]: WARNING nova.compute.manager [req-4943f742-622d-412d-be19-6951ea6d4b8b req-4d04f1f1-d3d6-4926-9932-9144c25b0ff0 service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Received unexpected event network-vif-plugged-971f6712-c5e7-4bb6-846d-e165e70fd45a for instance with vm_state building and task_state spawning.
Nov 09 03:59:21 user nova-compute[75378]: DEBUG nova.compute.manager [req-c2ab51e4-04e9-4f66-a72c-031bc288df3b req-6769b148-7b89-4618-b4ea-e27fa03a7180 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received event network-vif-plugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c2ab51e4-04e9-4f66-a72c-031bc288df3b req-6769b148-7b89-4618-b4ea-e27fa03a7180 service nova] Acquiring lock "dad51975-3054-4265-866e-63b1fa778472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c2ab51e4-04e9-4f66-a72c-031bc288df3b req-6769b148-7b89-4618-b4ea-e27fa03a7180 service nova] Lock "dad51975-3054-4265-866e-63b1fa778472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c2ab51e4-04e9-4f66-a72c-031bc288df3b req-6769b148-7b89-4618-b4ea-e27fa03a7180 service nova] Lock "dad51975-3054-4265-866e-63b1fa778472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG nova.compute.manager [req-c2ab51e4-04e9-4f66-a72c-031bc288df3b req-6769b148-7b89-4618-b4ea-e27fa03a7180 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] No waiting events found dispatching network-vif-plugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:59:21 user nova-compute[75378]: WARNING nova.compute.manager [req-c2ab51e4-04e9-4f66-a72c-031bc288df3b req-6769b148-7b89-4618-b4ea-e27fa03a7180 service nova] [instance: dad51975-3054-4265-866e-63b1fa778472] Received unexpected event network-vif-plugged-aeca0fbf-0fe2-4d4f-815c-39c1c1be42c8 for instance with vm_state deleted and task_state None.
Nov 09 03:59:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:22 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Instance destroyed successfully.
Nov 09 03:59:22 user nova-compute[75378]: DEBUG nova.compute.manager [req-de10b0d3-dcf6-499a-aa03-b0ce3270da53 req-4c672e46-13ab-4997-a3be-5ed932b5f309 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received event network-vif-unplugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:59:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-de10b0d3-dcf6-499a-aa03-b0ce3270da53 req-4c672e46-13ab-4997-a3be-5ed932b5f309 service nova] Acquiring lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-de10b0d3-dcf6-499a-aa03-b0ce3270da53 req-4c672e46-13ab-4997-a3be-5ed932b5f309 service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-de10b0d3-dcf6-499a-aa03-b0ce3270da53 req-4c672e46-13ab-4997-a3be-5ed932b5f309 service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:22 user nova-compute[75378]: DEBUG nova.compute.manager [req-de10b0d3-dcf6-499a-aa03-b0ce3270da53 req-4c672e46-13ab-4997-a3be-5ed932b5f309 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] No waiting events found dispatching network-vif-unplugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:59:22 user nova-compute[75378]: WARNING nova.compute.manager [req-de10b0d3-dcf6-499a-aa03-b0ce3270da53 req-4c672e46-13ab-4997-a3be-5ed932b5f309 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received unexpected event network-vif-unplugged-04953f29-39ff-47d1-ba38-55faaa6369ce for instance with vm_state rescued and task_state unrescuing.
Nov 09 03:59:22 user nova-compute[75378]: DEBUG nova.compute.manager [req-de10b0d3-dcf6-499a-aa03-b0ce3270da53 req-4c672e46-13ab-4997-a3be-5ed932b5f309 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received event network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:59:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-de10b0d3-dcf6-499a-aa03-b0ce3270da53 req-4c672e46-13ab-4997-a3be-5ed932b5f309 service nova] Acquiring lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-de10b0d3-dcf6-499a-aa03-b0ce3270da53 req-4c672e46-13ab-4997-a3be-5ed932b5f309 service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-de10b0d3-dcf6-499a-aa03-b0ce3270da53 req-4c672e46-13ab-4997-a3be-5ed932b5f309 service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:22 user nova-compute[75378]: DEBUG nova.compute.manager [req-de10b0d3-dcf6-499a-aa03-b0ce3270da53 req-4c672e46-13ab-4997-a3be-5ed932b5f309 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] No waiting events found dispatching network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:59:22 user nova-compute[75378]: WARNING nova.compute.manager [req-de10b0d3-dcf6-499a-aa03-b0ce3270da53 req-4c672e46-13ab-4997-a3be-5ed932b5f309 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received unexpected event network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce for instance with vm_state rescued and task_state unrescuing.
Nov 09 03:59:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:23 user nova-compute[75378]: DEBUG nova.compute.manager [req-b471dc58-4a5c-4f6b-9f05-cd70c4bd03be req-de29e07d-9bf5-419f-9c91-3ac8468a6426 service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Received event network-vif-plugged-971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:59:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b471dc58-4a5c-4f6b-9f05-cd70c4bd03be req-de29e07d-9bf5-419f-9c91-3ac8468a6426 service nova] Acquiring lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b471dc58-4a5c-4f6b-9f05-cd70c4bd03be req-de29e07d-9bf5-419f-9c91-3ac8468a6426 service nova] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b471dc58-4a5c-4f6b-9f05-cd70c4bd03be req-de29e07d-9bf5-419f-9c91-3ac8468a6426 service nova] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:23 user nova-compute[75378]: DEBUG nova.compute.manager [req-b471dc58-4a5c-4f6b-9f05-cd70c4bd03be req-de29e07d-9bf5-419f-9c91-3ac8468a6426 service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] No waiting events found dispatching network-vif-plugged-971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:59:23 user nova-compute[75378]: WARNING nova.compute.manager [req-b471dc58-4a5c-4f6b-9f05-cd70c4bd03be req-de29e07d-9bf5-419f-9c91-3ac8468a6426 service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Received unexpected event network-vif-plugged-971f6712-c5e7-4bb6-846d-e165e70fd45a for instance with vm_state building and task_state spawning.
Nov 09 03:59:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 03:59:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 03:59:23 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Instance spawned successfully.
Nov 09 03:59:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 03:59:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:59:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:59:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:59:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:59:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:59:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 03:59:24 user nova-compute[75378]: INFO nova.compute.manager [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 09 03:59:24 user nova-compute[75378]: DEBUG nova.compute.manager [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:59:24 user nova-compute[75378]: INFO nova.compute.manager [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Took 32.84 seconds to build instance.
Nov 09 03:59:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-664ddc35-db44-4c1a-b053-84218d6b4508 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.954s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:24 user nova-compute[75378]: DEBUG nova.compute.manager [req-5b1b4134-d6a7-410a-a610-edf403b8bd49 req-767ad74e-41d2-443b-9619-9ebe58cf3465 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received event network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:59:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5b1b4134-d6a7-410a-a610-edf403b8bd49 req-767ad74e-41d2-443b-9619-9ebe58cf3465 service nova] Acquiring lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5b1b4134-d6a7-410a-a610-edf403b8bd49 req-767ad74e-41d2-443b-9619-9ebe58cf3465 service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5b1b4134-d6a7-410a-a610-edf403b8bd49 req-767ad74e-41d2-443b-9619-9ebe58cf3465 service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:24 user nova-compute[75378]: DEBUG nova.compute.manager [req-5b1b4134-d6a7-410a-a610-edf403b8bd49 req-767ad74e-41d2-443b-9619-9ebe58cf3465 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] No waiting events found dispatching network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:59:24 user nova-compute[75378]: WARNING nova.compute.manager [req-5b1b4134-d6a7-410a-a610-edf403b8bd49 req-767ad74e-41d2-443b-9619-9ebe58cf3465 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received unexpected event network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce for instance with vm_state rescued and task_state unrescuing.
Nov 09 03:59:24 user nova-compute[75378]: DEBUG nova.compute.manager [req-5b1b4134-d6a7-410a-a610-edf403b8bd49 req-767ad74e-41d2-443b-9619-9ebe58cf3465 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received event network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:59:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5b1b4134-d6a7-410a-a610-edf403b8bd49 req-767ad74e-41d2-443b-9619-9ebe58cf3465 service nova] Acquiring lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5b1b4134-d6a7-410a-a610-edf403b8bd49 req-767ad74e-41d2-443b-9619-9ebe58cf3465 service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-5b1b4134-d6a7-410a-a610-edf403b8bd49 req-767ad74e-41d2-443b-9619-9ebe58cf3465 service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:24 user nova-compute[75378]: DEBUG nova.compute.manager [req-5b1b4134-d6a7-410a-a610-edf403b8bd49 req-767ad74e-41d2-443b-9619-9ebe58cf3465 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] No waiting events found dispatching network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 03:59:24 user nova-compute[75378]: WARNING nova.compute.manager [req-5b1b4134-d6a7-410a-a610-edf403b8bd49 req-767ad74e-41d2-443b-9619-9ebe58cf3465 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received unexpected event network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce for instance with vm_state rescued and task_state unrescuing.
Nov 09 03:59:25 user nova-compute[75378]: DEBUG nova.compute.manager [None req-cbc05c59-2ce6-4344-b536-5100e53b7e8f tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 03:59:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:36 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:59:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:38 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:59:39 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:59:39 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:59:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-11f18164-9676-4a8a-91be-8bd87673ec5b" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:59:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-11f18164-9676-4a8a-91be-8bd87673ec5b" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:59:39 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 03:59:39 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Updating instance_info_cache with network_info: [{"id": "a18b5039-3584-437a-b55f-b72630693484", "address": "fa:16:3e:f3:24:46", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa18b5039-35", "ovs_interfaceid": "a18b5039-3584-437a-b55f-b72630693484", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:59:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-11f18164-9676-4a8a-91be-8bd87673ec5b" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:59:39 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 03:59:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:41 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:59:41 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:59:41 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:59:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:42 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:59:44 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:59:44 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:59:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:44 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:59:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:59:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa/disk --force-share --output=json" returned: 0 in 0.380s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:45 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:45 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:45 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:45 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:45 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:45 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.347s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:45 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:59:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:59:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 03:59:48 user nova-compute[75378]: DEBUG nova.compute.manager [req-6743a53e-d6d7-4b72-8330-d0dda33d4127 req-22a14e4c-ca4f-411a-b424-ffbc21dc819b service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Received event network-changed-fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 03:59:48 user nova-compute[75378]: DEBUG nova.compute.manager [req-6743a53e-d6d7-4b72-8330-d0dda33d4127 req-22a14e4c-ca4f-411a-b424-ffbc21dc819b service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Refreshing instance network info cache due to event network-changed-fb8b1969-9e49-47a4-a528-43c6673bd63d. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 03:59:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6743a53e-d6d7-4b72-8330-d0dda33d4127 req-22a14e4c-ca4f-411a-b424-ffbc21dc819b service nova] Acquiring lock "refresh_cache-eb8117df-cf63-4bc9-9691-4828ff7f5a8e" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 03:59:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6743a53e-d6d7-4b72-8330-d0dda33d4127 req-22a14e4c-ca4f-411a-b424-ffbc21dc819b service nova] Acquired lock "refresh_cache-eb8117df-cf63-4bc9-9691-4828ff7f5a8e" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 03:59:48 user nova-compute[75378]: DEBUG nova.network.neutron [req-6743a53e-d6d7-4b72-8330-d0dda33d4127 req-22a14e4c-ca4f-411a-b424-ffbc21dc819b service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Refreshing network info cache for port fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 03:59:48 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:59:48 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:59:48 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7540MB free_disk=24.489402770996094GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:59:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7d051405-6b57-4db2-9533-c2f4e87134d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2c2acb48-972a-41d7-987e-48e79b3bef93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 013db901-fbee-4593-a14f-95a03e79fad0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 11f18164-9676-4a8a-91be-8bd87673ec5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9a841180-ac54-4c2a-9e82-4affb78d3fc9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 06799031-9998-4829-8725-09526681c442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance eb8117df-cf63-4bc9-9691-4828ff7f5a8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 1967e205-2619-498f-b115-d15bb82d6efa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9dcaeb12-99bc-48f0-aec9-3de2a3770e01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 19359be7-5789-4d89-bc5a-c6c5ccd52211 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquiring lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG nova.objects.instance [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lazy-loading 'flavor' on Instance uuid eb8117df-cf63-4bc9-9691-4828ff7f5a8e {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG nova.network.neutron [req-6743a53e-d6d7-4b72-8330-d0dda33d4127 req-22a14e4c-ca4f-411a-b424-ffbc21dc819b service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Updated VIF entry in instance network info cache for port fb8b1969-9e49-47a4-a528-43c6673bd63d. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG nova.network.neutron [req-6743a53e-d6d7-4b72-8330-d0dda33d4127 req-22a14e4c-ca4f-411a-b424-ffbc21dc819b service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Updating instance_info_cache with network_info: [{"id": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "address": "fa:16:3e:5b:d9:0b", "network": {"id": "45fb3f32-bd04-41a3-bbf0-0d85276e8495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1831642379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52d99bb19e6343af92da922122e2a440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8b1969-9e", "ovs_interfaceid": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6743a53e-d6d7-4b72-8330-d0dda33d4127 req-22a14e4c-ca4f-411a-b424-ffbc21dc819b service nova] Releasing lock "refresh_cache-eb8117df-cf63-4bc9-9691-4828ff7f5a8e" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquiring lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:59:49 user nova-compute[75378]: INFO nova.compute.manager [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Attaching volume 9d394411-cc83-4308-ac96-0af3f47f7da2 to /dev/vdb
Nov 09 03:59:49 user nova-compute[75378]: DEBUG os_brick.utils [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7c5057-2ae3-4d38-8293-5d332205e4fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[385b5203-147f-4c0b-87da-80c5a090c5ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35d4666-1a4c-4ee0-a1b2-3cf535c148d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9369c4c9-8617-4c3f-8751-bc44dcff337c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 03:59:49 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 03:59:49 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d63151-772f-4f8a-b10f-3f0192037d0a]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG os_brick.utils [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 03:59:49 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Updating existing volume attachment record: 1663f1c7-ab0c-489d-845d-adead39e5a24 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 03:59:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:50 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:59:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:59:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:01 user nova-compute[75378]: DEBUG nova.compute.manager [req-7017d030-eaf8-4b24-936f-3e58c6c71509 req-51cd789e-c0dd-4976-8f94-a77527dd6a5f service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Received event network-changed-dedb00e6-5dfd-437b-a836-8ba236348811 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:00:01 user nova-compute[75378]: DEBUG nova.compute.manager [req-7017d030-eaf8-4b24-936f-3e58c6c71509 req-51cd789e-c0dd-4976-8f94-a77527dd6a5f service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Refreshing instance network info cache due to event network-changed-dedb00e6-5dfd-437b-a836-8ba236348811. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:00:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7017d030-eaf8-4b24-936f-3e58c6c71509 req-51cd789e-c0dd-4976-8f94-a77527dd6a5f service nova] Acquiring lock "refresh_cache-1967e205-2619-498f-b115-d15bb82d6efa" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:00:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7017d030-eaf8-4b24-936f-3e58c6c71509 req-51cd789e-c0dd-4976-8f94-a77527dd6a5f service nova] Acquired lock "refresh_cache-1967e205-2619-498f-b115-d15bb82d6efa" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:00:01 user nova-compute[75378]: DEBUG nova.network.neutron [req-7017d030-eaf8-4b24-936f-3e58c6c71509 req-51cd789e-c0dd-4976-8f94-a77527dd6a5f service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Refreshing network info cache for port dedb00e6-5dfd-437b-a836-8ba236348811 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:00:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "1967e205-2619-498f-b115-d15bb82d6efa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "1967e205-2619-498f-b115-d15bb82d6efa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "1967e205-2619-498f-b115-d15bb82d6efa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "1967e205-2619-498f-b115-d15bb82d6efa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "1967e205-2619-498f-b115-d15bb82d6efa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:00:02 user nova-compute[75378]: INFO nova.compute.manager [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Terminating instance
Nov 09 04:00:02 user nova-compute[75378]: DEBUG nova.compute.manager [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG nova.network.neutron [req-7017d030-eaf8-4b24-936f-3e58c6c71509 req-51cd789e-c0dd-4976-8f94-a77527dd6a5f service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Updated VIF entry in instance network info cache for port dedb00e6-5dfd-437b-a836-8ba236348811. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG nova.network.neutron [req-7017d030-eaf8-4b24-936f-3e58c6c71509 req-51cd789e-c0dd-4976-8f94-a77527dd6a5f service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Updating instance_info_cache with network_info: [{"id": "dedb00e6-5dfd-437b-a836-8ba236348811", "address": "fa:16:3e:9a:ca:d9", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdedb00e6-5d", "ovs_interfaceid": "dedb00e6-5dfd-437b-a836-8ba236348811", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7017d030-eaf8-4b24-936f-3e58c6c71509 req-51cd789e-c0dd-4976-8f94-a77527dd6a5f service nova] Releasing lock "refresh_cache-1967e205-2619-498f-b115-d15bb82d6efa" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG nova.compute.manager [req-cb59ad04-a646-4926-8618-27047da50b4b req-482bbfdb-45d5-4af2-ab14-1bf20aab347c service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Received event network-vif-unplugged-dedb00e6-5dfd-437b-a836-8ba236348811 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cb59ad04-a646-4926-8618-27047da50b4b req-482bbfdb-45d5-4af2-ab14-1bf20aab347c service nova] Acquiring lock "1967e205-2619-498f-b115-d15bb82d6efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cb59ad04-a646-4926-8618-27047da50b4b req-482bbfdb-45d5-4af2-ab14-1bf20aab347c service nova] Lock "1967e205-2619-498f-b115-d15bb82d6efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-cb59ad04-a646-4926-8618-27047da50b4b req-482bbfdb-45d5-4af2-ab14-1bf20aab347c service nova] Lock "1967e205-2619-498f-b115-d15bb82d6efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG nova.compute.manager [req-cb59ad04-a646-4926-8618-27047da50b4b req-482bbfdb-45d5-4af2-ab14-1bf20aab347c service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] No waiting events found dispatching network-vif-unplugged-dedb00e6-5dfd-437b-a836-8ba236348811 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG nova.compute.manager [req-cb59ad04-a646-4926-8618-27047da50b4b req-482bbfdb-45d5-4af2-ab14-1bf20aab347c service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Received event network-vif-unplugged-dedb00e6-5dfd-437b-a836-8ba236348811 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:02 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Instance destroyed successfully.
Nov 09 04:00:02 user nova-compute[75378]: DEBUG nova.objects.instance [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lazy-loading 'resources' on Instance uuid 1967e205-2619-498f-b115-d15bb82d6efa {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-754031776',display_name='tempest-AttachVolumeNegativeTest-server-754031776',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-754031776',id=36,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhV2uvNvHOZuwr3xj2P9pJuzXRS9XfzEVc6/Jwj79Nxgu4d+2GIk4g31lN3OecirP2fHL4WPD7GQ+0IIfEQ83VuFIUJodQp0s/i63qOQQbJwgoJ6kyZ26QHTWoRy+saHg==',key_name='tempest-keypair-1871735098',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:58:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d990b7b4c19436d8cd8f43d8d0facb9',ramdisk_id='',reservation_id='r-cl4hro47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-921155549',owner_user_name='tempest-AttachVolumeNegativeTest-921155549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:58:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afcdb0627e34b6e893b7981ea4615e3',uuid=1967e205-2619-498f-b115-d15bb82d6efa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dedb00e6-5dfd-437b-a836-8ba236348811", "address": "fa:16:3e:9a:ca:d9", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdedb00e6-5d", "ovs_interfaceid": "dedb00e6-5dfd-437b-a836-8ba236348811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converting VIF {"id": "dedb00e6-5dfd-437b-a836-8ba236348811", "address": "fa:16:3e:9a:ca:d9", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdedb00e6-5d", "ovs_interfaceid": "dedb00e6-5dfd-437b-a836-8ba236348811", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ca:d9,bridge_name='br-int',has_traffic_filtering=True,id=dedb00e6-5dfd-437b-a836-8ba236348811,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdedb00e6-5d') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG os_vif [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ca:d9,bridge_name='br-int',has_traffic_filtering=True,id=dedb00e6-5dfd-437b-a836-8ba236348811,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdedb00e6-5d') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdedb00e6-5d, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=baf5b2e4-edbb-44fe-a5a5-bb7344d62cac) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:02 user nova-compute[75378]: INFO os_vif [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:ca:d9,bridge_name='br-int',has_traffic_filtering=True,id=dedb00e6-5dfd-437b-a836-8ba236348811,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdedb00e6-5d')
Nov 09 04:00:02 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Deleting instance files /opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa_del
Nov 09 04:00:02 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Deletion of /opt/stack/data/nova/instances/1967e205-2619-498f-b115-d15bb82d6efa_del complete
Nov 09 04:00:02 user nova-compute[75378]: INFO nova.compute.manager [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 09 04:00:02 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:00:02 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:00:03 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:00:03 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Took 0.77 seconds to deallocate network for instance.
Nov 09 04:00:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:00:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:00:03 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:00:03 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:00:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:00:04 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Deleted allocations for instance 1967e205-2619-498f-b115-d15bb82d6efa
Nov 09 04:00:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-50904689-270d-4dd6-bd44-2b3fd7fcdfef tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "1967e205-2619-498f-b115-d15bb82d6efa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.070s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:00:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-eb56c53e-1972-4357-9d73-37c22428d16d req-4ffcf544-1f80-4dfe-b89b-1e0a5a06541e service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Received event network-vif-plugged-dedb00e6-5dfd-437b-a836-8ba236348811 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:00:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-eb56c53e-1972-4357-9d73-37c22428d16d req-4ffcf544-1f80-4dfe-b89b-1e0a5a06541e service nova] Acquiring lock "1967e205-2619-498f-b115-d15bb82d6efa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:00:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-eb56c53e-1972-4357-9d73-37c22428d16d req-4ffcf544-1f80-4dfe-b89b-1e0a5a06541e service nova] Lock "1967e205-2619-498f-b115-d15bb82d6efa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:00:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-eb56c53e-1972-4357-9d73-37c22428d16d req-4ffcf544-1f80-4dfe-b89b-1e0a5a06541e service nova] Lock "1967e205-2619-498f-b115-d15bb82d6efa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:00:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-eb56c53e-1972-4357-9d73-37c22428d16d req-4ffcf544-1f80-4dfe-b89b-1e0a5a06541e service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] No waiting events found dispatching network-vif-plugged-dedb00e6-5dfd-437b-a836-8ba236348811 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:00:04 user nova-compute[75378]: WARNING nova.compute.manager [req-eb56c53e-1972-4357-9d73-37c22428d16d req-4ffcf544-1f80-4dfe-b89b-1e0a5a06541e service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Received unexpected event network-vif-plugged-dedb00e6-5dfd-437b-a836-8ba236348811 for instance with vm_state deleted and task_state None.
Nov 09 04:00:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-eb56c53e-1972-4357-9d73-37c22428d16d req-4ffcf544-1f80-4dfe-b89b-1e0a5a06541e service nova] [instance: 1967e205-2619-498f-b115-d15bb82d6efa] Received event network-vif-deleted-dedb00e6-5dfd-437b-a836-8ba236348811 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:00:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mKlbrYDZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:00:32 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:00:32 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:00:32 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:00:32 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:00:32 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[706f2486-ebf1-4aa5-b67e-6470e441a00f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 04:00:32 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe2f65a-b28b-4230-84c6-2a79174c03b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2] added
Nov 09 04:00:32 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[13803b6b-06d1-42d4-91e7-28264871a0dc]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d04a8b-32e2-48a7-b727-ea09c29b0ad3]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mKlbrYDZ {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mKlbrYDZ" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4496143-7f58-4f3f-bf15-db98b4df294f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mKlbrYDZ'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2fc619-4c70-4833-a146-84abcd63661c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcf794d-7b57-4700-996b-33f4bcdd6d26]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:00:32 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 04:00:32 user nova-compute[75378]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)
Nov 09 04:00:32 user nova-compute[75378]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:00:32 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:00:32 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 04:00:32 user nova-compute[75378]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)
Nov 09 04:00:32 user nova-compute[75378]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:00:32 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b0583e-9960-4a8e-a6da-2accd7ba90c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2, portal: 172.16.0.220,3260]
Nov 09 04:00:32 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2, portal: 172.16.0.220,3260] successful.
Nov 09 04:00:32 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0769df41-a201-465f-8ea9-1b945cde1b78]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8360de99-fd24-47fb-86a9-c1cbf806fbc0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:00:32 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 04:00:32 user nova-compute[75378]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)
Nov 09 04:00:32 user nova-compute[75378]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:00:32 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:00:32 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:00:32 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 04:00:32 user nova-compute[75378]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)
Nov 09 04:00:32 user nova-compute[75378]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:00:32 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:00:32 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] HCTL ('37', '-', '-', 0) found on session 39 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 04:00:32 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f380b4-8971-4f1c-b2a2-bcd9caf65a38]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:33 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Searching for a device in session 39 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:00:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mKlbrYDZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 04:00:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:00:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '26130636262303034', 'path': '/dev/sdf'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:00:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130636262303034', 'path': '/dev/sdf'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 04:00:34 user nova-compute[75378]: DEBUG nova.objects.instance [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lazy-loading 'flavor' on Instance uuid eb8117df-cf63-4bc9-9691-4828ff7f5a8e {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:00:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 04:00:34 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:00:34 user nova-compute[75378]:   <source dev="/dev/sdf"/>
Nov 09 04:00:34 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 04:00:34 user nova-compute[75378]:   <serial>9d394411-cc83-4308-ac96-0af3f47f7da2</serial>
Nov 09 04:00:34 user nova-compute[75378]: </disk>
Nov 09 04:00:34 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 04:00:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:00:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:00:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] No VIF found with MAC fa:16:3e:5b:d9:0b, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:00:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-677e6378-e488-4e27-b3b8-2f6977805b4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 45.052s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:00:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:38 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:00:38 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:00:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquiring lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:00:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:00:38 user nova-compute[75378]: DEBUG nova.objects.instance [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lazy-loading 'flavor' on Instance uuid eb8117df-cf63-4bc9-9691-4828ff7f5a8e {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:00:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:00:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquiring lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:00:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:00:38 user nova-compute[75378]: INFO nova.compute.manager [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Attaching volume 23c47b9a-6716-4f1f-b05d-5052b07cf5e2 to /dev/vdc
Nov 09 04:00:38 user nova-compute[75378]: DEBUG os_brick.utils [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:00:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:38 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[190dee5b-797d-4b34-a694-3195bcebeafc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[507b6e30-584b-4ea5-8c60-6af2bbe523d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3f5a7b-7081-4985-88dc-74091ce1e138]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79d5516-468a-49fe-808a-829cfb10da18]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:00:39 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 04:00:39 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5a01d3-2eb8-44a6-bc2c-3c71989b24ff]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG os_brick.utils [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Updating existing volume attachment record: 2550a182-10d6-4655-b7bc-999ef2fd1c20 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-9a841180-ac54-4c2a-9e82-4affb78d3fc9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-9a841180-ac54-4c2a-9e82-4affb78d3fc9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Updating instance_info_cache with network_info: [{"id": "04953f29-39ff-47d1-ba38-55faaa6369ce", "address": "fa:16:3e:7b:a8:05", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04953f29-39", "ovs_interfaceid": "04953f29-39ff-47d1-ba38-55faaa6369ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-9a841180-ac54-4c2a-9e82-4affb78d3fc9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:00:39 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 04:00:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:42 user nova-compute[75378]: DEBUG nova.compute.manager [req-267c2e42-dcfb-4e60-a0ac-e1fb06522795 req-745f2e22-5eb9-43b0-b3c9-5e5c55c8bc04 service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Received event network-changed-70d7d7ee-d1e8-4b8c-981b-26394c1b1edc {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:00:42 user nova-compute[75378]: DEBUG nova.compute.manager [req-267c2e42-dcfb-4e60-a0ac-e1fb06522795 req-745f2e22-5eb9-43b0-b3c9-5e5c55c8bc04 service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Refreshing instance network info cache due to event network-changed-70d7d7ee-d1e8-4b8c-981b-26394c1b1edc. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:00:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-267c2e42-dcfb-4e60-a0ac-e1fb06522795 req-745f2e22-5eb9-43b0-b3c9-5e5c55c8bc04 service nova] Acquiring lock "refresh_cache-2c2acb48-972a-41d7-987e-48e79b3bef93" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:00:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-267c2e42-dcfb-4e60-a0ac-e1fb06522795 req-745f2e22-5eb9-43b0-b3c9-5e5c55c8bc04 service nova] Acquired lock "refresh_cache-2c2acb48-972a-41d7-987e-48e79b3bef93" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:00:42 user nova-compute[75378]: DEBUG nova.network.neutron [req-267c2e42-dcfb-4e60-a0ac-e1fb06522795 req-745f2e22-5eb9-43b0-b3c9-5e5c55c8bc04 service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Refreshing network info cache for port 70d7d7ee-d1e8-4b8c-981b-26394c1b1edc {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:00:42 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:00:42 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:00:42 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:00:42 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:00:42 user nova-compute[75378]: DEBUG nova.network.neutron [req-267c2e42-dcfb-4e60-a0ac-e1fb06522795 req-745f2e22-5eb9-43b0-b3c9-5e5c55c8bc04 service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Updated VIF entry in instance network info cache for port 70d7d7ee-d1e8-4b8c-981b-26394c1b1edc. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:00:42 user nova-compute[75378]: DEBUG nova.network.neutron [req-267c2e42-dcfb-4e60-a0ac-e1fb06522795 req-745f2e22-5eb9-43b0-b3c9-5e5c55c8bc04 service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Updating instance_info_cache with network_info: [{"id": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "address": "fa:16:3e:02:bc:fb", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d7d7ee-d1", "ovs_interfaceid": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:00:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-267c2e42-dcfb-4e60-a0ac-e1fb06522795 req-745f2e22-5eb9-43b0-b3c9-5e5c55c8bc04 service nova] Releasing lock "refresh_cache-2c2acb48-972a-41d7-987e-48e79b3bef93" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:00:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:43 user nova-compute[75378]: DEBUG nova.compute.manager [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Stashing vm_state: active {{(pid=75378) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 09 04:00:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:00:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:00:44 user nova-compute[75378]: DEBUG nova.compute.manager [req-42f44bfa-a122-41f2-a344-7df107aa38f9 req-b52815b1-815d-412e-9dd4-b224356f867c service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Received event network-changed-971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:00:44 user nova-compute[75378]: DEBUG nova.compute.manager [req-42f44bfa-a122-41f2-a344-7df107aa38f9 req-b52815b1-815d-412e-9dd4-b224356f867c service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Refreshing instance network info cache due to event network-changed-971f6712-c5e7-4bb6-846d-e165e70fd45a. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:00:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-42f44bfa-a122-41f2-a344-7df107aa38f9 req-b52815b1-815d-412e-9dd4-b224356f867c service nova] Acquiring lock "refresh_cache-9dcaeb12-99bc-48f0-aec9-3de2a3770e01" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:00:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-42f44bfa-a122-41f2-a344-7df107aa38f9 req-b52815b1-815d-412e-9dd4-b224356f867c service nova] Acquired lock "refresh_cache-9dcaeb12-99bc-48f0-aec9-3de2a3770e01" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:00:44 user nova-compute[75378]: DEBUG nova.network.neutron [req-42f44bfa-a122-41f2-a344-7df107aa38f9 req-b52815b1-815d-412e-9dd4-b224356f867c service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Refreshing network info cache for port 971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:00:44 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 04:00:44 user nova-compute[75378]: INFO nova.compute.claims [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Claim successful on node user
Nov 09 04:00:44 user nova-compute[75378]: INFO nova.compute.resource_tracker [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Updating resource usage from migration 2ea6362c-e6eb-4d1d-82f9-28e22bbac1b4
Nov 09 04:00:44 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:00:44 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:00:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.453s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:00:44 user nova-compute[75378]: INFO nova.compute.manager [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Migrating
Nov 09 04:00:44 user nova-compute[75378]: DEBUG nova.network.neutron [req-42f44bfa-a122-41f2-a344-7df107aa38f9 req-b52815b1-815d-412e-9dd4-b224356f867c service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Updated VIF entry in instance network info cache for port 971f6712-c5e7-4bb6-846d-e165e70fd45a. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:00:44 user nova-compute[75378]: DEBUG nova.network.neutron [req-42f44bfa-a122-41f2-a344-7df107aa38f9 req-b52815b1-815d-412e-9dd4-b224356f867c service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Updating instance_info_cache with network_info: [{"id": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "address": "fa:16:3e:68:d1:1a", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971f6712-c5", "ovs_interfaceid": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:00:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "refresh_cache-9dcaeb12-99bc-48f0-aec9-3de2a3770e01" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:00:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-42f44bfa-a122-41f2-a344-7df107aa38f9 req-b52815b1-815d-412e-9dd4-b224356f867c service nova] Releasing lock "refresh_cache-9dcaeb12-99bc-48f0-aec9-3de2a3770e01" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:00:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquired lock "refresh_cache-9dcaeb12-99bc-48f0-aec9-3de2a3770e01" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:00:44 user nova-compute[75378]: DEBUG nova.network.neutron [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG nova.network.neutron [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Updating instance_info_cache with network_info: [{"id": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "address": "fa:16:3e:68:d1:1a", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971f6712-c5", "ovs_interfaceid": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Releasing lock "refresh_cache-9dcaeb12-99bc-48f0-aec9-3de2a3770e01" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Starting migrate_disk_and_power_off {{(pid=75378) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-50d2b9b0-bb1f-4cc5-9ba6-c65c3f05e974 req-3a87b08b-5ec1-4ddd-a310-a989d08757bd service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Received event network-vif-unplugged-971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-50d2b9b0-bb1f-4cc5-9ba6-c65c3f05e974 req-3a87b08b-5ec1-4ddd-a310-a989d08757bd service nova] Acquiring lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-50d2b9b0-bb1f-4cc5-9ba6-c65c3f05e974 req-3a87b08b-5ec1-4ddd-a310-a989d08757bd service nova] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-50d2b9b0-bb1f-4cc5-9ba6-c65c3f05e974 req-3a87b08b-5ec1-4ddd-a310-a989d08757bd service nova] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-50d2b9b0-bb1f-4cc5-9ba6-c65c3f05e974 req-3a87b08b-5ec1-4ddd-a310-a989d08757bd service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] No waiting events found dispatching network-vif-unplugged-971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:00:45 user nova-compute[75378]: WARNING nova.compute.manager [req-50d2b9b0-bb1f-4cc5-9ba6-c65c3f05e974 req-3a87b08b-5ec1-4ddd-a310-a989d08757bd service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Received unexpected event network-vif-unplugged-971f6712-c5e7-4bb6-846d-e165e70fd45a for instance with vm_state active and task_state resize_migrating.
Nov 09 04:00:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:45 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Instance destroyed successfully.
Nov 09 04:00:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:58:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-313014061',display_name='tempest-ServerActionsTestOtherA-server-313014061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-313014061',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFabS+mewwrg7oOEw/0EoMWlEwIz3NoSF6MUhLgvIEWjSZH9d/Fg8M+DuLJkZN6SKSXE9qeztuGxbDfpg7EHMNtmRvy2F5yoI+XGOsX3tR4ssTADXmphKv1NsnpmlrDrQg==',key_name='tempest-keypair-138130530',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:59:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='548993d280024b60b3778b026177e356',ramdisk_id='',reservation_id='r-a17ajdc9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2010465588',owner_user_name='tempest-ServerActionsTestOtherA-2010465588-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:00:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d4f0858695e4509a6b0ab99a8212571',uuid=9dcaeb12-99bc-48f0-aec9-3de2a3770e01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "address": "fa:16:3e:68:d1:1a", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1061624576-network", "vif_mac": "fa:16:3e:68:d1:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971f6712-c5", "ovs_interfaceid": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converting VIF {"id": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "address": "fa:16:3e:68:d1:1a", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1061624576-network", "vif_mac": "fa:16:3e:68:d1:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971f6712-c5", "ovs_interfaceid": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:d1:1a,bridge_name='br-int',has_traffic_filtering=True,id=971f6712-c5e7-4bb6-846d-e165e70fd45a,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap971f6712-c5') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG os_vif [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:d1:1a,bridge_name='br-int',has_traffic_filtering=True,id=971f6712-c5e7-4bb6-846d-e165e70fd45a,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap971f6712-c5') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap971f6712-c5, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf81237f-09ba-4c68-a40a-b98cb7d06e8a) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:45 user nova-compute[75378]: INFO os_vif [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:d1:1a,bridge_name='br-int',has_traffic_filtering=True,id=971f6712-c5e7-4bb6-846d-e165e70fd45a,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap971f6712-c5')
Nov 09 04:00:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPVFTdZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:00:45 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:00:45 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:45 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc434f7-55f9-46a8-ac8d-28553198bebf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 04:00:46 user nova-compute[75378]: No targets found.
Nov 09 04:00:46 user nova-compute[75378]: iSNS:
Nov 09 04:00:46 user nova-compute[75378]: No targets found.
Nov 09 04:00:46 user nova-compute[75378]: STATIC:
Nov 09 04:00:46 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 04:00:46 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:00:46 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:00:46 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171
Nov 09 04:00:46 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:00:46 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:00:46 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2
Nov 09 04:00:46 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:00:46 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:00:46 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723
Nov 09 04:00:46 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:00:46 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:00:46 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522
Nov 09 04:00:46 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:00:46 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:00:46 user nova-compute[75378]: FIRMWARE:
Nov 09 04:00:46 user nova-compute[75378]: No targets found.
Nov 09 04:00:46 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 04:00:46 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 04:00:46 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd01c5df-e000-4b60-9f9a-269a8c1c59e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d913c005-95a8-4f6c-82bc-15c79bbefd22]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:00:46 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 04:00:46 user nova-compute[75378]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)
Nov 09 04:00:46 user nova-compute[75378]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:00:46 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:00:46 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:00:46 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 04:00:46 user nova-compute[75378]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)
Nov 09 04:00:46 user nova-compute[75378]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:00:46 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:00:46 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c7b6950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723'): ({'sdb'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Removing single pathed devices sdb {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[378ad4aa-4d8a-4de2-9b41-fd887f8350c9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[29331785-22c7-48a1-a07e-494150296bff]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Flushing IO for device /dev/sdb {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f07903-b025-42b5-86c0-b29f89693000]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddcdc65-81a6-4cf4-b909-e0c3231676e7]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23233633336393938', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a429d6c6', '/dev/disk/by-id/scsi-1SCST_BIOa429d6c6-23c369989fa74f1b') {{(pid=87049) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[114a86cf-e50a-45de-8b43-4d25754f483e]: (4, None) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d71823-70aa-4584-bbe1-d8f26b4bec15]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a1e043-b00e-4bbe-8c5d-abf1453b2b79]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723, portal: 172.16.0.220,3260]
Nov 09 04:00:46 user nova-compute[75378]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723, portal: 172.16.0.220,3260] successful.
Nov 09 04:00:46 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aec0797-0ba1-42be-a6e1-2f8f5c8741c4]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] <== disconnect_volume: return (383ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG nova.compute.manager [req-8ca54364-8c74-4e66-8c08-ab3fd310c532 req-7cf901c4-9f2f-41fc-8b8b-921ebfe190e5 service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Received event network-vif-plugged-971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8ca54364-8c74-4e66-8c08-ab3fd310c532 req-7cf901c4-9f2f-41fc-8b8b-921ebfe190e5 service nova] Acquiring lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8ca54364-8c74-4e66-8c08-ab3fd310c532 req-7cf901c4-9f2f-41fc-8b8b-921ebfe190e5 service nova] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8ca54364-8c74-4e66-8c08-ab3fd310c532 req-7cf901c4-9f2f-41fc-8b8b-921ebfe190e5 service nova] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG nova.compute.manager [req-8ca54364-8c74-4e66-8c08-ab3fd310c532 req-7cf901c4-9f2f-41fc-8b8b-921ebfe190e5 service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] No waiting events found dispatching network-vif-plugged-971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:00:47 user nova-compute[75378]: WARNING nova.compute.manager [req-8ca54364-8c74-4e66-8c08-ab3fd310c532 req-7cf901c4-9f2f-41fc-8b8b-921ebfe190e5 service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Received unexpected event network-vif-plugged-971f6712-c5e7-4bb6-846d-e165e70fd45a for instance with vm_state active and task_state resize_migrating.
Nov 09 04:00:47 user nova-compute[75378]: DEBUG nova.network.neutron [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Port 971f6712-c5e7-4bb6-846d-e165e70fd45a binding to destination host user is already ACTIVE {{(pid=75378) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "refresh_cache-9dcaeb12-99bc-48f0-aec9-3de2a3770e01" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquired lock "refresh_cache-9dcaeb12-99bc-48f0-aec9-3de2a3770e01" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG nova.network.neutron [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG nova.network.neutron [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Updating instance_info_cache with network_info: [{"id": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "address": "fa:16:3e:68:d1:1a", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971f6712-c5", "ovs_interfaceid": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Releasing lock "refresh_cache-9dcaeb12-99bc-48f0-aec9-3de2a3770e01" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG os_brick.utils [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cd21d2-63f2-48b3-a73e-b756182f86d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df8d122-729e-4b72-b41d-06b0791ed924]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edcf0d9-c01f-429b-a81d-fba62d55582c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[48460814-5f7c-4c04-b53c-9a76114ef3a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:00:48 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2405136-66dc-4f9d-86c2-8284d8843020]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG os_brick.utils [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:00:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:00:49 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:00:49 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:00:49 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:00:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7909MB free_disk=25.028762817382812GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:00:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:00:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:00:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Applying migration context for instance 9dcaeb12-99bc-48f0-aec9-3de2a3770e01 as it has an incoming, in-progress migration 2ea6362c-e6eb-4d1d-82f9-28e22bbac1b4. Migration status is post-migrating {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 09 04:00:49 user nova-compute[75378]: INFO nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Updating resource usage from migration 2ea6362c-e6eb-4d1d-82f9-28e22bbac1b4
Nov 09 04:00:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7d051405-6b57-4db2-9533-c2f4e87134d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:00:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2c2acb48-972a-41d7-987e-48e79b3bef93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:00:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 013db901-fbee-4593-a14f-95a03e79fad0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:00:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 11f18164-9676-4a8a-91be-8bd87673ec5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:00:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9a841180-ac54-4c2a-9e82-4affb78d3fc9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:00:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 06799031-9998-4829-8725-09526681c442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:00:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance eb8117df-cf63-4bc9-9691-4828ff7f5a8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:00:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 19359be7-5789-4d89-bc5a-c6c5ccd52211 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:00:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Migration 2ea6362c-e6eb-4d1d-82f9-28e22bbac1b4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 09 04:00:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9dcaeb12-99bc-48f0-aec9-3de2a3770e01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:00:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:00:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:00:50 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:00:50 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:00:50 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:00:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.576s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:00:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "06799031-9998-4829-8725-09526681c442" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:00:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "06799031-9998-4829-8725-09526681c442" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:00:53 user nova-compute[75378]: INFO nova.compute.manager [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Detaching volume 7f29cbb5-01fa-4fc0-a79f-8716980ba171
Nov 09 04:00:53 user nova-compute[75378]: INFO nova.virt.block_device [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Attempting to driver detach volume 7f29cbb5-01fa-4fc0-a79f-8716980ba171 from mountpoint /dev/vdb
Nov 09 04:00:53 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Attempting to detach device vdb from instance 06799031-9998-4829-8725-09526681c442 from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 04:00:53 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 04:00:53 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:00:53 user nova-compute[75378]:   <source dev="/dev/sde"/>
Nov 09 04:00:53 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 04:00:53 user nova-compute[75378]:   <serial>7f29cbb5-01fa-4fc0-a79f-8716980ba171</serial>
Nov 09 04:00:53 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 04:00:53 user nova-compute[75378]: </disk>
Nov 09 04:00:53 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 04:00:53 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Successfully detached device vdb from instance 06799031-9998-4829-8725-09526681c442 from the persistent domain config.
Nov 09 04:00:53 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 06799031-9998-4829-8725-09526681c442 from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 04:00:53 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 04:00:53 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:00:53 user nova-compute[75378]:   <source dev="/dev/sde"/>
Nov 09 04:00:53 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 04:00:53 user nova-compute[75378]:   <serial>7f29cbb5-01fa-4fc0-a79f-8716980ba171</serial>
Nov 09 04:00:53 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 04:00:53 user nova-compute[75378]: </disk>
Nov 09 04:00:53 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 04:00:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 06799031-9998-4829-8725-09526681c442 {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 04:00:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:00:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:01 user nova-compute[75378]: DEBUG nova.compute.manager [req-160787cd-90ac-40ae-b1dc-fb488a21a575 req-4358e6b6-ea9f-4b95-aadc-514956a4bcd9 service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Received event network-changed-7bcc909c-9b09-409b-8aab-a9f095514e2d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:01:01 user nova-compute[75378]: DEBUG nova.compute.manager [req-160787cd-90ac-40ae-b1dc-fb488a21a575 req-4358e6b6-ea9f-4b95-aadc-514956a4bcd9 service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Refreshing instance network info cache due to event network-changed-7bcc909c-9b09-409b-8aab-a9f095514e2d. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:01:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-160787cd-90ac-40ae-b1dc-fb488a21a575 req-4358e6b6-ea9f-4b95-aadc-514956a4bcd9 service nova] Acquiring lock "refresh_cache-19359be7-5789-4d89-bc5a-c6c5ccd52211" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:01:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-160787cd-90ac-40ae-b1dc-fb488a21a575 req-4358e6b6-ea9f-4b95-aadc-514956a4bcd9 service nova] Acquired lock "refresh_cache-19359be7-5789-4d89-bc5a-c6c5ccd52211" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:01:01 user nova-compute[75378]: DEBUG nova.network.neutron [req-160787cd-90ac-40ae-b1dc-fb488a21a575 req-4358e6b6-ea9f-4b95-aadc-514956a4bcd9 service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Refreshing network info cache for port 7bcc909c-9b09-409b-8aab-a9f095514e2d {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:01:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:02 user nova-compute[75378]: DEBUG nova.network.neutron [req-160787cd-90ac-40ae-b1dc-fb488a21a575 req-4358e6b6-ea9f-4b95-aadc-514956a4bcd9 service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Updated VIF entry in instance network info cache for port 7bcc909c-9b09-409b-8aab-a9f095514e2d. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:01:02 user nova-compute[75378]: DEBUG nova.network.neutron [req-160787cd-90ac-40ae-b1dc-fb488a21a575 req-4358e6b6-ea9f-4b95-aadc-514956a4bcd9 service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Updating instance_info_cache with network_info: [{"id": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "address": "fa:16:3e:3a:3e:05", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc909c-9b", "ovs_interfaceid": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:01:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-160787cd-90ac-40ae-b1dc-fb488a21a575 req-4358e6b6-ea9f-4b95-aadc-514956a4bcd9 service nova] Releasing lock "refresh_cache-19359be7-5789-4d89-bc5a-c6c5ccd52211" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:01:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-34aad4ea-63c7-4fcf-96fb-1f254ead26a1 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "19359be7-5789-4d89-bc5a-c6c5ccd52211" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:01:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-34aad4ea-63c7-4fcf-96fb-1f254ead26a1 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "19359be7-5789-4d89-bc5a-c6c5ccd52211" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:01:02 user nova-compute[75378]: DEBUG nova.objects.instance [None req-34aad4ea-63c7-4fcf-96fb-1f254ead26a1 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lazy-loading 'flavor' on Instance uuid 19359be7-5789-4d89-bc5a-c6c5ccd52211 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:01:02 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-34aad4ea-63c7-4fcf-96fb-1f254ead26a1 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Ignoring supplied device name: /dev/vdb
Nov 09 04:01:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-34aad4ea-63c7-4fcf-96fb-1f254ead26a1 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "19359be7-5789-4d89-bc5a-c6c5ccd52211" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-34aad4ea-63c7-4fcf-96fb-1f254ead26a1 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "19359be7-5789-4d89-bc5a-c6c5ccd52211" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-34aad4ea-63c7-4fcf-96fb-1f254ead26a1 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "19359be7-5789-4d89-bc5a-c6c5ccd52211" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:01:03 user nova-compute[75378]: INFO nova.compute.manager [None req-34aad4ea-63c7-4fcf-96fb-1f254ead26a1 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Attaching volume 49b7fbb8-5603-46ec-8076-445410ee1f64 to /dev/vdb
Nov 09 04:01:03 user nova-compute[75378]: DEBUG os_brick.utils [None req-34aad4ea-63c7-4fcf-96fb-1f254ead26a1 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2650b1-7050-489c-b77d-d15c459f9a00]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dcc6c3-50b2-48bf-8849-e47fb2c4e0f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afc0293-0cee-4627-8d66-6a95fe25a08f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1851766-1e4e-4e23-97ef-a8fedad6516d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-34aad4ea-63c7-4fcf-96fb-1f254ead26a1 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-34aad4ea-63c7-4fcf-96fb-1f254ead26a1 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34aad4ea-63c7-4fcf-96fb-1f254ead26a1 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:01:03 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 04:01:03 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6953d39c-a312-4e41-9c0b-a1b07337c890]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-34aad4ea-63c7-4fcf-96fb-1f254ead26a1 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-34aad4ea-63c7-4fcf-96fb-1f254ead26a1 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-34aad4ea-63c7-4fcf-96fb-1f254ead26a1 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG os_brick.utils [None req-34aad4ea-63c7-4fcf-96fb-1f254ead26a1 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:01:03 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-34aad4ea-63c7-4fcf-96fb-1f254ead26a1 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Updating existing volume attachment record: 0e6c0bd6-c01d-4f14-9559-1fc542192d4f {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 04:01:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:06 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:01:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:01:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:01:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:01:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:01:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:01:11 user nova-compute[75378]: INFO nova.compute.manager [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Terminating instance
Nov 09 04:01:11 user nova-compute[75378]: DEBUG nova.compute.manager [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:01:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:11 user nova-compute[75378]: DEBUG nova.compute.manager [req-7121a3a0-fc03-4ff5-9c44-edb157183350 req-f4ddc916-bb4b-424a-a8a7-7889b3a75c20 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received event network-vif-unplugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:01:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7121a3a0-fc03-4ff5-9c44-edb157183350 req-f4ddc916-bb4b-424a-a8a7-7889b3a75c20 service nova] Acquiring lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:01:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7121a3a0-fc03-4ff5-9c44-edb157183350 req-f4ddc916-bb4b-424a-a8a7-7889b3a75c20 service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:01:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7121a3a0-fc03-4ff5-9c44-edb157183350 req-f4ddc916-bb4b-424a-a8a7-7889b3a75c20 service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:01:11 user nova-compute[75378]: DEBUG nova.compute.manager [req-7121a3a0-fc03-4ff5-9c44-edb157183350 req-f4ddc916-bb4b-424a-a8a7-7889b3a75c20 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] No waiting events found dispatching network-vif-unplugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:01:11 user nova-compute[75378]: DEBUG nova.compute.manager [req-7121a3a0-fc03-4ff5-9c44-edb157183350 req-f4ddc916-bb4b-424a-a8a7-7889b3a75c20 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received event network-vif-unplugged-04953f29-39ff-47d1-ba38-55faaa6369ce for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:01:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:12 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Instance destroyed successfully.
Nov 09 04:01:12 user nova-compute[75378]: DEBUG nova.objects.instance [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'resources' on Instance uuid 9a841180-ac54-4c2a-9e82-4affb78d3fc9 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:54:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2019851881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2019851881',id=32,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:57:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c2176531ffa4cf7bec818309e39ab8d',ramdisk_id='',reservation_id='r-6tm4rcnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:59:26Z,user_data=None,user_id='57efcfeacd7f4daf916e7dd04e11d8f2',uuid=9a841180-ac54-4c2a-9e82-4affb78d3fc9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04953f29-39ff-47d1-ba38-55faaa6369ce", "address": "fa:16:3e:7b:a8:05", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04953f29-39", "ovs_interfaceid": "04953f29-39ff-47d1-ba38-55faaa6369ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converting VIF {"id": "04953f29-39ff-47d1-ba38-55faaa6369ce", "address": "fa:16:3e:7b:a8:05", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04953f29-39", "ovs_interfaceid": "04953f29-39ff-47d1-ba38-55faaa6369ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:a8:05,bridge_name='br-int',has_traffic_filtering=True,id=04953f29-39ff-47d1-ba38-55faaa6369ce,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04953f29-39') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG os_vif [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:a8:05,bridge_name='br-int',has_traffic_filtering=True,id=04953f29-39ff-47d1-ba38-55faaa6369ce,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04953f29-39') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04953f29-39, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f46d3ec7-d738-4b8f-9e98-bd3438b289bb) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:01:12 user nova-compute[75378]: INFO os_vif [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:a8:05,bridge_name='br-int',has_traffic_filtering=True,id=04953f29-39ff-47d1-ba38-55faaa6369ce,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04953f29-39')
Nov 09 04:01:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQFhmJSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:01:12 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:01:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.115s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d051de13-1e6e-4619-b71b-fa72bcc351e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 04:01:12 user nova-compute[75378]: No targets found.
Nov 09 04:01:12 user nova-compute[75378]: iSNS:
Nov 09 04:01:12 user nova-compute[75378]: No targets found.
Nov 09 04:01:12 user nova-compute[75378]: STATIC:
Nov 09 04:01:12 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 04:01:12 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:01:12 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:01:12 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171
Nov 09 04:01:12 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:01:12 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:01:12 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2
Nov 09 04:01:12 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:01:12 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:01:12 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522
Nov 09 04:01:12 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:01:12 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:01:12 user nova-compute[75378]: FIRMWARE:
Nov 09 04:01:12 user nova-compute[75378]: No targets found.
Nov 09 04:01:12 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 04:01:12 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 04:01:12 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b78009-f69c-47f1-98c1-af3315681230]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d816dc-bbbd-45e0-9825-f8aa185e30af]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:01:12 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 04:01:12 user nova-compute[75378]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)
Nov 09 04:01:12 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:01:12 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:01:12 user nova-compute[75378]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 (non-flash)
Nov 09 04:01:12 user nova-compute[75378]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)
Nov 09 04:01:12 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:01:12 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c57b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522'): ({'sdd'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Removing single pathed devices sdd {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[98836bf6-ef95-45e1-b756-eb8dcbf20d69]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7e9684-764c-4484-8572-6ec0781e617e]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Flushing IO for device /dev/sdd {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dca0a4-26ec-4435-9cdb-5b49da2f5691]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dac572-22e0-480c-8bdd-7160ca8528d0]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] SCSI volumes sdd have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96919e0-affd-45f0-800a-226dae14a97e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd9527f-3a6f-47a6-85a6-68dd92fb5696]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522, portal: 172.16.0.220,3260]
Nov 09 04:01:12 user nova-compute[75378]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522, portal: 172.16.0.220,3260] successful.
Nov 09 04:01:12 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1afb52f3-a9af-40ce-9187-72f736022522 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8837b31b-6e6c-4c52-bfa9-1bb5812bd9b2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] <== disconnect_volume: return (447ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 04:01:12 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Deleting instance files /opt/stack/data/nova/instances/9a841180-ac54-4c2a-9e82-4affb78d3fc9_del
Nov 09 04:01:12 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Deletion of /opt/stack/data/nova/instances/9a841180-ac54-4c2a-9e82-4affb78d3fc9_del complete
Nov 09 04:01:12 user nova-compute[75378]: INFO nova.compute.manager [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 09 04:01:12 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:01:12 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:01:13 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:01:13 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Took 0.45 seconds to deallocate network for instance.
Nov 09 04:01:13 user nova-compute[75378]: DEBUG nova.compute.manager [req-0a01729d-7556-4f26-99b9-ee61102c3b5b req-942f7491-1510-419c-a15e-909771f3ccf6 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received event network-vif-deleted-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:01:13 user nova-compute[75378]: INFO nova.compute.manager [req-0a01729d-7556-4f26-99b9-ee61102c3b5b req-942f7491-1510-419c-a15e-909771f3ccf6 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Neutron deleted interface 04953f29-39ff-47d1-ba38-55faaa6369ce; detaching it from the instance and deleting it from the info cache
Nov 09 04:01:13 user nova-compute[75378]: DEBUG nova.network.neutron [req-0a01729d-7556-4f26-99b9-ee61102c3b5b req-942f7491-1510-419c-a15e-909771f3ccf6 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:01:13 user nova-compute[75378]: DEBUG nova.compute.manager [req-0a01729d-7556-4f26-99b9-ee61102c3b5b req-942f7491-1510-419c-a15e-909771f3ccf6 service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Detach interface failed, port_id=04953f29-39ff-47d1-ba38-55faaa6369ce, reason: Instance 9a841180-ac54-4c2a-9e82-4affb78d3fc9 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 04:01:13 user nova-compute[75378]: DEBUG nova.compute.manager [req-355b9f64-e51f-454b-8489-a7b772900da0 req-ee10782e-e0ae-4120-9e19-cf340e4fe20f service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received event network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:01:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-355b9f64-e51f-454b-8489-a7b772900da0 req-ee10782e-e0ae-4120-9e19-cf340e4fe20f service nova] Acquiring lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:01:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-355b9f64-e51f-454b-8489-a7b772900da0 req-ee10782e-e0ae-4120-9e19-cf340e4fe20f service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:01:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-355b9f64-e51f-454b-8489-a7b772900da0 req-ee10782e-e0ae-4120-9e19-cf340e4fe20f service nova] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:01:13 user nova-compute[75378]: DEBUG nova.compute.manager [req-355b9f64-e51f-454b-8489-a7b772900da0 req-ee10782e-e0ae-4120-9e19-cf340e4fe20f service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] No waiting events found dispatching network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:01:13 user nova-compute[75378]: WARNING nova.compute.manager [req-355b9f64-e51f-454b-8489-a7b772900da0 req-ee10782e-e0ae-4120-9e19-cf340e4fe20f service nova] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Received unexpected event network-vif-plugged-04953f29-39ff-47d1-ba38-55faaa6369ce for instance with vm_state active and task_state deleting.
Nov 09 04:01:14 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 06799031-9998-4829-8725-09526681c442 is timed out.
Nov 09 04:01:14 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Successfully detached device vdb from instance 06799031-9998-4829-8725-09526681c442 from the live domain config.
Nov 09 04:01:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HynUKtrC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:01:14 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:01:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab809c8-e668-47b6-bb4f-35a0e14dfc6c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 04:01:14 user nova-compute[75378]: No targets found.
Nov 09 04:01:14 user nova-compute[75378]: iSNS:
Nov 09 04:01:14 user nova-compute[75378]: No targets found.
Nov 09 04:01:14 user nova-compute[75378]: STATIC:
Nov 09 04:01:14 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 04:01:14 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:01:14 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:01:14 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171
Nov 09 04:01:14 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:01:14 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:01:14 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2
Nov 09 04:01:14 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:01:14 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:01:14 user nova-compute[75378]: FIRMWARE:
Nov 09 04:01:14 user nova-compute[75378]: No targets found.
Nov 09 04:01:14 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 04:01:14 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 04:01:14 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[076919ca-25fa-4463-8563-a3f5b5652a53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9ef652-fcc2-400d-85dd-0adcd605a004]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:01:14 user nova-compute[75378]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)
Nov 09 04:01:14 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:01:14 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:01:14 user nova-compute[75378]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 (non-flash)
Nov 09 04:01:14 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:01:14 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c7b4f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171'): ({'sde'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Removing single pathed devices sde {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22567f0-fb06-4ce3-8d26-2fc52991a278]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.106s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b664b86a-7333-4874-9c98-d8cd91b913d9]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Flushing IO for device /dev/sde {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[360f38cb-6cdc-42ee-9939-24e47acd733d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f926156-0f65-4393-9d7a-f6814887fb53]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] SCSI volumes sde have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c625f79a-410b-4d63-86a4-b411cf857afb]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2b60ff-450f-46b3-bd49-825c8e2861b1]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171, portal: 172.16.0.220,3260]
Nov 09 04:01:14 user nova-compute[75378]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171, portal: 172.16.0.220,3260] successful.
Nov 09 04:01:14 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f29cbb5-01fa-4fc0-a79f-8716980ba171 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a355350-6a98-423a-99d2-d26b678129f7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] <== disconnect_volume: return (391ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:01:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 04:01:15 user nova-compute[75378]: INFO nova.compute.manager [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 9a841180-ac54-4c2a-9e82-4affb78d3fc9] Took 2.28 seconds to detach 1 volumes for instance.
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Starting finish_migration {{(pid=75378) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Instance directory exists: not creating {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 04:01:15 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Creating image(s)
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Did not create local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Ensure instance console log exists: /opt/stack/data/nova/instances/9dcaeb12-99bc-48f0-aec9-3de2a3770e01/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Start _get_guest_xml network_info=[{"id": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "address": "fa:16:3e:68:d1:1a", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1061624576-network", "vif_mac": "fa:16:3e:68:d1:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971f6712-c5", "ovs_interfaceid": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPVFTdZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '9dcaeb12-99bc-48f0-aec9-3de2a3770e01', 'attached_at': '2023-11-09T04:01:14.000000', 'detached_at': '', 'volume_id': 'a973b815-15ca-43a6-acba-896d722ff723', 'serial': 'a973b815-15ca-43a6-acba-896d722ff723'}, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': '8a58178b-9c23-40b9-b758-07efe13d4da5', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 04:01:15 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:01:15 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPVFTdZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:01:15 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:01:15 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:01:15 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0409b022-4341-4717-b6d4-380c1622ea65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 04:01:15 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f726c7d7-6361-478a-8fbf-5722d1a5c0e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723] added
Nov 09 04:01:15 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f66906-fccf-46db-a69b-8b552c541f0c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1f1b3e-165d-41c0-9365-52c9fea13ca5]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vPVFTdZG {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vPVFTdZG" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a61bc69-025d-4580-b794-caf264db145d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vPVFTdZG'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8598da-0e03-4c77-baa7-b8116ecc4de1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2db8d5-1f48-48b9-bded-d931efc64328]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:01:15 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:01:15 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:01:15 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:01:15 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b536a2-4437-433d-b9bd-65635a4a2ccc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723, portal: 172.16.0.220,3260]
Nov 09 04:01:15 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723, portal: 172.16.0.220,3260] successful.
Nov 09 04:01:15 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf3f2c9-2477-49ee-9c97-65fc8dae90f5]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6276a6-9331-460e-9ec0-e11febbab343]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:01:15 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:01:15 user nova-compute[75378]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:01:15 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:01:15 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:01:15 user nova-compute[75378]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:01:15 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:15 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Deleted allocations for instance 9a841180-ac54-4c2a-9e82-4affb78d3fc9
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e79da7f-b29e-4f41-8b7f-53f5b3ca4cfe]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPVFTdZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 04:01:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c4eb011e-34bb-4218-a4a5-7b1f10f817fb tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "9a841180-ac54-4c2a-9e82-4affb78d3fc9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.642s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG nova.objects.instance [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lazy-loading 'flavor' on Instance uuid 06799031-9998-4829-8725-09526681c442 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-03cc5246-5faa-4786-aba2-61ae7c456232 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "06799031-9998-4829-8725-09526681c442" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.959s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23233633336393938', 'path': '/dev/sdb'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233633336393938', 'path': '/dev/sdb'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:58:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-313014061',display_name='tempest-ServerActionsTestOtherA-server-313014061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-313014061',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFabS+mewwrg7oOEw/0EoMWlEwIz3NoSF6MUhLgvIEWjSZH9d/Fg8M+DuLJkZN6SKSXE9qeztuGxbDfpg7EHMNtmRvy2F5yoI+XGOsX3tR4ssTADXmphKv1NsnpmlrDrQg==',key_name='tempest-keypair-138130530',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:59:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='548993d280024b60b3778b026177e356',ramdisk_id='',reservation_id='r-a17ajdc9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2010465588',owner_user_name='tempest-ServerActionsTestOtherA-2010465588-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:00:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d4f0858695e4509a6b0ab99a8212571',uuid=9dcaeb12-99bc-48f0-aec9-3de2a3770e01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "address": "fa:16:3e:68:d1:1a", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1061624576-network", "vif_mac": "fa:16:3e:68:d1:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971f6712-c5", "ovs_interfaceid": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converting VIF {"id": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "address": "fa:16:3e:68:d1:1a", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1061624576-network", "vif_mac": "fa:16:3e:68:d1:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971f6712-c5", "ovs_interfaceid": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:d1:1a,bridge_name='br-int',has_traffic_filtering=True,id=971f6712-c5e7-4bb6-846d-e165e70fd45a,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap971f6712-c5') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] End _get_guest_xml xml=<domain type="kvm">
Nov 09 04:01:16 user nova-compute[75378]:   <uuid>9dcaeb12-99bc-48f0-aec9-3de2a3770e01</uuid>
Nov 09 04:01:16 user nova-compute[75378]:   <name>instance-00000025</name>
Nov 09 04:01:16 user nova-compute[75378]:   <memory>2097152</memory>
Nov 09 04:01:16 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 04:01:16 user nova-compute[75378]:   <metadata>
Nov 09 04:01:16 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 04:01:16 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 04:01:16 user nova-compute[75378]:       <nova:name>tempest-ServerActionsTestOtherA-server-313014061</nova:name>
Nov 09 04:01:16 user nova-compute[75378]:       <nova:creationTime>2023-11-09 04:01:15</nova:creationTime>
Nov 09 04:01:16 user nova-compute[75378]:       <nova:flavor name="m1.small">
Nov 09 04:01:16 user nova-compute[75378]:         <nova:memory>2048</nova:memory>
Nov 09 04:01:16 user nova-compute[75378]:         <nova:disk>20</nova:disk>
Nov 09 04:01:16 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 04:01:16 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 04:01:16 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 04:01:16 user nova-compute[75378]:       </nova:flavor>
Nov 09 04:01:16 user nova-compute[75378]:       <nova:owner>
Nov 09 04:01:16 user nova-compute[75378]:         <nova:user uuid="5d4f0858695e4509a6b0ab99a8212571">tempest-ServerActionsTestOtherA-2010465588-project-member</nova:user>
Nov 09 04:01:16 user nova-compute[75378]:         <nova:project uuid="548993d280024b60b3778b026177e356">tempest-ServerActionsTestOtherA-2010465588</nova:project>
Nov 09 04:01:16 user nova-compute[75378]:       </nova:owner>
Nov 09 04:01:16 user nova-compute[75378]:       <nova:ports>
Nov 09 04:01:16 user nova-compute[75378]:         <nova:port uuid="971f6712-c5e7-4bb6-846d-e165e70fd45a">
Nov 09 04:01:16 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 09 04:01:16 user nova-compute[75378]:         </nova:port>
Nov 09 04:01:16 user nova-compute[75378]:       </nova:ports>
Nov 09 04:01:16 user nova-compute[75378]:     </nova:instance>
Nov 09 04:01:16 user nova-compute[75378]:   </metadata>
Nov 09 04:01:16 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 04:01:16 user nova-compute[75378]:     <system>
Nov 09 04:01:16 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 04:01:16 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 04:01:16 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 04:01:16 user nova-compute[75378]:       <entry name="serial">9dcaeb12-99bc-48f0-aec9-3de2a3770e01</entry>
Nov 09 04:01:16 user nova-compute[75378]:       <entry name="uuid">9dcaeb12-99bc-48f0-aec9-3de2a3770e01</entry>
Nov 09 04:01:16 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 04:01:16 user nova-compute[75378]:     </system>
Nov 09 04:01:16 user nova-compute[75378]:   </sysinfo>
Nov 09 04:01:16 user nova-compute[75378]:   <os>
Nov 09 04:01:16 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 04:01:16 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 04:01:16 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 04:01:16 user nova-compute[75378]:   </os>
Nov 09 04:01:16 user nova-compute[75378]:   <features>
Nov 09 04:01:16 user nova-compute[75378]:     <acpi/>
Nov 09 04:01:16 user nova-compute[75378]:     <apic/>
Nov 09 04:01:16 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 04:01:16 user nova-compute[75378]:   </features>
Nov 09 04:01:16 user nova-compute[75378]:   <clock offset="utc">
Nov 09 04:01:16 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 04:01:16 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 04:01:16 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 04:01:16 user nova-compute[75378]:   </clock>
Nov 09 04:01:16 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 04:01:16 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 04:01:16 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 04:01:16 user nova-compute[75378]:   </cpu>
Nov 09 04:01:16 user nova-compute[75378]:   <devices>
Nov 09 04:01:16 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 04:01:16 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:01:16 user nova-compute[75378]:       <source dev="/dev/sdb"/>
Nov 09 04:01:16 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 04:01:16 user nova-compute[75378]:       <serial>a973b815-15ca-43a6-acba-896d722ff723</serial>
Nov 09 04:01:16 user nova-compute[75378]:     </disk>
Nov 09 04:01:16 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 04:01:16 user nova-compute[75378]:       <mac address="fa:16:3e:68:d1:1a"/>
Nov 09 04:01:16 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:01:16 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 04:01:16 user nova-compute[75378]:       <target dev="tap971f6712-c5"/>
Nov 09 04:01:16 user nova-compute[75378]:     </interface>
Nov 09 04:01:16 user nova-compute[75378]:     <serial type="pty">
Nov 09 04:01:16 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/9dcaeb12-99bc-48f0-aec9-3de2a3770e01/console.log" append="off"/>
Nov 09 04:01:16 user nova-compute[75378]:     </serial>
Nov 09 04:01:16 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 04:01:16 user nova-compute[75378]:     <video>
Nov 09 04:01:16 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:01:16 user nova-compute[75378]:     </video>
Nov 09 04:01:16 user nova-compute[75378]:     <rng model="virtio">
Nov 09 04:01:16 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 04:01:16 user nova-compute[75378]:     </rng>
Nov 09 04:01:16 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 04:01:16 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 04:01:16 user nova-compute[75378]:       <stats period="10"/>
Nov 09 04:01:16 user nova-compute[75378]:     </memballoon>
Nov 09 04:01:16 user nova-compute[75378]:   </devices>
Nov 09 04:01:16 user nova-compute[75378]: </domain>
Nov 09 04:01:16 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:58:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-313014061',display_name='tempest-ServerActionsTestOtherA-server-313014061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-313014061',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFabS+mewwrg7oOEw/0EoMWlEwIz3NoSF6MUhLgvIEWjSZH9d/Fg8M+DuLJkZN6SKSXE9qeztuGxbDfpg7EHMNtmRvy2F5yoI+XGOsX3tR4ssTADXmphKv1NsnpmlrDrQg==',key_name='tempest-keypair-138130530',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:59:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='548993d280024b60b3778b026177e356',ramdisk_id='',reservation_id='r-a17ajdc9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2010465588',owner_user_name='tempest-ServerActionsTestOtherA-2010465588-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:00:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d4f0858695e4509a6b0ab99a8212571',uuid=9dcaeb12-99bc-48f0-aec9-3de2a3770e01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "address": "fa:16:3e:68:d1:1a", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1061624576-network", "vif_mac": "fa:16:3e:68:d1:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971f6712-c5", "ovs_interfaceid": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converting VIF {"id": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "address": "fa:16:3e:68:d1:1a", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1061624576-network", "vif_mac": "fa:16:3e:68:d1:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971f6712-c5", "ovs_interfaceid": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:d1:1a,bridge_name='br-int',has_traffic_filtering=True,id=971f6712-c5e7-4bb6-846d-e165e70fd45a,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap971f6712-c5') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG os_vif [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:d1:1a,bridge_name='br-int',has_traffic_filtering=True,id=971f6712-c5e7-4bb6-846d-e165e70fd45a,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap971f6712-c5') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6196d541-9e87-5857-9610-e0707d80440d', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap971f6712-c5, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap971f6712-c5, col_values=(('qos', UUID('3d80ea59-a3bd-4996-9978-3e3411d00502')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap971f6712-c5, col_values=(('external_ids', {'iface-id': '971f6712-c5e7-4bb6-846d-e165e70fd45a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:d1:1a', 'vm-uuid': '9dcaeb12-99bc-48f0-aec9-3de2a3770e01'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:01:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:16 user nova-compute[75378]: INFO os_vif [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:d1:1a,bridge_name='br-int',has_traffic_filtering=True,id=971f6712-c5e7-4bb6-846d-e165e70fd45a,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap971f6712-c5')
Nov 09 04:01:17 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:01:17 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] No VIF found with MAC fa:16:3e:68:d1:1a, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:01:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:18 user nova-compute[75378]: DEBUG nova.compute.manager [req-21fc2d76-630c-4dc0-8cc5-d1c0865c9dac req-71d9d6a7-f0ad-45fc-ad06-7636465b937f service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Received event network-vif-plugged-971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:01:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-21fc2d76-630c-4dc0-8cc5-d1c0865c9dac req-71d9d6a7-f0ad-45fc-ad06-7636465b937f service nova] Acquiring lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:01:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-21fc2d76-630c-4dc0-8cc5-d1c0865c9dac req-71d9d6a7-f0ad-45fc-ad06-7636465b937f service nova] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:01:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-21fc2d76-630c-4dc0-8cc5-d1c0865c9dac req-71d9d6a7-f0ad-45fc-ad06-7636465b937f service nova] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:01:18 user nova-compute[75378]: DEBUG nova.compute.manager [req-21fc2d76-630c-4dc0-8cc5-d1c0865c9dac req-71d9d6a7-f0ad-45fc-ad06-7636465b937f service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] No waiting events found dispatching network-vif-plugged-971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:01:18 user nova-compute[75378]: WARNING nova.compute.manager [req-21fc2d76-630c-4dc0-8cc5-d1c0865c9dac req-71d9d6a7-f0ad-45fc-ad06-7636465b937f service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Received unexpected event network-vif-plugged-971f6712-c5e7-4bb6-846d-e165e70fd45a for instance with vm_state active and task_state resize_finish.
Nov 09 04:01:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:20 user nova-compute[75378]: DEBUG nova.compute.manager [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 04:01:20 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Instance running successfully.
Nov 09 04:01:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Failed to set time: agent not configured {{(pid=75378) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 09 04:01:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e9ff773b-2f55-4ff9-b8a9-d96c0909161d tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] finish_migration finished successfully. {{(pid=75378) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 09 04:01:20 user nova-compute[75378]: DEBUG nova.compute.manager [req-852d592e-04e5-4736-951e-f54bfe783caf req-fc1979a6-6713-40f9-b4cd-dacbd0fcddec service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Received event network-vif-plugged-971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:01:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-852d592e-04e5-4736-951e-f54bfe783caf req-fc1979a6-6713-40f9-b4cd-dacbd0fcddec service nova] Acquiring lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:01:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-852d592e-04e5-4736-951e-f54bfe783caf req-fc1979a6-6713-40f9-b4cd-dacbd0fcddec service nova] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:01:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-852d592e-04e5-4736-951e-f54bfe783caf req-fc1979a6-6713-40f9-b4cd-dacbd0fcddec service nova] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:01:20 user nova-compute[75378]: DEBUG nova.compute.manager [req-852d592e-04e5-4736-951e-f54bfe783caf req-fc1979a6-6713-40f9-b4cd-dacbd0fcddec service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] No waiting events found dispatching network-vif-plugged-971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:01:20 user nova-compute[75378]: WARNING nova.compute.manager [req-852d592e-04e5-4736-951e-f54bfe783caf req-fc1979a6-6713-40f9-b4cd-dacbd0fcddec service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Received unexpected event network-vif-plugged-971f6712-c5e7-4bb6-846d-e165e70fd45a for instance with vm_state active and task_state resize_finish.
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.volume.cinder [None req-34aad4ea-63c7-4fcf-96fb-1f254ead26a1 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Update attachment failed for attachment 0e6c0bd6-c01d-4f14-9559-1fc542192d4f. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6ebfb54f-aaa2-42b0-aed5-b6122e04f9d2) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6ebfb54f-aaa2-42b0-aed5-b6122e04f9d2)
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [None req-34aad4ea-63c7-4fcf-96fb-1f254ead26a1 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Failed to attach 49b7fbb8-5603-46ec-8076-445410ee1f64 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6ebfb54f-aaa2-42b0-aed5-b6122e04f9d2)
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Traceback (most recent call last):
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]     ret_val = method(obj, context, *args, **kwargs)
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]     self._do_attach(context, instance, volume, volume_api,
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]     self._volume_attach(context, volume, connector, instance,
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]     connection_info = volume_api.attachment_update(
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]     res = method(self, ctx, *args, **kwargs)
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]     with excutils.save_and_reraise_exception():
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]     self.force_reraise()
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]     raise self.value
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]     context, '3.44', skip_version_check=True).attachments.update(
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]     return method.func(obj, *args, **kwargs)
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]     resp = self._update('/attachments/%s' % id, body)
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]     return self._cs_request(url, 'PUT', **kwargs)
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]     return self.request(url, method, **kwargs)
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211]     raise exceptions.from_response(resp, body)
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6ebfb54f-aaa2-42b0-aed5-b6122e04f9d2)
Nov 09 04:01:20 user nova-compute[75378]: ERROR nova.compute.manager [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] 
Nov 09 04:01:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-34aad4ea-63c7-4fcf-96fb-1f254ead26a1 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "19359be7-5789-4d89-bc5a-c6c5ccd52211" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.861s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server [None req-34aad4ea-63c7-4fcf-96fb-1f254ead26a1 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6ebfb54f-aaa2-42b0-aed5-b6122e04f9d2)
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6ebfb54f-aaa2-42b0-aed5-b6122e04f9d2)
Nov 09 04:01:21 user nova-compute[75378]: ERROR oslo_messaging.rpc.server 
Nov 09 04:01:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquiring lock "00959e75-7446-4ff6-be3e-56d7146b3576" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:01:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "00959e75-7446-4ff6-be3e-56d7146b3576" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:01:22 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 04:01:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:01:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:01:22 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 04:01:22 user nova-compute[75378]: INFO nova.compute.claims [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Claim successful on node user
Nov 09 04:01:23 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 04:01:23 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 04:01:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG nova.policy [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '931191283d604e2a91bd3e4daceedebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b18add01440c082dbe9f1503b075d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 04:01:23 user nova-compute[75378]: INFO nova.virt.block_device [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Booting with volume 073fc7a9-2698-4f96-888c-170888571f4d at /dev/vda
Nov 09 04:01:23 user nova-compute[75378]: DEBUG os_brick.utils [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ae81da-2f55-4d21-ac92-972966e9f32b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf99dc89-4440-4fe8-b9d1-a9175ccee605]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5593a1-4166-4b4e-8241-dd8289246abe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e80db7e-4591-4e3b-84a7-16a7c8cd44ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:01:23 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 04:01:23 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[57736a3e-6c12-4182-850a-b41f18b19455]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG os_brick.utils [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:01:23 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Updating existing volume attachment record: bb66b970-5d22-46a6-9848-abd76df72ce3 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 04:01:24 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Successfully created port: bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 04:01:24 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Successfully updated port: bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 04:01:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquiring lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:01:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquired lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:01:25 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:01:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-a0159222-8527-48be-8761-f469153baf5e req-f75a8066-2205-456c-a555-c486dfee0e28 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received event network-changed-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:01:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-a0159222-8527-48be-8761-f469153baf5e req-f75a8066-2205-456c-a555-c486dfee0e28 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Refreshing instance network info cache due to event network-changed-bd706a0c-ba99-42b7-bf21-898a277c3541. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:01:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a0159222-8527-48be-8761-f469153baf5e req-f75a8066-2205-456c-a555-c486dfee0e28 service nova] Acquiring lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:01:25 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 04:01:25 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Updating instance_info_cache with network_info: [{"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:01:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Releasing lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:01:25 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Instance network_info: |[{"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 04:01:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a0159222-8527-48be-8761-f469153baf5e req-f75a8066-2205-456c-a555-c486dfee0e28 service nova] Acquired lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:01:25 user nova-compute[75378]: DEBUG nova.network.neutron [req-a0159222-8527-48be-8761-f469153baf5e req-f75a8066-2205-456c-a555-c486dfee0e28 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Refreshing network info cache for port bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG nova.network.neutron [req-a0159222-8527-48be-8761-f469153baf5e req-f75a8066-2205-456c-a555-c486dfee0e28 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Updated VIF entry in instance network info cache for port bd706a0c-ba99-42b7-bf21-898a277c3541. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG nova.network.neutron [req-a0159222-8527-48be-8761-f469153baf5e req-f75a8066-2205-456c-a555-c486dfee0e28 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Updating instance_info_cache with network_info: [{"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a0159222-8527-48be-8761-f469153baf5e req-f75a8066-2205-456c-a555-c486dfee0e28 service nova] Releasing lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SeLvfWMX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:01:26 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:01:26 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:01:26 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[804b9148-5cc8-4364-9409-a3421716dcc2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 04:01:26 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6037bce5-bb94-413f-9716-edc8b2516d11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2] added
Nov 09 04:01:26 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9c7992-5974-4b46-9968-39481bb144f6]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c2ef08-24f9-41fd-9105-f6738a0dd6f8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SeLvfWMX {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SeLvfWMX" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6900cfec-8ec5-4914-8f56-a97e8847bcb8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SeLvfWMX'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[db33eeb5-b807-467c-89d0-10df6341096b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd2d2ec-48b7-4739-8fab-49edfd78e41d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:01:26 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:01:26 user nova-compute[75378]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:01:26 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:01:26 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:01:26 user nova-compute[75378]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:01:26 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab43f167-0c5b-49e7-afaf-960095a58c3c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2, portal: 172.16.0.220,3260]
Nov 09 04:01:26 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2, portal: 172.16.0.220,3260] successful.
Nov 09 04:01:26 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[60833bd9-1da5-4269-ae21-169b36d2b0ac]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[efafca35-ea48-48a6-9e1f-638a543ab1db]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:01:26 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:01:26 user nova-compute[75378]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:01:26 user nova-compute[75378]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 (non-flash)
Nov 09 04:01:26 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:01:26 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:01:26 user nova-compute[75378]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:01:26 user nova-compute[75378]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 (non-flash)
Nov 09 04:01:26 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[480bcd85-6f0b-44f6-bed5-31e142b59368]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SeLvfWMX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:01:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:01:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23963656631366235', 'path': '/dev/sdd'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:01:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963656631366235', 'path': '/dev/sdd'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 04:01:27 user nova-compute[75378]: DEBUG nova.objects.instance [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lazy-loading 'flavor' on Instance uuid eb8117df-cf63-4bc9-9691-4828ff7f5a8e {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:01:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 04:01:27 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:01:27 user nova-compute[75378]:   <source dev="/dev/sdd"/>
Nov 09 04:01:27 user nova-compute[75378]:   <target dev="vdc" bus="virtio"/>
Nov 09 04:01:27 user nova-compute[75378]:   <serial>23c47b9a-6716-4f1f-b05d-5052b07cf5e2</serial>
Nov 09 04:01:27 user nova-compute[75378]: </disk>
Nov 09 04:01:27 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 04:01:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:01:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:01:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:01:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] No VIF found with MAC fa:16:3e:5b:d9:0b, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:01:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-566a540a-f92f-416d-8887-b704d34b34fa tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 49.661s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:01:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquiring lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:01:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:01:29 user nova-compute[75378]: INFO nova.compute.manager [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Detaching volume 23c47b9a-6716-4f1f-b05d-5052b07cf5e2
Nov 09 04:01:29 user nova-compute[75378]: INFO nova.virt.block_device [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Attempting to driver detach volume 23c47b9a-6716-4f1f-b05d-5052b07cf5e2 from mountpoint /dev/vdc
Nov 09 04:01:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Attempting to detach device vdc from instance eb8117df-cf63-4bc9-9691-4828ff7f5a8e from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 04:01:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 04:01:29 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:01:29 user nova-compute[75378]:   <source dev="/dev/sdd"/>
Nov 09 04:01:29 user nova-compute[75378]:   <target dev="vdc" bus="virtio"/>
Nov 09 04:01:29 user nova-compute[75378]:   <serial>23c47b9a-6716-4f1f-b05d-5052b07cf5e2</serial>
Nov 09 04:01:29 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 09 04:01:29 user nova-compute[75378]: </disk>
Nov 09 04:01:29 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 04:01:29 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Successfully detached device vdc from instance eb8117df-cf63-4bc9-9691-4828ff7f5a8e from the persistent domain config.
Nov 09 04:01:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance eb8117df-cf63-4bc9-9691-4828ff7f5a8e from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 04:01:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 04:01:29 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:01:29 user nova-compute[75378]:   <source dev="/dev/sdd"/>
Nov 09 04:01:29 user nova-compute[75378]:   <target dev="vdc" bus="virtio"/>
Nov 09 04:01:29 user nova-compute[75378]:   <serial>23c47b9a-6716-4f1f-b05d-5052b07cf5e2</serial>
Nov 09 04:01:29 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 09 04:01:29 user nova-compute[75378]: </disk>
Nov 09 04:01:29 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 04:01:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance eb8117df-cf63-4bc9-9691-4828ff7f5a8e {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 04:01:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:01:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:39 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:01:40 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:01:41 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:01:41 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:01:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-06799031-9998-4829-8725-09526681c442" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:01:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-06799031-9998-4829-8725-09526681c442" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:01:41 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 06799031-9998-4829-8725-09526681c442] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 04:01:41 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 06799031-9998-4829-8725-09526681c442] Updating instance_info_cache with network_info: [{"id": "037999da-478f-48ea-8d99-2c86b18842e8", "address": "fa:16:3e:41:3b:05", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037999da-47", "ovs_interfaceid": "037999da-478f-48ea-8d99-2c86b18842e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:01:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-06799031-9998-4829-8725-09526681c442" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:01:41 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 06799031-9998-4829-8725-09526681c442] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 04:01:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:42 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:01:42 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:01:42 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:01:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "06799031-9998-4829-8725-09526681c442" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:01:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "06799031-9998-4829-8725-09526681c442" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:01:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "06799031-9998-4829-8725-09526681c442-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:01:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "06799031-9998-4829-8725-09526681c442-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:01:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "06799031-9998-4829-8725-09526681c442-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:01:43 user nova-compute[75378]: INFO nova.compute.manager [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Terminating instance
Nov 09 04:01:43 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:01:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG nova.compute.manager [req-79b28c9a-7830-43b3-8f89-3d404ee5f3b6 req-a6e3528d-815c-4eca-87e8-b51c53543231 service nova] [instance: 06799031-9998-4829-8725-09526681c442] Received event network-vif-unplugged-037999da-478f-48ea-8d99-2c86b18842e8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-79b28c9a-7830-43b3-8f89-3d404ee5f3b6 req-a6e3528d-815c-4eca-87e8-b51c53543231 service nova] Acquiring lock "06799031-9998-4829-8725-09526681c442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-79b28c9a-7830-43b3-8f89-3d404ee5f3b6 req-a6e3528d-815c-4eca-87e8-b51c53543231 service nova] Lock "06799031-9998-4829-8725-09526681c442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-79b28c9a-7830-43b3-8f89-3d404ee5f3b6 req-a6e3528d-815c-4eca-87e8-b51c53543231 service nova] Lock "06799031-9998-4829-8725-09526681c442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG nova.compute.manager [req-79b28c9a-7830-43b3-8f89-3d404ee5f3b6 req-a6e3528d-815c-4eca-87e8-b51c53543231 service nova] [instance: 06799031-9998-4829-8725-09526681c442] No waiting events found dispatching network-vif-unplugged-037999da-478f-48ea-8d99-2c86b18842e8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG nova.compute.manager [req-79b28c9a-7830-43b3-8f89-3d404ee5f3b6 req-a6e3528d-815c-4eca-87e8-b51c53543231 service nova] [instance: 06799031-9998-4829-8725-09526681c442] Received event network-vif-unplugged-037999da-478f-48ea-8d99-2c86b18842e8 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:44 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 06799031-9998-4829-8725-09526681c442] Instance destroyed successfully.
Nov 09 04:01:44 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lazy-loading 'resources' on Instance uuid 06799031-9998-4829-8725-09526681c442 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:55:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1996227040',display_name='tempest-AttachVolumeNegativeTest-server-1996227040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1996227040',id=33,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIri4molai/oUIqKmxJbObknGBXVg/fe16qKxTlHAuSupxC2u/0CgZaBcMplT255HRlFJljzi1DEJzf0NqM9wctYe+9tL+88iHqplYGhHTkGu6VGEuwFEKF2Z5H4/fadg==',key_name='tempest-keypair-1397532635',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:55:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d990b7b4c19436d8cd8f43d8d0facb9',ramdisk_id='',reservation_id='r-og8gx1co',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-921155549',owner_user_name='tempest-AttachVolumeNegativeTest-921155549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:55:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afcdb0627e34b6e893b7981ea4615e3',uuid=06799031-9998-4829-8725-09526681c442,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "037999da-478f-48ea-8d99-2c86b18842e8", "address": "fa:16:3e:41:3b:05", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037999da-47", "ovs_interfaceid": "037999da-478f-48ea-8d99-2c86b18842e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converting VIF {"id": "037999da-478f-48ea-8d99-2c86b18842e8", "address": "fa:16:3e:41:3b:05", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037999da-47", "ovs_interfaceid": "037999da-478f-48ea-8d99-2c86b18842e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:3b:05,bridge_name='br-int',has_traffic_filtering=True,id=037999da-478f-48ea-8d99-2c86b18842e8,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037999da-47') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG os_vif [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:3b:05,bridge_name='br-int',has_traffic_filtering=True,id=037999da-478f-48ea-8d99-2c86b18842e8,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037999da-47') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap037999da-47, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0d2bdb1-4fc5-4e15-8695-a63a19b4d4ec) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:44 user nova-compute[75378]: INFO os_vif [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:3b:05,bridge_name='br-int',has_traffic_filtering=True,id=037999da-478f-48ea-8d99-2c86b18842e8,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037999da-47')
Nov 09 04:01:44 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Deleting instance files /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442_del
Nov 09 04:01:44 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Deletion of /opt/stack/data/nova/instances/06799031-9998-4829-8725-09526681c442_del complete
Nov 09 04:01:44 user nova-compute[75378]: INFO nova.compute.manager [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 06799031-9998-4829-8725-09526681c442] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 09 04:01:44 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 06799031-9998-4829-8725-09526681c442] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:01:44 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 06799031-9998-4829-8725-09526681c442] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:01:45 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 06799031-9998-4829-8725-09526681c442] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:01:45 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 06799031-9998-4829-8725-09526681c442] Took 0.83 seconds to deallocate network for instance.
Nov 09 04:01:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:01:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:01:45 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:01:45 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:01:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:01:45 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Deleted allocations for instance 06799031-9998-4829-8725-09526681c442
Nov 09 04:01:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ae4274ae-6de5-4347-a50b-27ec20e8aa54 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "06799031-9998-4829-8725-09526681c442" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.210s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:01:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-2e6fdccd-d17e-42c4-9792-baf5170cc9f8 req-73de981f-bf3c-4d5d-b2f3-8f858e6ddc0c service nova] [instance: 06799031-9998-4829-8725-09526681c442] Received event network-vif-plugged-037999da-478f-48ea-8d99-2c86b18842e8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:01:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2e6fdccd-d17e-42c4-9792-baf5170cc9f8 req-73de981f-bf3c-4d5d-b2f3-8f858e6ddc0c service nova] Acquiring lock "06799031-9998-4829-8725-09526681c442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:01:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2e6fdccd-d17e-42c4-9792-baf5170cc9f8 req-73de981f-bf3c-4d5d-b2f3-8f858e6ddc0c service nova] Lock "06799031-9998-4829-8725-09526681c442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:01:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2e6fdccd-d17e-42c4-9792-baf5170cc9f8 req-73de981f-bf3c-4d5d-b2f3-8f858e6ddc0c service nova] Lock "06799031-9998-4829-8725-09526681c442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:01:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-2e6fdccd-d17e-42c4-9792-baf5170cc9f8 req-73de981f-bf3c-4d5d-b2f3-8f858e6ddc0c service nova] [instance: 06799031-9998-4829-8725-09526681c442] No waiting events found dispatching network-vif-plugged-037999da-478f-48ea-8d99-2c86b18842e8 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:01:46 user nova-compute[75378]: WARNING nova.compute.manager [req-2e6fdccd-d17e-42c4-9792-baf5170cc9f8 req-73de981f-bf3c-4d5d-b2f3-8f858e6ddc0c service nova] [instance: 06799031-9998-4829-8725-09526681c442] Received unexpected event network-vif-plugged-037999da-478f-48ea-8d99-2c86b18842e8 for instance with vm_state deleted and task_state None.
Nov 09 04:01:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-2e6fdccd-d17e-42c4-9792-baf5170cc9f8 req-73de981f-bf3c-4d5d-b2f3-8f858e6ddc0c service nova] [instance: 06799031-9998-4829-8725-09526681c442] Received event network-vif-deleted-037999da-478f-48ea-8d99-2c86b18842e8 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:01:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:47 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:01:47 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:01:47 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:01:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:01:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:01:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:01:47 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:01:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:01:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:01:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:01:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:49 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:01:49 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:01:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8019MB free_disk=25.028789520263672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:01:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:01:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:01:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Applying migration context for instance 9dcaeb12-99bc-48f0-aec9-3de2a3770e01 as it has an incoming, in-progress migration 2ea6362c-e6eb-4d1d-82f9-28e22bbac1b4. Migration status is finished {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 09 04:01:49 user nova-compute[75378]: INFO nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Updating resource usage from migration 2ea6362c-e6eb-4d1d-82f9-28e22bbac1b4
Nov 09 04:01:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7d051405-6b57-4db2-9533-c2f4e87134d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:01:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2c2acb48-972a-41d7-987e-48e79b3bef93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:01:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 013db901-fbee-4593-a14f-95a03e79fad0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:01:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 11f18164-9676-4a8a-91be-8bd87673ec5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:01:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance eb8117df-cf63-4bc9-9691-4828ff7f5a8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:01:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 19359be7-5789-4d89-bc5a-c6c5ccd52211 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:01:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Migration 2ea6362c-e6eb-4d1d-82f9-28e22bbac1b4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 09 04:01:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9dcaeb12-99bc-48f0-aec9-3de2a3770e01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:01:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 00959e75-7446-4ff6-be3e-56d7146b3576 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:01:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:01:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:01:49 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:01:49 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:01:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:01:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:01:50 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance eb8117df-cf63-4bc9-9691-4828ff7f5a8e is timed out.
Nov 09 04:01:50 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Successfully detached device vdc from instance eb8117df-cf63-4bc9-9691-4828ff7f5a8e from the live domain config.
Nov 09 04:01:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SeLvfWMX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:01:50 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:01:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53d8508-1274-48eb-bfbf-ab39d073c7a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 04:01:50 user nova-compute[75378]: No targets found.
Nov 09 04:01:50 user nova-compute[75378]: iSNS:
Nov 09 04:01:50 user nova-compute[75378]: No targets found.
Nov 09 04:01:50 user nova-compute[75378]: STATIC:
Nov 09 04:01:50 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 04:01:50 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:01:50 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:01:50 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2
Nov 09 04:01:50 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:01:50 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:01:50 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2
Nov 09 04:01:50 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:01:50 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:01:50 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723
Nov 09 04:01:50 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:01:50 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:01:50 user nova-compute[75378]: FIRMWARE:
Nov 09 04:01:50 user nova-compute[75378]: No targets found.
Nov 09 04:01:50 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 04:01:50 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 04:01:50 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f61cf4b-f1c8-46b7-8d99-aa9096349389]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[970420cb-6990-4bfc-b1b2-03f15fb87f73]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:01:50 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:01:50 user nova-compute[75378]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:01:50 user nova-compute[75378]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 (non-flash)
Nov 09 04:01:50 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:01:50 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:01:50 user nova-compute[75378]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:01:50 user nova-compute[75378]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 (non-flash)
Nov 09 04:01:50 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c6b0ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2'): ({'sdd'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Removing single pathed devices sdd {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[207746a0-370e-4955-adc4-4432d1da7627]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a165cdd4-6525-4d7e-9083-38ea3a359ff6]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Flushing IO for device /dev/sdd {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa246462-2e14-490b-8371-a4bc8eaa2a43]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3247844-0feb-4c4d-bf33-e1e5e2e78909]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] SCSI volumes sdd have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5ee66a-f7a0-4f84-989e-67649d277cea]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a77b56-5490-4634-96d4-0d2798e206e3]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2, portal: 172.16.0.220,3260]
Nov 09 04:01:50 user nova-compute[75378]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2, portal: 172.16.0.220,3260] successful.
Nov 09 04:01:50 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23c47b9a-6716-4f1f-b05d-5052b07cf5e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[037ea55a-73cb-4014-8f39-3f548a7ad9db]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] <== disconnect_volume: return (322ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:01:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 04:01:51 user nova-compute[75378]: DEBUG nova.objects.instance [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lazy-loading 'flavor' on Instance uuid eb8117df-cf63-4bc9-9691-4828ff7f5a8e {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:01:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5695d125-bb14-4691-a37a-a1010134d3bc tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.849s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:01:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:01:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:01:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:01:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:01:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:01:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 04:02:02 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Creating image(s)
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Did not create local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Ensure instance console log exists: /opt/stack/data/nova/instances/00959e75-7446-4ff6-be3e-56d7146b3576/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Start _get_guest_xml network_info=[{"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abmGJcwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '00959e75-7446-4ff6-be3e-56d7146b3576', 'attached_at': '', 'detached_at': '', 'volume_id': '073fc7a9-2698-4f96-888c-170888571f4d', 'serial': '073fc7a9-2698-4f96-888c-170888571f4d'}, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'bb66b970-5d22-46a6-9848-abd76df72ce3', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 04:02:02 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:02:02 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abmGJcwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:02:02 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:02:02 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:02:02 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc36241d-c1cd-491d-8149-3d51e4f9c0ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 04:02:02 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfaaced-69bb-4c0c-903b-61d0b7f53bb2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d] added
Nov 09 04:02:02 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8386c1ec-b872-4541-8eaa-9723796ad07a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "11f18164-9676-4a8a-91be-8bd87673ec5b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "11f18164-9676-4a8a-91be-8bd87673ec5b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "11f18164-9676-4a8a-91be-8bd87673ec5b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "11f18164-9676-4a8a-91be-8bd87673ec5b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "11f18164-9676-4a8a-91be-8bd87673ec5b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:02 user nova-compute[75378]: INFO nova.compute.manager [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Terminating instance
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5467901f-4451-43dd-a248-71a8a797aa5b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.compute.manager [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abmGJcwI {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abmGJcwI" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28a3e59-a05f-464b-8376-38f85b05213b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'abmGJcwI'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07fb1fa-3bd8-4d21-ac5b-974012473ec0]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[610f1214-9f9a-4ff8-a12b-b5d0f78a88d9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:02:02 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:02:02 user nova-compute[75378]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:02:02 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:02:02 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:02:02 user nova-compute[75378]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:02:02 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[261683e5-2e2e-4b42-86f9-8918dac25cd6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d, portal: 172.16.0.220,3260]
Nov 09 04:02:02 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d, portal: 172.16.0.220,3260] successful.
Nov 09 04:02:02 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[59504e69-de2a-419b-904a-429e90da6382]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[30befe0d-1fb2-40fb-84c4-0207dc6904d4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:02:02 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:02:02 user nova-compute[75378]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:02:02 user nova-compute[75378]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d (non-flash)
Nov 09 04:02:02 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:02:02 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:02:02 user nova-compute[75378]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:02:02 user nova-compute[75378]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d (non-flash)
Nov 09 04:02:02 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a76be0-b26e-4d38-9737-0e1afa862a5c]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abmGJcwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.compute.manager [req-93c2118b-e728-4ef0-97a0-871dfb79c74a req-1d53e8a0-442f-4ed9-93d4-d9d26953404c service nova] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Received event network-vif-unplugged-a18b5039-3584-437a-b55f-b72630693484 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-93c2118b-e728-4ef0-97a0-871dfb79c74a req-1d53e8a0-442f-4ed9-93d4-d9d26953404c service nova] Acquiring lock "11f18164-9676-4a8a-91be-8bd87673ec5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-93c2118b-e728-4ef0-97a0-871dfb79c74a req-1d53e8a0-442f-4ed9-93d4-d9d26953404c service nova] Lock "11f18164-9676-4a8a-91be-8bd87673ec5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-93c2118b-e728-4ef0-97a0-871dfb79c74a req-1d53e8a0-442f-4ed9-93d4-d9d26953404c service nova] Lock "11f18164-9676-4a8a-91be-8bd87673ec5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.compute.manager [req-93c2118b-e728-4ef0-97a0-871dfb79c74a req-1d53e8a0-442f-4ed9-93d4-d9d26953404c service nova] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] No waiting events found dispatching network-vif-unplugged-a18b5039-3584-437a-b55f-b72630693484 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG nova.compute.manager [req-93c2118b-e728-4ef0-97a0-871dfb79c74a req-1d53e8a0-442f-4ed9-93d4-d9d26953404c service nova] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Received event network-vif-unplugged-a18b5039-3584-437a-b55f-b72630693484 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:03 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Instance destroyed successfully.
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.objects.instance [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'resources' on Instance uuid 11f18164-9676-4a8a-91be-8bd87673ec5b {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:51:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1322564567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1322564567',id=28,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:51:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c2176531ffa4cf7bec818309e39ab8d',ramdisk_id='',reservation_id='r-42iirc0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:53:45Z,user_data=None,user_id='57efcfeacd7f4daf916e7dd04e11d8f2',uuid=11f18164-9676-4a8a-91be-8bd87673ec5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a18b5039-3584-437a-b55f-b72630693484", "address": "fa:16:3e:f3:24:46", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa18b5039-35", "ovs_interfaceid": "a18b5039-3584-437a-b55f-b72630693484", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converting VIF {"id": "a18b5039-3584-437a-b55f-b72630693484", "address": "fa:16:3e:f3:24:46", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa18b5039-35", "ovs_interfaceid": "a18b5039-3584-437a-b55f-b72630693484", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:24:46,bridge_name='br-int',has_traffic_filtering=True,id=a18b5039-3584-437a-b55f-b72630693484,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa18b5039-35') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG os_vif [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:24:46,bridge_name='br-int',has_traffic_filtering=True,id=a18b5039-3584-437a-b55f-b72630693484,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa18b5039-35') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa18b5039-35, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1281a110-0a1d-4729-8f6e-9f44c800cc4c) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:03 user nova-compute[75378]: INFO os_vif [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:24:46,bridge_name='br-int',has_traffic_filtering=True,id=a18b5039-3584-437a-b55f-b72630693484,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa18b5039-35')
Nov 09 04:02:03 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Deleting instance files /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b_del
Nov 09 04:02:03 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Deletion of /opt/stack/data/nova/instances/11f18164-9676-4a8a-91be-8bd87673ec5b_del complete
Nov 09 04:02:03 user nova-compute[75378]: INFO nova.compute.manager [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 09 04:02:03 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23431643333626231', 'path': '/dev/sdd'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431643333626231', 'path': '/dev/sdd'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:01:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1994468493',display_name='tempest-TestShelveInstance-server-1994468493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1994468493',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCm0omUjoHyl4PvBkF16sxOWjYLeE1jTtpfJdDjNGvyhYeGuWjjLfukGm/WTTPWNWVyCXy66zTOjquQm5tfvYMzeICuPOlLbQx91KPbah5m5G55l9OSLgMebWgd7GFg0Hw==',key_name='tempest-TestShelveInstance-1433736735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='473b18add01440c082dbe9f1503b075d',ramdisk_id='',reservation_id='r-0nv92eqt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-32995184',owner_user_name='tempest-TestShelveInstance-32995184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:01:24Z,user_data=None,user_id='931191283d604e2a91bd3e4daceedebf',uuid=00959e75-7446-4ff6-be3e-56d7146b3576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Converting VIF {"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:4d:6f,bridge_name='br-int',has_traffic_filtering=True,id=bd706a0c-ba99-42b7-bf21-898a277c3541,network=Network(e2b2cd72-bdd1-484a-ace3-25029da9ac29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd706a0c-ba') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.objects.instance [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lazy-loading 'pci_devices' on Instance uuid 00959e75-7446-4ff6-be3e-56d7146b3576 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] End _get_guest_xml xml=<domain type="kvm">
Nov 09 04:02:03 user nova-compute[75378]:   <uuid>00959e75-7446-4ff6-be3e-56d7146b3576</uuid>
Nov 09 04:02:03 user nova-compute[75378]:   <name>instance-00000027</name>
Nov 09 04:02:03 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 04:02:03 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 04:02:03 user nova-compute[75378]:   <metadata>
Nov 09 04:02:03 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 04:02:03 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 04:02:03 user nova-compute[75378]:       <nova:name>tempest-TestShelveInstance-server-1994468493</nova:name>
Nov 09 04:02:03 user nova-compute[75378]:       <nova:creationTime>2023-11-09 04:02:02</nova:creationTime>
Nov 09 04:02:03 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 04:02:03 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 04:02:03 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 04:02:03 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 04:02:03 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 04:02:03 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 04:02:03 user nova-compute[75378]:       </nova:flavor>
Nov 09 04:02:03 user nova-compute[75378]:       <nova:owner>
Nov 09 04:02:03 user nova-compute[75378]:         <nova:user uuid="931191283d604e2a91bd3e4daceedebf">tempest-TestShelveInstance-32995184-project-member</nova:user>
Nov 09 04:02:03 user nova-compute[75378]:         <nova:project uuid="473b18add01440c082dbe9f1503b075d">tempest-TestShelveInstance-32995184</nova:project>
Nov 09 04:02:03 user nova-compute[75378]:       </nova:owner>
Nov 09 04:02:03 user nova-compute[75378]:       <nova:ports>
Nov 09 04:02:03 user nova-compute[75378]:         <nova:port uuid="bd706a0c-ba99-42b7-bf21-898a277c3541">
Nov 09 04:02:03 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 04:02:03 user nova-compute[75378]:         </nova:port>
Nov 09 04:02:03 user nova-compute[75378]:       </nova:ports>
Nov 09 04:02:03 user nova-compute[75378]:     </nova:instance>
Nov 09 04:02:03 user nova-compute[75378]:   </metadata>
Nov 09 04:02:03 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 04:02:03 user nova-compute[75378]:     <system>
Nov 09 04:02:03 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 04:02:03 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 04:02:03 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 04:02:03 user nova-compute[75378]:       <entry name="serial">00959e75-7446-4ff6-be3e-56d7146b3576</entry>
Nov 09 04:02:03 user nova-compute[75378]:       <entry name="uuid">00959e75-7446-4ff6-be3e-56d7146b3576</entry>
Nov 09 04:02:03 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 04:02:03 user nova-compute[75378]:     </system>
Nov 09 04:02:03 user nova-compute[75378]:   </sysinfo>
Nov 09 04:02:03 user nova-compute[75378]:   <os>
Nov 09 04:02:03 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 04:02:03 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 04:02:03 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 04:02:03 user nova-compute[75378]:   </os>
Nov 09 04:02:03 user nova-compute[75378]:   <features>
Nov 09 04:02:03 user nova-compute[75378]:     <acpi/>
Nov 09 04:02:03 user nova-compute[75378]:     <apic/>
Nov 09 04:02:03 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 04:02:03 user nova-compute[75378]:   </features>
Nov 09 04:02:03 user nova-compute[75378]:   <clock offset="utc">
Nov 09 04:02:03 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 04:02:03 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 04:02:03 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 04:02:03 user nova-compute[75378]:   </clock>
Nov 09 04:02:03 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 04:02:03 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 04:02:03 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 04:02:03 user nova-compute[75378]:   </cpu>
Nov 09 04:02:03 user nova-compute[75378]:   <devices>
Nov 09 04:02:03 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 04:02:03 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:02:03 user nova-compute[75378]:       <source dev="/dev/sdd"/>
Nov 09 04:02:03 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 04:02:03 user nova-compute[75378]:       <serial>073fc7a9-2698-4f96-888c-170888571f4d</serial>
Nov 09 04:02:03 user nova-compute[75378]:     </disk>
Nov 09 04:02:03 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 04:02:03 user nova-compute[75378]:       <mac address="fa:16:3e:16:4d:6f"/>
Nov 09 04:02:03 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:02:03 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 04:02:03 user nova-compute[75378]:       <target dev="tapbd706a0c-ba"/>
Nov 09 04:02:03 user nova-compute[75378]:     </interface>
Nov 09 04:02:03 user nova-compute[75378]:     <serial type="pty">
Nov 09 04:02:03 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/00959e75-7446-4ff6-be3e-56d7146b3576/console.log" append="off"/>
Nov 09 04:02:03 user nova-compute[75378]:     </serial>
Nov 09 04:02:03 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 04:02:03 user nova-compute[75378]:     <video>
Nov 09 04:02:03 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:02:03 user nova-compute[75378]:     </video>
Nov 09 04:02:03 user nova-compute[75378]:     <rng model="virtio">
Nov 09 04:02:03 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 04:02:03 user nova-compute[75378]:     </rng>
Nov 09 04:02:03 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 04:02:03 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 04:02:03 user nova-compute[75378]:       <stats period="10"/>
Nov 09 04:02:03 user nova-compute[75378]:     </memballoon>
Nov 09 04:02:03 user nova-compute[75378]:   </devices>
Nov 09 04:02:03 user nova-compute[75378]: </domain>
Nov 09 04:02:03 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:01:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1994468493',display_name='tempest-TestShelveInstance-server-1994468493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1994468493',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCm0omUjoHyl4PvBkF16sxOWjYLeE1jTtpfJdDjNGvyhYeGuWjjLfukGm/WTTPWNWVyCXy66zTOjquQm5tfvYMzeICuPOlLbQx91KPbah5m5G55l9OSLgMebWgd7GFg0Hw==',key_name='tempest-TestShelveInstance-1433736735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='473b18add01440c082dbe9f1503b075d',ramdisk_id='',reservation_id='r-0nv92eqt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-32995184',owner_user_name='tempest-TestShelveInstance-32995184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:01:24Z,user_data=None,user_id='931191283d604e2a91bd3e4daceedebf',uuid=00959e75-7446-4ff6-be3e-56d7146b3576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Converting VIF {"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:4d:6f,bridge_name='br-int',has_traffic_filtering=True,id=bd706a0c-ba99-42b7-bf21-898a277c3541,network=Network(e2b2cd72-bdd1-484a-ace3-25029da9ac29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd706a0c-ba') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG os_vif [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4d:6f,bridge_name='br-int',has_traffic_filtering=True,id=bd706a0c-ba99-42b7-bf21-898a277c3541,network=Network(e2b2cd72-bdd1-484a-ace3-25029da9ac29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd706a0c-ba') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5638648-d853-59b4-b910-8a2948aaf764', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd706a0c-ba, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd706a0c-ba, col_values=(('qos', UUID('78284226-5a49-4497-a3f5-2599958027eb')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd706a0c-ba, col_values=(('external_ids', {'iface-id': 'bd706a0c-ba99-42b7-bf21-898a277c3541', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:4d:6f', 'vm-uuid': '00959e75-7446-4ff6-be3e-56d7146b3576'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:03 user nova-compute[75378]: INFO os_vif [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4d:6f,bridge_name='br-int',has_traffic_filtering=True,id=bd706a0c-ba99-42b7-bf21-898a277c3541,network=Network(e2b2cd72-bdd1-484a-ace3-25029da9ac29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd706a0c-ba')
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-36429ebe-a917-4ec5-b906-afac70e29052 req-79496967-9121-4132-9d21-f40a5edc896e service nova] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Received event network-vif-deleted-a18b5039-3584-437a-b55f-b72630693484 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:02:03 user nova-compute[75378]: INFO nova.compute.manager [req-36429ebe-a917-4ec5-b906-afac70e29052 req-79496967-9121-4132-9d21-f40a5edc896e service nova] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Neutron deleted interface a18b5039-3584-437a-b55f-b72630693484; detaching it from the instance and deleting it from the info cache
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.network.neutron [req-36429ebe-a917-4ec5-b906-afac70e29052 req-79496967-9121-4132-9d21-f40a5edc896e service nova] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:02:03 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Took 0.43 seconds to deallocate network for instance.
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-36429ebe-a917-4ec5-b906-afac70e29052 req-79496967-9121-4132-9d21-f40a5edc896e service nova] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Detach interface failed, port_id=a18b5039-3584-437a-b55f-b72630693484, reason: Instance 11f18164-9676-4a8a-91be-8bd87673ec5b could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] No VIF found with MAC fa:16:3e:16:4d:6f, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:02:03 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:02:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:04 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Deleted allocations for instance 11f18164-9676-4a8a-91be-8bd87673ec5b
Nov 09 04:02:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-60ee5a42-b503-4ea6-839d-79543306fdd7 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "11f18164-9676-4a8a-91be-8bd87673ec5b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.028s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-c6d2718d-8157-40e2-92c5-eb767fc24f4d req-ae318e7c-c44f-4c28-b4ed-18e525d5c403 service nova] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Received event network-vif-plugged-a18b5039-3584-437a-b55f-b72630693484 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:02:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c6d2718d-8157-40e2-92c5-eb767fc24f4d req-ae318e7c-c44f-4c28-b4ed-18e525d5c403 service nova] Acquiring lock "11f18164-9676-4a8a-91be-8bd87673ec5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c6d2718d-8157-40e2-92c5-eb767fc24f4d req-ae318e7c-c44f-4c28-b4ed-18e525d5c403 service nova] Lock "11f18164-9676-4a8a-91be-8bd87673ec5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c6d2718d-8157-40e2-92c5-eb767fc24f4d req-ae318e7c-c44f-4c28-b4ed-18e525d5c403 service nova] Lock "11f18164-9676-4a8a-91be-8bd87673ec5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-c6d2718d-8157-40e2-92c5-eb767fc24f4d req-ae318e7c-c44f-4c28-b4ed-18e525d5c403 service nova] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] No waiting events found dispatching network-vif-plugged-a18b5039-3584-437a-b55f-b72630693484 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:02:04 user nova-compute[75378]: WARNING nova.compute.manager [req-c6d2718d-8157-40e2-92c5-eb767fc24f4d req-ae318e7c-c44f-4c28-b4ed-18e525d5c403 service nova] [instance: 11f18164-9676-4a8a-91be-8bd87673ec5b] Received unexpected event network-vif-plugged-a18b5039-3584-437a-b55f-b72630693484 for instance with vm_state deleted and task_state None.
Nov 09 04:02:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-55c70519-2e85-4cca-b041-6efd7eed54a0 req-ba1ff788-c659-4dd1-923f-579eb16384b6 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received event network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:02:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-55c70519-2e85-4cca-b041-6efd7eed54a0 req-ba1ff788-c659-4dd1-923f-579eb16384b6 service nova] Acquiring lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-55c70519-2e85-4cca-b041-6efd7eed54a0 req-ba1ff788-c659-4dd1-923f-579eb16384b6 service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-55c70519-2e85-4cca-b041-6efd7eed54a0 req-ba1ff788-c659-4dd1-923f-579eb16384b6 service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-55c70519-2e85-4cca-b041-6efd7eed54a0 req-ba1ff788-c659-4dd1-923f-579eb16384b6 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] No waiting events found dispatching network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:02:06 user nova-compute[75378]: WARNING nova.compute.manager [req-55c70519-2e85-4cca-b041-6efd7eed54a0 req-ba1ff788-c659-4dd1-923f-579eb16384b6 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received unexpected event network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 for instance with vm_state building and task_state spawning.
Nov 09 04:02:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-55c70519-2e85-4cca-b041-6efd7eed54a0 req-ba1ff788-c659-4dd1-923f-579eb16384b6 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received event network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:02:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-55c70519-2e85-4cca-b041-6efd7eed54a0 req-ba1ff788-c659-4dd1-923f-579eb16384b6 service nova] Acquiring lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-55c70519-2e85-4cca-b041-6efd7eed54a0 req-ba1ff788-c659-4dd1-923f-579eb16384b6 service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-55c70519-2e85-4cca-b041-6efd7eed54a0 req-ba1ff788-c659-4dd1-923f-579eb16384b6 service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-55c70519-2e85-4cca-b041-6efd7eed54a0 req-ba1ff788-c659-4dd1-923f-579eb16384b6 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] No waiting events found dispatching network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:02:06 user nova-compute[75378]: WARNING nova.compute.manager [req-55c70519-2e85-4cca-b041-6efd7eed54a0 req-ba1ff788-c659-4dd1-923f-579eb16384b6 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received unexpected event network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 for instance with vm_state building and task_state spawning.
Nov 09 04:02:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:07 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 04:02:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 04:02:07 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Instance spawned successfully.
Nov 09 04:02:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 04:02:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:02:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:02:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:02:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:02:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:02:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:02:07 user nova-compute[75378]: INFO nova.compute.manager [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 09 04:02:07 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:02:07 user nova-compute[75378]: INFO nova.compute.manager [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Took 44.43 seconds to build instance.
Nov 09 04:02:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d8160c2b-262f-4082-8b3a-96d0d8831184 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "00959e75-7446-4ff6-be3e-56d7146b3576" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.547s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquiring lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:20 user nova-compute[75378]: INFO nova.compute.manager [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Detaching volume 9d394411-cc83-4308-ac96-0af3f47f7da2
Nov 09 04:02:20 user nova-compute[75378]: INFO nova.virt.block_device [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Attempting to driver detach volume 9d394411-cc83-4308-ac96-0af3f47f7da2 from mountpoint /dev/vdb
Nov 09 04:02:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Attempting to detach device vdb from instance eb8117df-cf63-4bc9-9691-4828ff7f5a8e from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 04:02:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 04:02:20 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:02:20 user nova-compute[75378]:   <source dev="/dev/sdf"/>
Nov 09 04:02:20 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 04:02:20 user nova-compute[75378]:   <serial>9d394411-cc83-4308-ac96-0af3f47f7da2</serial>
Nov 09 04:02:20 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 04:02:20 user nova-compute[75378]: </disk>
Nov 09 04:02:20 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 04:02:20 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Successfully detached device vdb from instance eb8117df-cf63-4bc9-9691-4828ff7f5a8e from the persistent domain config.
Nov 09 04:02:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eb8117df-cf63-4bc9-9691-4828ff7f5a8e from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 04:02:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 04:02:20 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:02:20 user nova-compute[75378]:   <source dev="/dev/sdf"/>
Nov 09 04:02:20 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 04:02:20 user nova-compute[75378]:   <serial>9d394411-cc83-4308-ac96-0af3f47f7da2</serial>
Nov 09 04:02:20 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 04:02:20 user nova-compute[75378]: </disk>
Nov 09 04:02:20 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 04:02:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eb8117df-cf63-4bc9-9691-4828ff7f5a8e {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 04:02:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:23 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:02:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8783762b-6d3e-4178-80d8-e7d32f746ecb tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8783762b-6d3e-4178-80d8-e7d32f746ecb tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:33 user nova-compute[75378]: DEBUG nova.compute.manager [None req-8783762b-6d3e-4178-80d8-e7d32f746ecb tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Going to confirm migration 2 {{(pid=75378) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 09 04:02:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8783762b-6d3e-4178-80d8-e7d32f746ecb tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "refresh_cache-9dcaeb12-99bc-48f0-aec9-3de2a3770e01" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:02:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8783762b-6d3e-4178-80d8-e7d32f746ecb tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquired lock "refresh_cache-9dcaeb12-99bc-48f0-aec9-3de2a3770e01" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:02:33 user nova-compute[75378]: DEBUG nova.network.neutron [None req-8783762b-6d3e-4178-80d8-e7d32f746ecb tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:02:33 user nova-compute[75378]: DEBUG nova.objects.instance [None req-8783762b-6d3e-4178-80d8-e7d32f746ecb tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lazy-loading 'info_cache' on Instance uuid 9dcaeb12-99bc-48f0-aec9-3de2a3770e01 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:02:34 user nova-compute[75378]: DEBUG nova.network.neutron [None req-8783762b-6d3e-4178-80d8-e7d32f746ecb tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Updating instance_info_cache with network_info: [{"id": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "address": "fa:16:3e:68:d1:1a", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971f6712-c5", "ovs_interfaceid": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:02:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8783762b-6d3e-4178-80d8-e7d32f746ecb tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Releasing lock "refresh_cache-9dcaeb12-99bc-48f0-aec9-3de2a3770e01" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:02:34 user nova-compute[75378]: DEBUG nova.objects.instance [None req-8783762b-6d3e-4178-80d8-e7d32f746ecb tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lazy-loading 'migration_context' on Instance uuid 9dcaeb12-99bc-48f0-aec9-3de2a3770e01 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:02:34 user nova-compute[75378]: DEBUG nova.objects.base [None req-8783762b-6d3e-4178-80d8-e7d32f746ecb tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Object Instance<9dcaeb12-99bc-48f0-aec9-3de2a3770e01> lazy-loaded attributes: info_cache,migration_context {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 04:02:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8783762b-6d3e-4178-80d8-e7d32f746ecb tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8783762b-6d3e-4178-80d8-e7d32f746ecb tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:34 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-8783762b-6d3e-4178-80d8-e7d32f746ecb tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:02:34 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-8783762b-6d3e-4178-80d8-e7d32f746ecb tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:02:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8783762b-6d3e-4178-80d8-e7d32f746ecb tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.341s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:34 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-8783762b-6d3e-4178-80d8-e7d32f746ecb tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Deleted allocation for migration 2ea6362c-e6eb-4d1d-82f9-28e22bbac1b4
Nov 09 04:02:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8783762b-6d3e-4178-80d8-e7d32f746ecb tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.298s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:37 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 04:02:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:37 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 04:02:37 user nova-compute[75378]: INFO nova.compute.claims [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Claim successful on node user
Nov 09 04:02:37 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:02:37 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:02:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:37 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 04:02:37 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 04:02:37 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 04:02:37 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 04:02:37 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG nova.policy [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2afcdb0627e34b6e893b7981ea4615e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d990b7b4c19436d8cd8f43d8d0facb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 04:02:38 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Creating image(s)
Nov 09 04:02:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "/opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "/opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.189s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk 1073741824" returned: 0 in 0.050s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Successfully created port: 8ee45305-d703-4e55-ac47-60d1407e2772 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.176s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Cannot resize image /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Ensure instance console log exists: /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Successfully updated port: 8ee45305-d703-4e55-ac47-60d1407e2772 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "refresh_cache-a0a9882f-8b9f-4666-a9fe-0e23efd56616" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquired lock "refresh_cache-a0a9882f-8b9f-4666-a9fe-0e23efd56616" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.compute.manager [req-92bd40c7-6f67-457b-99c6-8b6cafedf509 req-60a32518-4c2d-4284-9bae-7aca2d09d6d0 service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Received event network-changed-8ee45305-d703-4e55-ac47-60d1407e2772 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.compute.manager [req-92bd40c7-6f67-457b-99c6-8b6cafedf509 req-60a32518-4c2d-4284-9bae-7aca2d09d6d0 service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Refreshing instance network info cache due to event network-changed-8ee45305-d703-4e55-ac47-60d1407e2772. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-92bd40c7-6f67-457b-99c6-8b6cafedf509 req-60a32518-4c2d-4284-9bae-7aca2d09d6d0 service nova] Acquiring lock "refresh_cache-a0a9882f-8b9f-4666-a9fe-0e23efd56616" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.network.neutron [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Updating instance_info_cache with network_info: [{"id": "8ee45305-d703-4e55-ac47-60d1407e2772", "address": "fa:16:3e:bb:23:47", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee45305-d7", "ovs_interfaceid": "8ee45305-d703-4e55-ac47-60d1407e2772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Releasing lock "refresh_cache-a0a9882f-8b9f-4666-a9fe-0e23efd56616" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Instance network_info: |[{"id": "8ee45305-d703-4e55-ac47-60d1407e2772", "address": "fa:16:3e:bb:23:47", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee45305-d7", "ovs_interfaceid": "8ee45305-d703-4e55-ac47-60d1407e2772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-92bd40c7-6f67-457b-99c6-8b6cafedf509 req-60a32518-4c2d-4284-9bae-7aca2d09d6d0 service nova] Acquired lock "refresh_cache-a0a9882f-8b9f-4666-a9fe-0e23efd56616" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.network.neutron [req-92bd40c7-6f67-457b-99c6-8b6cafedf509 req-60a32518-4c2d-4284-9bae-7aca2d09d6d0 service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Refreshing network info cache for port 8ee45305-d703-4e55-ac47-60d1407e2772 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Start _get_guest_xml network_info=[{"id": "8ee45305-d703-4e55-ac47-60d1407e2772", "address": "fa:16:3e:bb:23:47", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee45305-d7", "ovs_interfaceid": "8ee45305-d703-4e55-ac47-60d1407e2772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 04:02:39 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:02:39 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-188722783',display_name='tempest-AttachVolumeNegativeTest-server-188722783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-188722783',id=40,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1TZH0O62HKjn0vS/q0MNFkPN9Q8NN0PnmzpccxUFD1gUV7esyKdOJtjvCw0DkXv7SIQv3bc2gnIztVd02s6M6H07C6yHyfWu2F/1OLcFFHxqvZCTPINes9LYKcwLvNLw==',key_name='tempest-keypair-1751897258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d990b7b4c19436d8cd8f43d8d0facb9',ramdisk_id='',reservation_id='r-92o4kmoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-921155549',owner_user_name='tempest-AttachVolumeNegativeTest-921155549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:02:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afcdb0627e34b6e893b7981ea4615e3',uuid=a0a9882f-8b9f-4666-a9fe-0e23efd56616,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ee45305-d703-4e55-ac47-60d1407e2772", "address": "fa:16:3e:bb:23:47", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee45305-d7", "ovs_interfaceid": "8ee45305-d703-4e55-ac47-60d1407e2772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converting VIF {"id": "8ee45305-d703-4e55-ac47-60d1407e2772", "address": "fa:16:3e:bb:23:47", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee45305-d7", "ovs_interfaceid": "8ee45305-d703-4e55-ac47-60d1407e2772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:23:47,bridge_name='br-int',has_traffic_filtering=True,id=8ee45305-d703-4e55-ac47-60d1407e2772,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee45305-d7') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.objects.instance [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lazy-loading 'pci_devices' on Instance uuid a0a9882f-8b9f-4666-a9fe-0e23efd56616 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] End _get_guest_xml xml=<domain type="kvm">
Nov 09 04:02:39 user nova-compute[75378]:   <uuid>a0a9882f-8b9f-4666-a9fe-0e23efd56616</uuid>
Nov 09 04:02:39 user nova-compute[75378]:   <name>instance-00000028</name>
Nov 09 04:02:39 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 04:02:39 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 04:02:39 user nova-compute[75378]:   <metadata>
Nov 09 04:02:39 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 04:02:39 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 04:02:39 user nova-compute[75378]:       <nova:name>tempest-AttachVolumeNegativeTest-server-188722783</nova:name>
Nov 09 04:02:39 user nova-compute[75378]:       <nova:creationTime>2023-11-09 04:02:39</nova:creationTime>
Nov 09 04:02:39 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 04:02:39 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 04:02:39 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 04:02:39 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 04:02:39 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 04:02:39 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 04:02:39 user nova-compute[75378]:       </nova:flavor>
Nov 09 04:02:39 user nova-compute[75378]:       <nova:owner>
Nov 09 04:02:39 user nova-compute[75378]:         <nova:user uuid="2afcdb0627e34b6e893b7981ea4615e3">tempest-AttachVolumeNegativeTest-921155549-project-member</nova:user>
Nov 09 04:02:39 user nova-compute[75378]:         <nova:project uuid="6d990b7b4c19436d8cd8f43d8d0facb9">tempest-AttachVolumeNegativeTest-921155549</nova:project>
Nov 09 04:02:39 user nova-compute[75378]:       </nova:owner>
Nov 09 04:02:39 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 04:02:39 user nova-compute[75378]:       <nova:ports>
Nov 09 04:02:39 user nova-compute[75378]:         <nova:port uuid="8ee45305-d703-4e55-ac47-60d1407e2772">
Nov 09 04:02:39 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 09 04:02:39 user nova-compute[75378]:         </nova:port>
Nov 09 04:02:39 user nova-compute[75378]:       </nova:ports>
Nov 09 04:02:39 user nova-compute[75378]:     </nova:instance>
Nov 09 04:02:39 user nova-compute[75378]:   </metadata>
Nov 09 04:02:39 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 04:02:39 user nova-compute[75378]:     <system>
Nov 09 04:02:39 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 04:02:39 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 04:02:39 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 04:02:39 user nova-compute[75378]:       <entry name="serial">a0a9882f-8b9f-4666-a9fe-0e23efd56616</entry>
Nov 09 04:02:39 user nova-compute[75378]:       <entry name="uuid">a0a9882f-8b9f-4666-a9fe-0e23efd56616</entry>
Nov 09 04:02:39 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 04:02:39 user nova-compute[75378]:     </system>
Nov 09 04:02:39 user nova-compute[75378]:   </sysinfo>
Nov 09 04:02:39 user nova-compute[75378]:   <os>
Nov 09 04:02:39 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 04:02:39 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 04:02:39 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 04:02:39 user nova-compute[75378]:   </os>
Nov 09 04:02:39 user nova-compute[75378]:   <features>
Nov 09 04:02:39 user nova-compute[75378]:     <acpi/>
Nov 09 04:02:39 user nova-compute[75378]:     <apic/>
Nov 09 04:02:39 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 04:02:39 user nova-compute[75378]:   </features>
Nov 09 04:02:39 user nova-compute[75378]:   <clock offset="utc">
Nov 09 04:02:39 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 04:02:39 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 04:02:39 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 04:02:39 user nova-compute[75378]:   </clock>
Nov 09 04:02:39 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 04:02:39 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 04:02:39 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 04:02:39 user nova-compute[75378]:   </cpu>
Nov 09 04:02:39 user nova-compute[75378]:   <devices>
Nov 09 04:02:39 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 04:02:39 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 04:02:39 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk"/>
Nov 09 04:02:39 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 04:02:39 user nova-compute[75378]:     </disk>
Nov 09 04:02:39 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 04:02:39 user nova-compute[75378]:       <mac address="fa:16:3e:bb:23:47"/>
Nov 09 04:02:39 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:02:39 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 04:02:39 user nova-compute[75378]:       <target dev="tap8ee45305-d7"/>
Nov 09 04:02:39 user nova-compute[75378]:     </interface>
Nov 09 04:02:39 user nova-compute[75378]:     <serial type="pty">
Nov 09 04:02:39 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/console.log" append="off"/>
Nov 09 04:02:39 user nova-compute[75378]:     </serial>
Nov 09 04:02:39 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 04:02:39 user nova-compute[75378]:     <video>
Nov 09 04:02:39 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:02:39 user nova-compute[75378]:     </video>
Nov 09 04:02:39 user nova-compute[75378]:     <rng model="virtio">
Nov 09 04:02:39 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 04:02:39 user nova-compute[75378]:     </rng>
Nov 09 04:02:39 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 04:02:39 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 04:02:39 user nova-compute[75378]:       <stats period="10"/>
Nov 09 04:02:39 user nova-compute[75378]:     </memballoon>
Nov 09 04:02:39 user nova-compute[75378]:   </devices>
Nov 09 04:02:39 user nova-compute[75378]: </domain>
Nov 09 04:02:39 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-188722783',display_name='tempest-AttachVolumeNegativeTest-server-188722783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-188722783',id=40,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1TZH0O62HKjn0vS/q0MNFkPN9Q8NN0PnmzpccxUFD1gUV7esyKdOJtjvCw0DkXv7SIQv3bc2gnIztVd02s6M6H07C6yHyfWu2F/1OLcFFHxqvZCTPINes9LYKcwLvNLw==',key_name='tempest-keypair-1751897258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d990b7b4c19436d8cd8f43d8d0facb9',ramdisk_id='',reservation_id='r-92o4kmoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-921155549',owner_user_name='tempest-AttachVolumeNegativeTest-921155549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:02:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afcdb0627e34b6e893b7981ea4615e3',uuid=a0a9882f-8b9f-4666-a9fe-0e23efd56616,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ee45305-d703-4e55-ac47-60d1407e2772", "address": "fa:16:3e:bb:23:47", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee45305-d7", "ovs_interfaceid": "8ee45305-d703-4e55-ac47-60d1407e2772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converting VIF {"id": "8ee45305-d703-4e55-ac47-60d1407e2772", "address": "fa:16:3e:bb:23:47", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee45305-d7", "ovs_interfaceid": "8ee45305-d703-4e55-ac47-60d1407e2772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:23:47,bridge_name='br-int',has_traffic_filtering=True,id=8ee45305-d703-4e55-ac47-60d1407e2772,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee45305-d7') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG os_vif [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:23:47,bridge_name='br-int',has_traffic_filtering=True,id=8ee45305-d703-4e55-ac47-60d1407e2772,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee45305-d7') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c515a777-d870-5262-a1e5-258018bf2469', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ee45305-d7, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ee45305-d7, col_values=(('qos', UUID('b0102904-d72f-4717-b64e-a97ecd2e3107')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ee45305-d7, col_values=(('external_ids', {'iface-id': '8ee45305-d703-4e55-ac47-60d1407e2772', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:23:47', 'vm-uuid': 'a0a9882f-8b9f-4666-a9fe-0e23efd56616'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:39 user nova-compute[75378]: INFO os_vif [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:23:47,bridge_name='br-int',has_traffic_filtering=True,id=8ee45305-d703-4e55-ac47-60d1407e2772,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee45305-d7')
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] No VIF found with MAC fa:16:3e:bb:23:47, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.network.neutron [req-92bd40c7-6f67-457b-99c6-8b6cafedf509 req-60a32518-4c2d-4284-9bae-7aca2d09d6d0 service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Updated VIF entry in instance network info cache for port 8ee45305-d703-4e55-ac47-60d1407e2772. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG nova.network.neutron [req-92bd40c7-6f67-457b-99c6-8b6cafedf509 req-60a32518-4c2d-4284-9bae-7aca2d09d6d0 service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Updating instance_info_cache with network_info: [{"id": "8ee45305-d703-4e55-ac47-60d1407e2772", "address": "fa:16:3e:bb:23:47", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee45305-d7", "ovs_interfaceid": "8ee45305-d703-4e55-ac47-60d1407e2772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:02:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-92bd40c7-6f67-457b-99c6-8b6cafedf509 req-60a32518-4c2d-4284-9bae-7aca2d09d6d0 service nova] Releasing lock "refresh_cache-a0a9882f-8b9f-4666-a9fe-0e23efd56616" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:02:40 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance eb8117df-cf63-4bc9-9691-4828ff7f5a8e is timed out.
Nov 09 04:02:40 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Successfully detached device vdb from instance eb8117df-cf63-4bc9-9691-4828ff7f5a8e from the live domain config.
Nov 09 04:02:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mKlbrYDZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:02:40 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:02:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8811a1b-89f1-4a5d-a70c-38608ac187be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 04:02:40 user nova-compute[75378]: No targets found.
Nov 09 04:02:40 user nova-compute[75378]: iSNS:
Nov 09 04:02:40 user nova-compute[75378]: No targets found.
Nov 09 04:02:40 user nova-compute[75378]: STATIC:
Nov 09 04:02:40 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 04:02:40 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:02:40 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:02:40 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2
Nov 09 04:02:40 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:02:40 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:02:40 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d
Nov 09 04:02:40 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:02:40 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:02:40 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723
Nov 09 04:02:40 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:02:40 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:02:40 user nova-compute[75378]: FIRMWARE:
Nov 09 04:02:40 user nova-compute[75378]: No targets found.
Nov 09 04:02:40 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 04:02:40 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 04:02:40 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d7f19a-46dc-42d6-9ec7-9366eb68fadd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bd1c69-59f9-4605-b2cc-99b10d47e75a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:02:40 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:02:40 user nova-compute[75378]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:02:40 user nova-compute[75378]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d (non-flash)
Nov 09 04:02:40 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:02:40 user nova-compute[75378]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 (non-flash)
Nov 09 04:02:40 user nova-compute[75378]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:02:40 user nova-compute[75378]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d (non-flash)
Nov 09 04:02:40 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3b04760e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2'): ({'sdf'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Removing single pathed devices sdf {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f72cb6-0232-4a37-b333-e6e921ed4e06]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8345d84-ec61-4a45-8537-4993a68757a3]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Flushing IO for device /dev/sdf {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4e15c7-cd7f-48da-b512-cac943870507]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[394c55ce-05e1-438c-9ccc-bb28fd16105a]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] SCSI volumes sdf have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d761401a-147d-497f-8e05-e432f213918d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02cb6dc-ec7f-459d-9de6-537d08b21baa]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2, portal: 172.16.0.220,3260]
Nov 09 04:02:41 user nova-compute[75378]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2, portal: 172.16.0.220,3260] successful.
Nov 09 04:02:41 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG nova.compute.manager [req-342e5f96-2853-4d77-a669-f2a33e16c035 req-efcf0e02-f5b0-4641-a3f3-b8c566cb69c5 service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Received event network-vif-plugged-8ee45305-d703-4e55-ac47-60d1407e2772 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-342e5f96-2853-4d77-a669-f2a33e16c035 req-efcf0e02-f5b0-4641-a3f3-b8c566cb69c5 service nova] Acquiring lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-342e5f96-2853-4d77-a669-f2a33e16c035 req-efcf0e02-f5b0-4641-a3f3-b8c566cb69c5 service nova] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-342e5f96-2853-4d77-a669-f2a33e16c035 req-efcf0e02-f5b0-4641-a3f3-b8c566cb69c5 service nova] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG nova.compute.manager [req-342e5f96-2853-4d77-a669-f2a33e16c035 req-efcf0e02-f5b0-4641-a3f3-b8c566cb69c5 service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] No waiting events found dispatching network-vif-plugged-8ee45305-d703-4e55-ac47-60d1407e2772 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:02:41 user nova-compute[75378]: WARNING nova.compute.manager [req-342e5f96-2853-4d77-a669-f2a33e16c035 req-efcf0e02-f5b0-4641-a3f3-b8c566cb69c5 service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Received unexpected event network-vif-plugged-8ee45305-d703-4e55-ac47-60d1407e2772 for instance with vm_state building and task_state spawning.
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d394411-cc83-4308-ac96-0af3f47f7da2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ccd4d6-a0b3-4ece-b903-786e7a37534e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] <== disconnect_volume: return (378ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Didn't find any instances for network info cache update. {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:42 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:02:42 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:02:42 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:02:43 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 04:02:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 04:02:43 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Instance spawned successfully.
Nov 09 04:02:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 04:02:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:02:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:02:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:02:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:02:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:02:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:02:43 user nova-compute[75378]: INFO nova.compute.manager [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 09 04:02:43 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:02:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-b861cbe9-c6bb-4ea7-ae2e-3bd4240387b3 req-73d9dcca-d1db-451e-aa5f-e8e3276d9200 service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Received event network-vif-plugged-8ee45305-d703-4e55-ac47-60d1407e2772 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:02:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b861cbe9-c6bb-4ea7-ae2e-3bd4240387b3 req-73d9dcca-d1db-451e-aa5f-e8e3276d9200 service nova] Acquiring lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b861cbe9-c6bb-4ea7-ae2e-3bd4240387b3 req-73d9dcca-d1db-451e-aa5f-e8e3276d9200 service nova] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b861cbe9-c6bb-4ea7-ae2e-3bd4240387b3 req-73d9dcca-d1db-451e-aa5f-e8e3276d9200 service nova] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-b861cbe9-c6bb-4ea7-ae2e-3bd4240387b3 req-73d9dcca-d1db-451e-aa5f-e8e3276d9200 service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] No waiting events found dispatching network-vif-plugged-8ee45305-d703-4e55-ac47-60d1407e2772 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:02:43 user nova-compute[75378]: WARNING nova.compute.manager [req-b861cbe9-c6bb-4ea7-ae2e-3bd4240387b3 req-73d9dcca-d1db-451e-aa5f-e8e3276d9200 service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Received unexpected event network-vif-plugged-8ee45305-d703-4e55-ac47-60d1407e2772 for instance with vm_state building and task_state spawning.
Nov 09 04:02:43 user nova-compute[75378]: INFO nova.compute.manager [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Took 5.90 seconds to build instance.
Nov 09 04:02:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d1344769-01c1-4d74-b16f-89b0dc550c17 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.986s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:44 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:02:44 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:02:44 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:02:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:45 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:02:45 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Cleaning up deleted instances {{(pid=75378) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 04:02:45 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] There are 0 instances to clean {{(pid=75378) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 04:02:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:48 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:02:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:48 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:02:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:02:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:02:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:49 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:02:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:50 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:02:50 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:02:50 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=7933MB free_disk=25.14954376220703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:02:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 7d051405-6b57-4db2-9533-c2f4e87134d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:02:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2c2acb48-972a-41d7-987e-48e79b3bef93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:02:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 013db901-fbee-4593-a14f-95a03e79fad0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:02:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance eb8117df-cf63-4bc9-9691-4828ff7f5a8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:02:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 19359be7-5789-4d89-bc5a-c6c5ccd52211 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:02:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9dcaeb12-99bc-48f0-aec9-3de2a3770e01 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:02:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 00959e75-7446-4ff6-be3e-56d7146b3576 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:02:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance a0a9882f-8b9f-4666-a9fe-0e23efd56616 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:02:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:02:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:02:51 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing inventories for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 04:02:51 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Updating ProviderTree inventory for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 04:02:51 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Updating inventory in ProviderTree for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 04:02:51 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing aggregate associations for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8, aggregates: None {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 04:02:51 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing trait associations for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8, traits: HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 04:02:51 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:02:51 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:02:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:02:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.746s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:52 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:02:52 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:02:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "013db901-fbee-4593-a14f-95a03e79fad0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "013db901-fbee-4593-a14f-95a03e79fad0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "013db901-fbee-4593-a14f-95a03e79fad0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:52 user nova-compute[75378]: INFO nova.compute.manager [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Terminating instance
Nov 09 04:02:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-6ee8da56-1f38-49a0-b86a-43a6c6519fa3 req-c5abdef8-8f89-43ed-992a-94a91c63fbc5 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received event network-vif-unplugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6ee8da56-1f38-49a0-b86a-43a6c6519fa3 req-c5abdef8-8f89-43ed-992a-94a91c63fbc5 service nova] Acquiring lock "013db901-fbee-4593-a14f-95a03e79fad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6ee8da56-1f38-49a0-b86a-43a6c6519fa3 req-c5abdef8-8f89-43ed-992a-94a91c63fbc5 service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6ee8da56-1f38-49a0-b86a-43a6c6519fa3 req-c5abdef8-8f89-43ed-992a-94a91c63fbc5 service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-6ee8da56-1f38-49a0-b86a-43a6c6519fa3 req-c5abdef8-8f89-43ed-992a-94a91c63fbc5 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] No waiting events found dispatching network-vif-unplugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-6ee8da56-1f38-49a0-b86a-43a6c6519fa3 req-c5abdef8-8f89-43ed-992a-94a91c63fbc5 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received event network-vif-unplugged-5650a4a6-f99d-42e2-8b94-f18562892154 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:53 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Instance destroyed successfully.
Nov 09 04:02:53 user nova-compute[75378]: DEBUG nova.objects.instance [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'resources' on Instance uuid 013db901-fbee-4593-a14f-95a03e79fad0 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-51079469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-51079469',id=22,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:48:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c2176531ffa4cf7bec818309e39ab8d',ramdisk_id='',reservation_id='r-v7do5wzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:50:01Z,user_data=None,user_id='57efcfeacd7f4daf916e7dd04e11d8f2',uuid=013db901-fbee-4593-a14f-95a03e79fad0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5650a4a6-f99d-42e2-8b94-f18562892154", "address": "fa:16:3e:7f:95:df", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5650a4a6-f9", "ovs_interfaceid": "5650a4a6-f99d-42e2-8b94-f18562892154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converting VIF {"id": "5650a4a6-f99d-42e2-8b94-f18562892154", "address": "fa:16:3e:7f:95:df", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5650a4a6-f9", "ovs_interfaceid": "5650a4a6-f99d-42e2-8b94-f18562892154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:95:df,bridge_name='br-int',has_traffic_filtering=True,id=5650a4a6-f99d-42e2-8b94-f18562892154,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5650a4a6-f9') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG os_vif [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:95:df,bridge_name='br-int',has_traffic_filtering=True,id=5650a4a6-f99d-42e2-8b94-f18562892154,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5650a4a6-f9') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5650a4a6-f9, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=becda733-2466-453c-b14e-f3095ce8394c) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:02:53 user nova-compute[75378]: INFO os_vif [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:95:df,bridge_name='br-int',has_traffic_filtering=True,id=5650a4a6-f99d-42e2-8b94-f18562892154,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5650a4a6-f9')
Nov 09 04:02:53 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aSeGHxRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:02:53 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:02:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f802d0-c3ba-4574-a571-e2a164e98c97]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 04:02:53 user nova-compute[75378]: No targets found.
Nov 09 04:02:53 user nova-compute[75378]: iSNS:
Nov 09 04:02:53 user nova-compute[75378]: No targets found.
Nov 09 04:02:53 user nova-compute[75378]: STATIC:
Nov 09 04:02:53 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc
Nov 09 04:02:53 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:02:53 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:02:53 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d
Nov 09 04:02:53 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:02:53 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:02:53 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723
Nov 09 04:02:53 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:02:53 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:02:53 user nova-compute[75378]: FIRMWARE:
Nov 09 04:02:53 user nova-compute[75378]: No targets found.
Nov 09 04:02:53 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 04:02:53 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 04:02:53 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea6a504-fd7e-46ed-84b1-3e3fcfbaee6b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c086113-2673-4da7-85f4-eca7d1855f25]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:02:53 user nova-compute[75378]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:02:53 user nova-compute[75378]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d (non-flash)
Nov 09 04:02:53 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc (non-flash)
Nov 09 04:02:53 user nova-compute[75378]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:02:53 user nova-compute[75378]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d (non-flash)
Nov 09 04:02:53 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3b0461480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc'): ({'sdc'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Removing single pathed devices sdc {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2f1be6-397a-4913-b40c-b35a41619c7d]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5617d419-99fc-48bf-8d85-99ff3bf17afe]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Flushing IO for device /dev/sdc {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d25ee9-8723-4503-8def-427c68ee0478]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db263bf-bc41-456f-9f09-b231467beff1]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] SCSI volumes sdc have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 04:02:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[652b6e39-1968-41f9-a948-4598ceea50de]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:02:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[950752dc-d54d-4f82-98ea-d933bd242337]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc, portal: 172.16.0.220,3260]
Nov 09 04:02:54 user nova-compute[75378]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc, portal: 172.16.0.220,3260] successful.
Nov 09 04:02:54 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:02:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:02:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35d5d634-9dbe-4a80-b298-47934fd627dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:02:54 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6579be8d-e1a0-4d98-9650-fac5fd913871]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:02:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:02:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:02:54 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] <== disconnect_volume: return (339ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:02:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 04:02:54 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Deleting instance files /opt/stack/data/nova/instances/013db901-fbee-4593-a14f-95a03e79fad0_del
Nov 09 04:02:54 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Deletion of /opt/stack/data/nova/instances/013db901-fbee-4593-a14f-95a03e79fad0_del complete
Nov 09 04:02:54 user nova-compute[75378]: INFO nova.compute.manager [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 09 04:02:54 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:02:54 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:02:54 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:02:54 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:02:54 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Took 0.44 seconds to deallocate network for instance.
Nov 09 04:02:54 user nova-compute[75378]: DEBUG nova.compute.manager [req-4ac1819a-efb7-4323-b666-8041cb8e586b req-1254266e-3f58-44a1-adf1-613bc89d2697 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received event network-vif-deleted-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:02:54 user nova-compute[75378]: INFO nova.compute.manager [req-4ac1819a-efb7-4323-b666-8041cb8e586b req-1254266e-3f58-44a1-adf1-613bc89d2697 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Neutron deleted interface 5650a4a6-f99d-42e2-8b94-f18562892154; detaching it from the instance and deleting it from the info cache
Nov 09 04:02:54 user nova-compute[75378]: DEBUG nova.network.neutron [req-4ac1819a-efb7-4323-b666-8041cb8e586b req-1254266e-3f58-44a1-adf1-613bc89d2697 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:02:54 user nova-compute[75378]: DEBUG nova.compute.manager [req-4ac1819a-efb7-4323-b666-8041cb8e586b req-1254266e-3f58-44a1-adf1-613bc89d2697 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Detach interface failed, port_id=5650a4a6-f99d-42e2-8b94-f18562892154, reason: Instance 013db901-fbee-4593-a14f-95a03e79fad0 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 04:02:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-c9a04a03-e0f2-452b-beb1-d76d7c2aa328 req-f5081c01-3f74-46b2-9630-41fb15381185 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received event network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:02:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c9a04a03-e0f2-452b-beb1-d76d7c2aa328 req-f5081c01-3f74-46b2-9630-41fb15381185 service nova] Acquiring lock "013db901-fbee-4593-a14f-95a03e79fad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c9a04a03-e0f2-452b-beb1-d76d7c2aa328 req-f5081c01-3f74-46b2-9630-41fb15381185 service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c9a04a03-e0f2-452b-beb1-d76d7c2aa328 req-f5081c01-3f74-46b2-9630-41fb15381185 service nova] Lock "013db901-fbee-4593-a14f-95a03e79fad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-c9a04a03-e0f2-452b-beb1-d76d7c2aa328 req-f5081c01-3f74-46b2-9630-41fb15381185 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] No waiting events found dispatching network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:02:55 user nova-compute[75378]: WARNING nova.compute.manager [req-c9a04a03-e0f2-452b-beb1-d76d7c2aa328 req-f5081c01-3f74-46b2-9630-41fb15381185 service nova] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Received unexpected event network-vif-plugged-5650a4a6-f99d-42e2-8b94-f18562892154 for instance with vm_state active and task_state deleting.
Nov 09 04:02:55 user nova-compute[75378]: INFO nova.compute.manager [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 013db901-fbee-4593-a14f-95a03e79fad0] Took 1.00 seconds to detach 1 volumes for instance.
Nov 09 04:02:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:55 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:02:55 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:02:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:56 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Deleted allocations for instance 013db901-fbee-4593-a14f-95a03e79fad0
Nov 09 04:02:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4f66413d-e27e-4a04-9f6f-25769cd7eac3 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "013db901-fbee-4593-a14f-95a03e79fad0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.380s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 7d051405-6b57-4db2-9533-c2f4e87134d8 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 2c2acb48-972a-41d7-987e-48e79b3bef93 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid eb8117df-cf63-4bc9-9691-4828ff7f5a8e {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 9dcaeb12-99bc-48f0-aec9-3de2a3770e01 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 19359be7-5789-4d89-bc5a-c6c5ccd52211 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 00959e75-7446-4ff6-be3e-56d7146b3576 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid a0a9882f-8b9f-4666-a9fe-0e23efd56616 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "7d051405-6b57-4db2-9533-c2f4e87134d8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "7d051405-6b57-4db2-9533-c2f4e87134d8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "2c2acb48-972a-41d7-987e-48e79b3bef93" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "2c2acb48-972a-41d7-987e-48e79b3bef93" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "19359be7-5789-4d89-bc5a-c6c5ccd52211" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "19359be7-5789-4d89-bc5a-c6c5ccd52211" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "00959e75-7446-4ff6-be3e-56d7146b3576" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "00959e75-7446-4ff6-be3e-56d7146b3576" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG nova.objects.instance [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lazy-loading 'flavor' on Instance uuid eb8117df-cf63-4bc9-9691-4828ff7f5a8e {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "7d051405-6b57-4db2-9533-c2f4e87134d8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "19359be7-5789-4d89-bc5a-c6c5ccd52211" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "2c2acb48-972a-41d7-987e-48e79b3bef93" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f234a3a2-7092-4b92-a28c-a195efa1e6ab tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 39.156s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.065s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "00959e75-7446-4ff6-be3e-56d7146b3576" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:02:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:01 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:03:01 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75378) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 04:03:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:04 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:03:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquiring lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquiring lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:10 user nova-compute[75378]: INFO nova.compute.manager [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Terminating instance
Nov 09 04:03:10 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:03:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG nova.compute.manager [req-ab77ce97-8b44-4e95-8130-0fdf0d106758 req-8db06332-7652-4d88-aa65-892d8667e027 service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Received event network-vif-unplugged-fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ab77ce97-8b44-4e95-8130-0fdf0d106758 req-8db06332-7652-4d88-aa65-892d8667e027 service nova] Acquiring lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ab77ce97-8b44-4e95-8130-0fdf0d106758 req-8db06332-7652-4d88-aa65-892d8667e027 service nova] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ab77ce97-8b44-4e95-8130-0fdf0d106758 req-8db06332-7652-4d88-aa65-892d8667e027 service nova] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG nova.compute.manager [req-ab77ce97-8b44-4e95-8130-0fdf0d106758 req-8db06332-7652-4d88-aa65-892d8667e027 service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] No waiting events found dispatching network-vif-unplugged-fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG nova.compute.manager [req-ab77ce97-8b44-4e95-8130-0fdf0d106758 req-8db06332-7652-4d88-aa65-892d8667e027 service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Received event network-vif-unplugged-fb8b1969-9e49-47a4-a528-43c6673bd63d for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:11 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Instance destroyed successfully.
Nov 09 04:03:11 user nova-compute[75378]: DEBUG nova.objects.instance [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lazy-loading 'resources' on Instance uuid eb8117df-cf63-4bc9-9691-4828ff7f5a8e {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:57:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-492873150',display_name='tempest-TestServerVolumeAttachmentScenario-server-492873150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-492873150',id=35,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8v4TOeuCX3JxKCmIDwWB7PrtGuDTnKc7Ba5YKPUKZb6kmeJMQSkseFsZy8ewmy3BelALwGirxlOK5xvpXphkaxfHiTI/GjoACZFJAKPKNouONzKDoWshQrNyiKsgj/Pg==',key_name='tempest-keypair-603782745',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:58:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52d99bb19e6343af92da922122e2a440',ramdisk_id='',reservation_id='r-ppmf0hbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-352447538',owner_user_name='tempest-TestServerVolumeAttachmentScenario-352447538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9656d7c2a654cfbb156aebf1c69fc3a',uuid=eb8117df-cf63-4bc9-9691-4828ff7f5a8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "address": "fa:16:3e:5b:d9:0b", "network": {"id": "45fb3f32-bd04-41a3-bbf0-0d85276e8495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1831642379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52d99bb19e6343af92da922122e2a440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8b1969-9e", "ovs_interfaceid": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Converting VIF {"id": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "address": "fa:16:3e:5b:d9:0b", "network": {"id": "45fb3f32-bd04-41a3-bbf0-0d85276e8495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1831642379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52d99bb19e6343af92da922122e2a440", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb8b1969-9e", "ovs_interfaceid": "fb8b1969-9e49-47a4-a528-43c6673bd63d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:d9:0b,bridge_name='br-int',has_traffic_filtering=True,id=fb8b1969-9e49-47a4-a528-43c6673bd63d,network=Network(45fb3f32-bd04-41a3-bbf0-0d85276e8495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8b1969-9e') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG os_vif [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:d9:0b,bridge_name='br-int',has_traffic_filtering=True,id=fb8b1969-9e49-47a4-a528-43c6673bd63d,network=Network(45fb3f32-bd04-41a3-bbf0-0d85276e8495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8b1969-9e') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb8b1969-9e, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1238b4af-f95d-4d65-8d02-6d6ff4c1753e) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:03:11 user nova-compute[75378]: INFO os_vif [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:d9:0b,bridge_name='br-int',has_traffic_filtering=True,id=fb8b1969-9e49-47a4-a528-43c6673bd63d,network=Network(45fb3f32-bd04-41a3-bbf0-0d85276e8495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb8b1969-9e')
Nov 09 04:03:11 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Deleting instance files /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e_del
Nov 09 04:03:11 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Deletion of /opt/stack/data/nova/instances/eb8117df-cf63-4bc9-9691-4828ff7f5a8e_del complete
Nov 09 04:03:11 user nova-compute[75378]: INFO nova.compute.manager [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 09 04:03:11 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:03:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:12 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:03:12 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Took 1.16 seconds to deallocate network for instance.
Nov 09 04:03:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:13 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Deleted allocations for instance eb8117df-cf63-4bc9-9691-4828ff7f5a8e
Nov 09 04:03:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9b159bbd-5066-48e8-b4d1-bf5f58281e4a tempest-TestServerVolumeAttachmentScenario-352447538 tempest-TestServerVolumeAttachmentScenario-352447538-project-member] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.609s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG nova.compute.manager [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Received event network-vif-plugged-fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] Acquiring lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG nova.compute.manager [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] No waiting events found dispatching network-vif-plugged-fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:03:13 user nova-compute[75378]: WARNING nova.compute.manager [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Received unexpected event network-vif-plugged-fb8b1969-9e49-47a4-a528-43c6673bd63d for instance with vm_state deleted and task_state None.
Nov 09 04:03:13 user nova-compute[75378]: DEBUG nova.compute.manager [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Received event network-vif-plugged-fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] Acquiring lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG nova.compute.manager [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] No waiting events found dispatching network-vif-plugged-fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:03:13 user nova-compute[75378]: WARNING nova.compute.manager [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Received unexpected event network-vif-plugged-fb8b1969-9e49-47a4-a528-43c6673bd63d for instance with vm_state deleted and task_state None.
Nov 09 04:03:13 user nova-compute[75378]: DEBUG nova.compute.manager [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Received event network-vif-plugged-fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] Acquiring lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG nova.compute.manager [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] No waiting events found dispatching network-vif-plugged-fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:03:13 user nova-compute[75378]: WARNING nova.compute.manager [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Received unexpected event network-vif-plugged-fb8b1969-9e49-47a4-a528-43c6673bd63d for instance with vm_state deleted and task_state None.
Nov 09 04:03:13 user nova-compute[75378]: DEBUG nova.compute.manager [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Received event network-vif-unplugged-fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] Acquiring lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG nova.compute.manager [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] No waiting events found dispatching network-vif-unplugged-fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:03:13 user nova-compute[75378]: WARNING nova.compute.manager [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Received unexpected event network-vif-unplugged-fb8b1969-9e49-47a4-a528-43c6673bd63d for instance with vm_state deleted and task_state None.
Nov 09 04:03:13 user nova-compute[75378]: DEBUG nova.compute.manager [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Received event network-vif-deleted-fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG nova.compute.manager [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Received event network-vif-plugged-fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] Acquiring lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] Lock "eb8117df-cf63-4bc9-9691-4828ff7f5a8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:13 user nova-compute[75378]: DEBUG nova.compute.manager [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] No waiting events found dispatching network-vif-plugged-fb8b1969-9e49-47a4-a528-43c6673bd63d {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:03:13 user nova-compute[75378]: WARNING nova.compute.manager [req-17bd7f21-6896-48ae-b88b-34e3fa7bb44b req-6c4815fe-5e16-4631-b0d3-52746ff539fd service nova] [instance: eb8117df-cf63-4bc9-9691-4828ff7f5a8e] Received unexpected event network-vif-plugged-fb8b1969-9e49-47a4-a528-43c6673bd63d for instance with vm_state deleted and task_state None.
Nov 09 04:03:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-11f439b4-074e-4e10-9945-f18fcf94bfde req-0576a0ea-4f59-4e0b-97b2-c4017b88d501 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received event network-changed-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:03:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-11f439b4-074e-4e10-9945-f18fcf94bfde req-0576a0ea-4f59-4e0b-97b2-c4017b88d501 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Refreshing instance network info cache due to event network-changed-bd706a0c-ba99-42b7-bf21-898a277c3541. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:03:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-11f439b4-074e-4e10-9945-f18fcf94bfde req-0576a0ea-4f59-4e0b-97b2-c4017b88d501 service nova] Acquiring lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:03:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-11f439b4-074e-4e10-9945-f18fcf94bfde req-0576a0ea-4f59-4e0b-97b2-c4017b88d501 service nova] Acquired lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:03:14 user nova-compute[75378]: DEBUG nova.network.neutron [req-11f439b4-074e-4e10-9945-f18fcf94bfde req-0576a0ea-4f59-4e0b-97b2-c4017b88d501 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Refreshing network info cache for port bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:03:15 user nova-compute[75378]: DEBUG nova.network.neutron [req-11f439b4-074e-4e10-9945-f18fcf94bfde req-0576a0ea-4f59-4e0b-97b2-c4017b88d501 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Updated VIF entry in instance network info cache for port bd706a0c-ba99-42b7-bf21-898a277c3541. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:03:15 user nova-compute[75378]: DEBUG nova.network.neutron [req-11f439b4-074e-4e10-9945-f18fcf94bfde req-0576a0ea-4f59-4e0b-97b2-c4017b88d501 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Updating instance_info_cache with network_info: [{"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:03:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-11f439b4-074e-4e10-9945-f18fcf94bfde req-0576a0ea-4f59-4e0b-97b2-c4017b88d501 service nova] Releasing lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:03:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquiring lock "00959e75-7446-4ff6-be3e-56d7146b3576" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "00959e75-7446-4ff6-be3e-56d7146b3576" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:15 user nova-compute[75378]: INFO nova.compute.manager [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Shelve offloading
Nov 09 04:03:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:15 user nova-compute[75378]: DEBUG nova.compute.manager [req-f153f37d-2608-411b-b0d1-0bc2cb16b3e4 req-2630945b-1ae6-4767-bb68-0475181316e4 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received event network-vif-unplugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:03:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f153f37d-2608-411b-b0d1-0bc2cb16b3e4 req-2630945b-1ae6-4767-bb68-0475181316e4 service nova] Acquiring lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f153f37d-2608-411b-b0d1-0bc2cb16b3e4 req-2630945b-1ae6-4767-bb68-0475181316e4 service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f153f37d-2608-411b-b0d1-0bc2cb16b3e4 req-2630945b-1ae6-4767-bb68-0475181316e4 service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:15 user nova-compute[75378]: DEBUG nova.compute.manager [req-f153f37d-2608-411b-b0d1-0bc2cb16b3e4 req-2630945b-1ae6-4767-bb68-0475181316e4 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] No waiting events found dispatching network-vif-unplugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:03:15 user nova-compute[75378]: WARNING nova.compute.manager [req-f153f37d-2608-411b-b0d1-0bc2cb16b3e4 req-2630945b-1ae6-4767-bb68-0475181316e4 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received unexpected event network-vif-unplugged-bd706a0c-ba99-42b7-bf21-898a277c3541 for instance with vm_state active and task_state shelving.
Nov 09 04:03:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:16 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Instance destroyed successfully.
Nov 09 04:03:16 user nova-compute[75378]: DEBUG nova.compute.manager [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:03:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquiring lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:03:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquired lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:03:16 user nova-compute[75378]: DEBUG nova.network.neutron [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:03:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:16 user nova-compute[75378]: DEBUG nova.network.neutron [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Updating instance_info_cache with network_info: [{"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:03:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Releasing lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:03:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:17 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Instance destroyed successfully.
Nov 09 04:03:17 user nova-compute[75378]: DEBUG nova.objects.instance [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lazy-loading 'resources' on Instance uuid 00959e75-7446-4ff6-be3e-56d7146b3576 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:01:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1994468493',display_name='tempest-TestShelveInstance-server-1994468493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1994468493',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCm0omUjoHyl4PvBkF16sxOWjYLeE1jTtpfJdDjNGvyhYeGuWjjLfukGm/WTTPWNWVyCXy66zTOjquQm5tfvYMzeICuPOlLbQx91KPbah5m5G55l9OSLgMebWgd7GFg0Hw==',key_name='tempest-TestShelveInstance-1433736735',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:02:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='473b18add01440c082dbe9f1503b075d',ramdisk_id='',reservation_id='r-0nv92eqt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-32995184',owner_user_name='tempest-TestShelveInstance-32995184-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T04:02:07Z,user_data=None,user_id='931191283d604e2a91bd3e4daceedebf',uuid=00959e75-7446-4ff6-be3e-56d7146b3576,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Converting VIF {"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:4d:6f,bridge_name='br-int',has_traffic_filtering=True,id=bd706a0c-ba99-42b7-bf21-898a277c3541,network=Network(e2b2cd72-bdd1-484a-ace3-25029da9ac29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd706a0c-ba') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG os_vif [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4d:6f,bridge_name='br-int',has_traffic_filtering=True,id=bd706a0c-ba99-42b7-bf21-898a277c3541,network=Network(e2b2cd72-bdd1-484a-ace3-25029da9ac29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd706a0c-ba') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-611917d9-2d75-4126-ba56-152d239438ab req-a66a9eed-9374-4818-91e1-f93f8ac98149 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received event network-changed-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-611917d9-2d75-4126-ba56-152d239438ab req-a66a9eed-9374-4818-91e1-f93f8ac98149 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Refreshing instance network info cache due to event network-changed-bd706a0c-ba99-42b7-bf21-898a277c3541. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-611917d9-2d75-4126-ba56-152d239438ab req-a66a9eed-9374-4818-91e1-f93f8ac98149 service nova] Acquiring lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-611917d9-2d75-4126-ba56-152d239438ab req-a66a9eed-9374-4818-91e1-f93f8ac98149 service nova] Acquired lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG nova.network.neutron [req-611917d9-2d75-4126-ba56-152d239438ab req-a66a9eed-9374-4818-91e1-f93f8ac98149 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Refreshing network info cache for port bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd706a0c-ba, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78284226-5a49-4497-a3f5-2599958027eb) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:17 user nova-compute[75378]: INFO os_vif [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4d:6f,bridge_name='br-int',has_traffic_filtering=True,id=bd706a0c-ba99-42b7-bf21-898a277c3541,network=Network(e2b2cd72-bdd1-484a-ace3-25029da9ac29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd706a0c-ba')
Nov 09 04:03:17 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abmGJcwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:03:17 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:03:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa25dff3-60cd-4817-b76c-2d3ad0ab026f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 04:03:17 user nova-compute[75378]: No targets found.
Nov 09 04:03:17 user nova-compute[75378]: iSNS:
Nov 09 04:03:17 user nova-compute[75378]: No targets found.
Nov 09 04:03:17 user nova-compute[75378]: STATIC:
Nov 09 04:03:17 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d
Nov 09 04:03:17 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:03:17 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:03:17 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723
Nov 09 04:03:17 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:03:17 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:03:17 user nova-compute[75378]: FIRMWARE:
Nov 09 04:03:17 user nova-compute[75378]: No targets found.
Nov 09 04:03:17 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 04:03:17 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 04:03:17 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a7cdf3-9c72-4e40-a7b2-aee7236e8064]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fec84e-63d4-4554-b434-40211ab37fa4]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:03:17 user nova-compute[75378]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d (non-flash)
Nov 09 04:03:17 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:03:17 user nova-compute[75378]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d (non-flash)
Nov 09 04:03:17 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c628700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d'): ({'sdd'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Removing single pathed devices sdd {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fa3999-4e4e-4fa8-ad64-714635cd5ee3]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43cde4b-748f-4365-a280-eeefed66fcb1]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Flushing IO for device /dev/sdd {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5a7b35-1d29-4ad6-8ad4-8c4abc2cd8be]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee25234-3807-4b25-b361-c0b0068d34a4]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] SCSI volumes sdd have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[170d5fc8-32f7-44dd-95ae-a14c84ab4345]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[db83904d-f2ed-4b41-9833-691cbd63ed20]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d, portal: 172.16.0.220,3260]
Nov 09 04:03:17 user nova-compute[75378]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d, portal: 172.16.0.220,3260] successful.
Nov 09 04:03:17 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[74259680-feb5-4c7e-94c5-1ccf12ddf322]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] <== disconnect_volume: return (334ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 04:03:17 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Deleting instance files /opt/stack/data/nova/instances/00959e75-7446-4ff6-be3e-56d7146b3576_del
Nov 09 04:03:17 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Deletion of /opt/stack/data/nova/instances/00959e75-7446-4ff6-be3e-56d7146b3576_del complete
Nov 09 04:03:17 user nova-compute[75378]: DEBUG nova.network.neutron [req-611917d9-2d75-4126-ba56-152d239438ab req-a66a9eed-9374-4818-91e1-f93f8ac98149 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Updated VIF entry in instance network info cache for port bd706a0c-ba99-42b7-bf21-898a277c3541. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG nova.network.neutron [req-611917d9-2d75-4126-ba56-152d239438ab req-a66a9eed-9374-4818-91e1-f93f8ac98149 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Updating instance_info_cache with network_info: [{"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": null, "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-611917d9-2d75-4126-ba56-152d239438ab req-a66a9eed-9374-4818-91e1-f93f8ac98149 service nova] Releasing lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received event network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] Acquiring lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] No waiting events found dispatching network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:03:17 user nova-compute[75378]: WARNING nova.compute.manager [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received unexpected event network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 for instance with vm_state active and task_state shelving.
Nov 09 04:03:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received event network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] Acquiring lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] No waiting events found dispatching network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:03:17 user nova-compute[75378]: WARNING nova.compute.manager [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received unexpected event network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 for instance with vm_state active and task_state shelving.
Nov 09 04:03:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received event network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] Acquiring lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] No waiting events found dispatching network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:03:17 user nova-compute[75378]: WARNING nova.compute.manager [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received unexpected event network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 for instance with vm_state active and task_state shelving.
Nov 09 04:03:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received event network-vif-unplugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] Acquiring lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] No waiting events found dispatching network-vif-unplugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:03:17 user nova-compute[75378]: WARNING nova.compute.manager [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received unexpected event network-vif-unplugged-bd706a0c-ba99-42b7-bf21-898a277c3541 for instance with vm_state active and task_state shelving.
Nov 09 04:03:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received event network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] Acquiring lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] No waiting events found dispatching network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:03:17 user nova-compute[75378]: WARNING nova.compute.manager [req-ee79da5f-5704-41a3-b478-1d5a456ca78b req-8ca8a607-bb6a-45be-af77-d3e32c5853cb service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received unexpected event network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 for instance with vm_state active and task_state shelving.
Nov 09 04:03:19 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Deleted allocations for instance 00959e75-7446-4ff6-be3e-56d7146b3576
Nov 09 04:03:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:19 user nova-compute[75378]: DEBUG nova.objects.instance [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lazy-loading 'numa_topology' on Instance uuid 00959e75-7446-4ff6-be3e-56d7146b3576 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:03:19 user nova-compute[75378]: DEBUG nova.objects.base [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Object Instance<00959e75-7446-4ff6-be3e-56d7146b3576> lazy-loaded attributes: resources,numa_topology {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 04:03:19 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:03:19 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:03:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-81306a09-8418-4b79-bf9f-26ac473303a4 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "00959e75-7446-4ff6-be3e-56d7146b3576" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.108s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:03:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:03:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Rebuilding the list of instances to heal {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-7d051405-6b57-4db2-9533-c2f4e87134d8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-7d051405-6b57-4db2-9533-c2f4e87134d8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lazy-loading 'info_cache' on Instance uuid 7d051405-6b57-4db2-9533-c2f4e87134d8 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Updating instance_info_cache with network_info: [{"id": "90598abb-8896-4b67-9871-b78f46b1fdfe", "address": "fa:16:3e:ed:1b:d3", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90598abb-88", "ovs_interfaceid": "90598abb-8896-4b67-9871-b78f46b1fdfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "7d051405-6b57-4db2-9533-c2f4e87134d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "7d051405-6b57-4db2-9533-c2f4e87134d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "7d051405-6b57-4db2-9533-c2f4e87134d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "7d051405-6b57-4db2-9533-c2f4e87134d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "7d051405-6b57-4db2-9533-c2f4e87134d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-7d051405-6b57-4db2-9533-c2f4e87134d8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 04:03:43 user nova-compute[75378]: INFO nova.compute.manager [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Terminating instance
Nov 09 04:03:43 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG nova.compute.manager [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-06141c70-303c-49c2-8a76-91c581a765b5 req-e7167d4a-8a46-4311-96e8-82a0796850eb service nova] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Received event network-vif-unplugged-90598abb-8896-4b67-9871-b78f46b1fdfe {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-06141c70-303c-49c2-8a76-91c581a765b5 req-e7167d4a-8a46-4311-96e8-82a0796850eb service nova] Acquiring lock "7d051405-6b57-4db2-9533-c2f4e87134d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-06141c70-303c-49c2-8a76-91c581a765b5 req-e7167d4a-8a46-4311-96e8-82a0796850eb service nova] Lock "7d051405-6b57-4db2-9533-c2f4e87134d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-06141c70-303c-49c2-8a76-91c581a765b5 req-e7167d4a-8a46-4311-96e8-82a0796850eb service nova] Lock "7d051405-6b57-4db2-9533-c2f4e87134d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-06141c70-303c-49c2-8a76-91c581a765b5 req-e7167d4a-8a46-4311-96e8-82a0796850eb service nova] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] No waiting events found dispatching network-vif-unplugged-90598abb-8896-4b67-9871-b78f46b1fdfe {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:03:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-06141c70-303c-49c2-8a76-91c581a765b5 req-e7167d4a-8a46-4311-96e8-82a0796850eb service nova] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Received event network-vif-unplugged-90598abb-8896-4b67-9871-b78f46b1fdfe for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:03:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:44 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Instance destroyed successfully.
Nov 09 04:03:44 user nova-compute[75378]: DEBUG nova.objects.instance [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lazy-loading 'resources' on Instance uuid 7d051405-6b57-4db2-9533-c2f4e87134d8 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:03:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:42:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1360967074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1360967074',id=15,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:42:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c2176531ffa4cf7bec818309e39ab8d',ramdisk_id='',reservation_id='r-2d0lhvyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:44:20Z,user_data=None,user_id='57efcfeacd7f4daf916e7dd04e11d8f2',uuid=7d051405-6b57-4db2-9533-c2f4e87134d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90598abb-8896-4b67-9871-b78f46b1fdfe", "address": "fa:16:3e:ed:1b:d3", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90598abb-88", "ovs_interfaceid": "90598abb-8896-4b67-9871-b78f46b1fdfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:03:44 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converting VIF {"id": "90598abb-8896-4b67-9871-b78f46b1fdfe", "address": "fa:16:3e:ed:1b:d3", "network": {"id": "74d10ee2-b644-47f2-9596-6bb75495b103", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675071001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c2176531ffa4cf7bec818309e39ab8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90598abb-88", "ovs_interfaceid": "90598abb-8896-4b67-9871-b78f46b1fdfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:03:44 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:1b:d3,bridge_name='br-int',has_traffic_filtering=True,id=90598abb-8896-4b67-9871-b78f46b1fdfe,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90598abb-88') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:03:44 user nova-compute[75378]: DEBUG os_vif [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:1b:d3,bridge_name='br-int',has_traffic_filtering=True,id=90598abb-8896-4b67-9871-b78f46b1fdfe,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90598abb-88') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:03:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90598abb-88, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:03:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82bd3082-d1dd-4e08-b6dd-01b4f8d6fde7) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:03:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:03:44 user nova-compute[75378]: INFO os_vif [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:1b:d3,bridge_name='br-int',has_traffic_filtering=True,id=90598abb-8896-4b67-9871-b78f46b1fdfe,network=Network(74d10ee2-b644-47f2-9596-6bb75495b103),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90598abb-88')
Nov 09 04:03:44 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Deleting instance files /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8_del
Nov 09 04:03:44 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Deletion of /opt/stack/data/nova/instances/7d051405-6b57-4db2-9533-c2f4e87134d8_del complete
Nov 09 04:03:44 user nova-compute[75378]: INFO nova.compute.manager [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 09 04:03:44 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:03:44 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:03:44 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:03:44 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:03:44 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Took 0.40 seconds to deallocate network for instance.
Nov 09 04:03:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:45 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:03:45 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:03:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:45 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:03:45 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Deleted allocations for instance 7d051405-6b57-4db2-9533-c2f4e87134d8
Nov 09 04:03:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3d79b50b-6968-4a2e-bfb3-b3689c9d1039 tempest-ServerBootFromVolumeStableRescueTest-1679422577 tempest-ServerBootFromVolumeStableRescueTest-1679422577-project-member] Lock "7d051405-6b57-4db2-9533-c2f4e87134d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.646s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-7f4f177e-166e-4d04-9e4f-1f612abdfba4 req-048b9a98-cb35-4625-b66b-e90172a6b6e4 service nova] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Received event network-vif-plugged-90598abb-8896-4b67-9871-b78f46b1fdfe {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:03:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7f4f177e-166e-4d04-9e4f-1f612abdfba4 req-048b9a98-cb35-4625-b66b-e90172a6b6e4 service nova] Acquiring lock "7d051405-6b57-4db2-9533-c2f4e87134d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7f4f177e-166e-4d04-9e4f-1f612abdfba4 req-048b9a98-cb35-4625-b66b-e90172a6b6e4 service nova] Lock "7d051405-6b57-4db2-9533-c2f4e87134d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7f4f177e-166e-4d04-9e4f-1f612abdfba4 req-048b9a98-cb35-4625-b66b-e90172a6b6e4 service nova] Lock "7d051405-6b57-4db2-9533-c2f4e87134d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-7f4f177e-166e-4d04-9e4f-1f612abdfba4 req-048b9a98-cb35-4625-b66b-e90172a6b6e4 service nova] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] No waiting events found dispatching network-vif-plugged-90598abb-8896-4b67-9871-b78f46b1fdfe {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:03:45 user nova-compute[75378]: WARNING nova.compute.manager [req-7f4f177e-166e-4d04-9e4f-1f612abdfba4 req-048b9a98-cb35-4625-b66b-e90172a6b6e4 service nova] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Received unexpected event network-vif-plugged-90598abb-8896-4b67-9871-b78f46b1fdfe for instance with vm_state deleted and task_state None.
Nov 09 04:03:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-7f4f177e-166e-4d04-9e4f-1f612abdfba4 req-048b9a98-cb35-4625-b66b-e90172a6b6e4 service nova] [instance: 7d051405-6b57-4db2-9533-c2f4e87134d8] Received event network-vif-deleted-90598abb-8896-4b67-9871-b78f46b1fdfe {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:03:46 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:03:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:48 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:03:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:48 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:03:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:03:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:03:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:03:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:03:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:03:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:03:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:03:48 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:03:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:03:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:03:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:03:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:03:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:03:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:03:49 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:03:49 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:03:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8348MB free_disk=25.264850616455078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:03:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:03:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:03:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2c2acb48-972a-41d7-987e-48e79b3bef93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:03:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 19359be7-5789-4d89-bc5a-c6c5ccd52211 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:03:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9dcaeb12-99bc-48f0-aec9-3de2a3770e01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:03:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance a0a9882f-8b9f-4666-a9fe-0e23efd56616 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:03:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:03:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:03:49 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:03:50 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:03:50 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:03:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:03:52 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:03:52 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:03:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:03:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:04:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "19359be7-5789-4d89-bc5a-c6c5ccd52211" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:04:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "19359be7-5789-4d89-bc5a-c6c5ccd52211" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:04:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "19359be7-5789-4d89-bc5a-c6c5ccd52211-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:04:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "19359be7-5789-4d89-bc5a-c6c5ccd52211-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:04:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "19359be7-5789-4d89-bc5a-c6c5ccd52211-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:04:19 user nova-compute[75378]: INFO nova.compute.manager [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Terminating instance
Nov 09 04:04:19 user nova-compute[75378]: DEBUG nova.compute.manager [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:04:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-7caf259c-f7bc-4b41-94e0-ddc6ba6244a8 req-bfd4fa19-0e6e-41f1-929a-733e8aba42b4 service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Received event network-vif-unplugged-7bcc909c-9b09-409b-8aab-a9f095514e2d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:04:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7caf259c-f7bc-4b41-94e0-ddc6ba6244a8 req-bfd4fa19-0e6e-41f1-929a-733e8aba42b4 service nova] Acquiring lock "19359be7-5789-4d89-bc5a-c6c5ccd52211-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:04:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7caf259c-f7bc-4b41-94e0-ddc6ba6244a8 req-bfd4fa19-0e6e-41f1-929a-733e8aba42b4 service nova] Lock "19359be7-5789-4d89-bc5a-c6c5ccd52211-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:04:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7caf259c-f7bc-4b41-94e0-ddc6ba6244a8 req-bfd4fa19-0e6e-41f1-929a-733e8aba42b4 service nova] Lock "19359be7-5789-4d89-bc5a-c6c5ccd52211-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:04:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-7caf259c-f7bc-4b41-94e0-ddc6ba6244a8 req-bfd4fa19-0e6e-41f1-929a-733e8aba42b4 service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] No waiting events found dispatching network-vif-unplugged-7bcc909c-9b09-409b-8aab-a9f095514e2d {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:04:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-7caf259c-f7bc-4b41-94e0-ddc6ba6244a8 req-bfd4fa19-0e6e-41f1-929a-733e8aba42b4 service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Received event network-vif-unplugged-7bcc909c-9b09-409b-8aab-a9f095514e2d for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:04:20 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Instance destroyed successfully.
Nov 09 04:04:20 user nova-compute[75378]: DEBUG nova.objects.instance [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lazy-loading 'resources' on Instance uuid 19359be7-5789-4d89-bc5a-c6c5ccd52211 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:04:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1103060003',display_name='tempest-VolumesSnapshotTestJSON-instance-1103060003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1103060003',id=38,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBisGsfyiju0+J1AHKLS6GQEWztscCWC3D0QrQbh95VyBSPp5Thn5+SL30M7VGPkqNDtxz926SzNR0yHZ6qy5irp47vGnO2PLyx2fn9ZLWmK/h7OnxQThqcHfk54eSP26A==',key_name='tempest-keypair-1211870534',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:59:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='294bd41e27d9485f845906fed03ba98e',ramdisk_id='',reservation_id='r-gimqy5jf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1705070970',owner_user_name='tempest-VolumesSnapshotTestJSON-1705070970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:59:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e20cee1117e645709251b4b5a6ccb075',uuid=19359be7-5789-4d89-bc5a-c6c5ccd52211,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "address": "fa:16:3e:3a:3e:05", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc909c-9b", "ovs_interfaceid": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:04:20 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Converting VIF {"id": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "address": "fa:16:3e:3a:3e:05", "network": {"id": "0a93a88f-39de-4b68-9674-7ed7dfe24759", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-368864517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "294bd41e27d9485f845906fed03ba98e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bcc909c-9b", "ovs_interfaceid": "7bcc909c-9b09-409b-8aab-a9f095514e2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:04:20 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:3e:05,bridge_name='br-int',has_traffic_filtering=True,id=7bcc909c-9b09-409b-8aab-a9f095514e2d,network=Network(0a93a88f-39de-4b68-9674-7ed7dfe24759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcc909c-9b') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:04:20 user nova-compute[75378]: DEBUG os_vif [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:3e:05,bridge_name='br-int',has_traffic_filtering=True,id=7bcc909c-9b09-409b-8aab-a9f095514e2d,network=Network(0a93a88f-39de-4b68-9674-7ed7dfe24759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcc909c-9b') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:04:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bcc909c-9b, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:04:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2294f6af-2e3d-4a6e-83d3-87edbf163583) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:04:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:20 user nova-compute[75378]: INFO os_vif [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:3e:05,bridge_name='br-int',has_traffic_filtering=True,id=7bcc909c-9b09-409b-8aab-a9f095514e2d,network=Network(0a93a88f-39de-4b68-9674-7ed7dfe24759),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bcc909c-9b')
Nov 09 04:04:20 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Deleting instance files /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211_del
Nov 09 04:04:20 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Deletion of /opt/stack/data/nova/instances/19359be7-5789-4d89-bc5a-c6c5ccd52211_del complete
Nov 09 04:04:20 user nova-compute[75378]: INFO nova.compute.manager [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 09 04:04:20 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:04:20 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:04:20 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:04:20 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:04:20 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Took 0.70 seconds to deallocate network for instance.
Nov 09 04:04:20 user nova-compute[75378]: DEBUG nova.compute.manager [req-662835e5-4bf6-4ba3-8d7a-89a078969246 req-54b0cc3a-0a7f-493b-97bb-0c62912f791e service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Received event network-vif-deleted-7bcc909c-9b09-409b-8aab-a9f095514e2d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:04:20 user nova-compute[75378]: INFO nova.compute.manager [req-662835e5-4bf6-4ba3-8d7a-89a078969246 req-54b0cc3a-0a7f-493b-97bb-0c62912f791e service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Neutron deleted interface 7bcc909c-9b09-409b-8aab-a9f095514e2d; detaching it from the instance and deleting it from the info cache
Nov 09 04:04:20 user nova-compute[75378]: DEBUG nova.network.neutron [req-662835e5-4bf6-4ba3-8d7a-89a078969246 req-54b0cc3a-0a7f-493b-97bb-0c62912f791e service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:04:20 user nova-compute[75378]: DEBUG nova.compute.manager [req-662835e5-4bf6-4ba3-8d7a-89a078969246 req-54b0cc3a-0a7f-493b-97bb-0c62912f791e service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Detach interface failed, port_id=7bcc909c-9b09-409b-8aab-a9f095514e2d, reason: Instance 19359be7-5789-4d89-bc5a-c6c5ccd52211 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 04:04:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:04:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:04:21 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:04:21 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:04:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:04:21 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Deleted allocations for instance 19359be7-5789-4d89-bc5a-c6c5ccd52211
Nov 09 04:04:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5935d6ad-6e40-4c15-8f95-55d922574e44 tempest-VolumesSnapshotTestJSON-1705070970 tempest-VolumesSnapshotTestJSON-1705070970-project-member] Lock "19359be7-5789-4d89-bc5a-c6c5ccd52211" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:04:21 user nova-compute[75378]: DEBUG nova.compute.manager [req-a39faf05-ae9e-48e1-86a2-422ae48c02a9 req-5cde9ac5-44eb-43ad-8afc-0fdc1e346af7 service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Received event network-vif-plugged-7bcc909c-9b09-409b-8aab-a9f095514e2d {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:04:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a39faf05-ae9e-48e1-86a2-422ae48c02a9 req-5cde9ac5-44eb-43ad-8afc-0fdc1e346af7 service nova] Acquiring lock "19359be7-5789-4d89-bc5a-c6c5ccd52211-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:04:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a39faf05-ae9e-48e1-86a2-422ae48c02a9 req-5cde9ac5-44eb-43ad-8afc-0fdc1e346af7 service nova] Lock "19359be7-5789-4d89-bc5a-c6c5ccd52211-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:04:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a39faf05-ae9e-48e1-86a2-422ae48c02a9 req-5cde9ac5-44eb-43ad-8afc-0fdc1e346af7 service nova] Lock "19359be7-5789-4d89-bc5a-c6c5ccd52211-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:04:21 user nova-compute[75378]: DEBUG nova.compute.manager [req-a39faf05-ae9e-48e1-86a2-422ae48c02a9 req-5cde9ac5-44eb-43ad-8afc-0fdc1e346af7 service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] No waiting events found dispatching network-vif-plugged-7bcc909c-9b09-409b-8aab-a9f095514e2d {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:04:21 user nova-compute[75378]: WARNING nova.compute.manager [req-a39faf05-ae9e-48e1-86a2-422ae48c02a9 req-5cde9ac5-44eb-43ad-8afc-0fdc1e346af7 service nova] [instance: 19359be7-5789-4d89-bc5a-c6c5ccd52211] Received unexpected event network-vif-plugged-7bcc909c-9b09-409b-8aab-a9f095514e2d for instance with vm_state deleted and task_state None.
Nov 09 04:04:24 user nova-compute[75378]: INFO nova.compute.manager [None req-af7259ea-141f-49e7-87c3-e5bb2a48ea39 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Get console output
Nov 09 04:04:24 user nova-compute[75378]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 09 04:04:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:28 user nova-compute[75378]: DEBUG nova.compute.manager [req-68c2bae6-d084-40ef-8ffb-a342661f943a req-f771310f-9b2b-43d7-a20c-b483a089cd5c service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Received event network-changed-8ee45305-d703-4e55-ac47-60d1407e2772 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:04:28 user nova-compute[75378]: DEBUG nova.compute.manager [req-68c2bae6-d084-40ef-8ffb-a342661f943a req-f771310f-9b2b-43d7-a20c-b483a089cd5c service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Refreshing instance network info cache due to event network-changed-8ee45305-d703-4e55-ac47-60d1407e2772. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:04:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-68c2bae6-d084-40ef-8ffb-a342661f943a req-f771310f-9b2b-43d7-a20c-b483a089cd5c service nova] Acquiring lock "refresh_cache-a0a9882f-8b9f-4666-a9fe-0e23efd56616" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:04:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-68c2bae6-d084-40ef-8ffb-a342661f943a req-f771310f-9b2b-43d7-a20c-b483a089cd5c service nova] Acquired lock "refresh_cache-a0a9882f-8b9f-4666-a9fe-0e23efd56616" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:04:28 user nova-compute[75378]: DEBUG nova.network.neutron [req-68c2bae6-d084-40ef-8ffb-a342661f943a req-f771310f-9b2b-43d7-a20c-b483a089cd5c service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Refreshing network info cache for port 8ee45305-d703-4e55-ac47-60d1407e2772 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:04:28 user nova-compute[75378]: DEBUG nova.network.neutron [req-68c2bae6-d084-40ef-8ffb-a342661f943a req-f771310f-9b2b-43d7-a20c-b483a089cd5c service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Updated VIF entry in instance network info cache for port 8ee45305-d703-4e55-ac47-60d1407e2772. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:04:28 user nova-compute[75378]: DEBUG nova.network.neutron [req-68c2bae6-d084-40ef-8ffb-a342661f943a req-f771310f-9b2b-43d7-a20c-b483a089cd5c service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Updating instance_info_cache with network_info: [{"id": "8ee45305-d703-4e55-ac47-60d1407e2772", "address": "fa:16:3e:bb:23:47", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee45305-d7", "ovs_interfaceid": "8ee45305-d703-4e55-ac47-60d1407e2772", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:04:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-68c2bae6-d084-40ef-8ffb-a342661f943a req-f771310f-9b2b-43d7-a20c-b483a089cd5c service nova] Releasing lock "refresh_cache-a0a9882f-8b9f-4666-a9fe-0e23efd56616" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:04:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG nova.objects.instance [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lazy-loading 'flavor' on Instance uuid a0a9882f-8b9f-4666-a9fe-0e23efd56616 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:04:34 user nova-compute[75378]: INFO nova.compute.manager [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Attaching volume 5a907c4f-5761-4bca-9eab-9af8beb70bd0 to /dev/vdb
Nov 09 04:04:34 user nova-compute[75378]: DEBUG os_brick.utils [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4626747c-4539-46dd-9467-718458733550]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f809dd06-0448-4162-89de-30978c2f2225]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e44498-4e96-43e1-9df6-2782ef1cf6b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[63025e9e-01e4-429c-ba33-1889b8d1844e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:04:34 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 04:04:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c882aed2-7b04-44dc-a715-75900f858e0d]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG os_brick.utils [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:04:34 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Updating existing volume attachment record: 0d8dacec-1970-4d15-9105-129feca9bfbf {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 04:04:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:43 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:04:43 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:04:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-2c2acb48-972a-41d7-987e-48e79b3bef93" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:04:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-2c2acb48-972a-41d7-987e-48e79b3bef93" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:04:43 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 04:04:44 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Updating instance_info_cache with network_info: [{"id": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "address": "fa:16:3e:02:bc:fb", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d7d7ee-d1", "ovs_interfaceid": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:04:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-2c2acb48-972a-41d7-987e-48e79b3bef93" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:04:44 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 04:04:44 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:04:44 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:04:44 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:04:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:04:45 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:04:46 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:04:46 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:04:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:49 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:04:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:04:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:04:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:04:49 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:04:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:04:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:04:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:04:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:04:49 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:04:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:04:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:04:49 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:04:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:04:50 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:04:50 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:04:50 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8534MB free_disk=25.29003143310547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:04:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:04:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:04:50 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2c2acb48-972a-41d7-987e-48e79b3bef93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:04:50 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9dcaeb12-99bc-48f0-aec9-3de2a3770e01 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:04:50 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance a0a9882f-8b9f-4666-a9fe-0e23efd56616 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:04:50 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:04:50 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:04:50 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:04:50 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:04:50 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:04:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.322s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:04:53 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:04:53 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:04:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:04:58 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 04:04:58 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZNMQcHOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:04:58 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:04:58 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:04:58 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:04:58 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:04:58 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:04:58 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:04:58 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 04:04:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:04:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:04:58 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8f6fb9-8755-4b5e-9563-2b2a2eac8ecd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:04:58 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 04:04:58 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:04:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:04:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:04:58 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4a2c6e-619e-4123-8a1e-d145c3ad1c09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:04:58 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0] added
Nov 09 04:04:58 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:04:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:04:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:04:58 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[afea443b-b142-43e9-9890-f75f95b8bf4a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:04:58 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:04:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:04:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:04:58 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e58120d-3085-48db-85ba-2ead3027b7fa]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:04:58 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:04:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZNMQcHOe {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZNMQcHOe" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3962d73b-f930-452e-a483-7255772a3654]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZNMQcHOe'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca712eb-41aa-4ba2-9f13-7273d0008921]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6571077d-0b72-4542-b2be-130256a1fee4]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:04:59 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:04:59 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5bc8c3-a76c-4c53-99df-25f5d9320259]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0, portal: 172.16.0.220,3260]
Nov 09 04:04:59 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0, portal: 172.16.0.220,3260] successful.
Nov 09 04:04:59 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46ff154-0e77-4683-8c71-24d515510e50]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab8e452-d39a-4f49-86d7-e03ba3c6b039]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:04:59 user nova-compute[75378]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 (non-flash)
Nov 09 04:04:59 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:04:59 user nova-compute[75378]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 (non-flash)
Nov 09 04:04:59 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c820e2a7-0466-42fd-86cc-60fd0c8b53da]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:04:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZNMQcHOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 04:05:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:05:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:05:00 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23032633264643330', 'path': '/dev/sdc'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:05:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032633264643330', 'path': '/dev/sdc'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 04:05:00 user nova-compute[75378]: DEBUG nova.objects.instance [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lazy-loading 'flavor' on Instance uuid a0a9882f-8b9f-4666-a9fe-0e23efd56616 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:05:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 04:05:00 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:05:00 user nova-compute[75378]:   <source dev="/dev/sdc"/>
Nov 09 04:05:00 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 04:05:00 user nova-compute[75378]:   <serial>5a907c4f-5761-4bca-9eab-9af8beb70bd0</serial>
Nov 09 04:05:00 user nova-compute[75378]: </disk>
Nov 09 04:05:00 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 04:05:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:05:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:05:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] No VIF found with MAC fa:16:3e:bb:23:47, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:05:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-928a29d2-815e-4350-8691-03e98a6dadab tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.313s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:05:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:05:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:05:02 user nova-compute[75378]: INFO nova.compute.manager [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Detaching volume 5a907c4f-5761-4bca-9eab-9af8beb70bd0
Nov 09 04:05:02 user nova-compute[75378]: INFO nova.virt.block_device [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Attempting to driver detach volume 5a907c4f-5761-4bca-9eab-9af8beb70bd0 from mountpoint /dev/vdb
Nov 09 04:05:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Attempting to detach device vdb from instance a0a9882f-8b9f-4666-a9fe-0e23efd56616 from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 04:05:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 04:05:02 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:05:02 user nova-compute[75378]:   <source dev="/dev/sdc"/>
Nov 09 04:05:02 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 04:05:02 user nova-compute[75378]:   <serial>5a907c4f-5761-4bca-9eab-9af8beb70bd0</serial>
Nov 09 04:05:02 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 04:05:02 user nova-compute[75378]: </disk>
Nov 09 04:05:02 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 04:05:02 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Successfully detached device vdb from instance a0a9882f-8b9f-4666-a9fe-0e23efd56616 from the persistent domain config.
Nov 09 04:05:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a0a9882f-8b9f-4666-a9fe-0e23efd56616 from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 04:05:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 04:05:02 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:05:02 user nova-compute[75378]:   <source dev="/dev/sdc"/>
Nov 09 04:05:02 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 04:05:02 user nova-compute[75378]:   <serial>5a907c4f-5761-4bca-9eab-9af8beb70bd0</serial>
Nov 09 04:05:02 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 04:05:02 user nova-compute[75378]: </disk>
Nov 09 04:05:02 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 04:05:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a0a9882f-8b9f-4666-a9fe-0e23efd56616 {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 04:05:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:05 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquiring lock "00959e75-7446-4ff6-be3e-56d7146b3576" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "00959e75-7446-4ff6-be3e-56d7146b3576" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:05:07 user nova-compute[75378]: INFO nova.compute.manager [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Unshelving
Nov 09 04:05:07 user nova-compute[75378]: INFO nova.virt.block_device [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Booting with volume 073fc7a9-2698-4f96-888c-170888571f4d at /dev/vda
Nov 09 04:05:07 user nova-compute[75378]: DEBUG os_brick.utils [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[545a00a3-b36b-4e29-9914-b4eb076a5e15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9093dab-8dab-4b0c-8526-aded8f510d3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d4c282-57a0-41bf-8d4f-543b4e52cfbe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e3d66e-95ca-4b92-ac87-e007670211bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:05:07 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 04:05:07 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb83284e-8534-425e-bce1-329fb39e1de2]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG os_brick.utils [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:05:07 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Updating existing volume attachment record: ae4a7f79-4786-4191-ac89-5bfa6710eeea {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 04:05:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:05:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:05:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:05:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:05:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:22 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a0a9882f-8b9f-4666-a9fe-0e23efd56616 is timed out.
Nov 09 04:05:22 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Successfully detached device vdb from instance a0a9882f-8b9f-4666-a9fe-0e23efd56616 from the live domain config.
Nov 09 04:05:22 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZNMQcHOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:05:22 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:05:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4c8aa4-a749-47dc-8fb5-76f95723c24a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 04:05:22 user nova-compute[75378]: No targets found.
Nov 09 04:05:22 user nova-compute[75378]: iSNS:
Nov 09 04:05:22 user nova-compute[75378]: No targets found.
Nov 09 04:05:22 user nova-compute[75378]: STATIC:
Nov 09 04:05:22 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0
Nov 09 04:05:22 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:05:22 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:05:22 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723
Nov 09 04:05:22 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:05:22 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:05:22 user nova-compute[75378]: FIRMWARE:
Nov 09 04:05:22 user nova-compute[75378]: No targets found.
Nov 09 04:05:22 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 04:05:22 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 04:05:22 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[46825a6d-975d-40da-b8ed-9810ac8b62ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f9960c-d0b5-4cc2-85de-eae4292416c6]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:05:22 user nova-compute[75378]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 (non-flash)
Nov 09 04:05:22 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:05:22 user nova-compute[75378]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 (non-flash)
Nov 09 04:05:22 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c7f5630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0'): ({'sdc'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Removing single pathed devices sdc {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[884ba9ef-9809-4043-b7b6-9765367c6ada]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c487223d-b01b-428e-b9ff-fbe573b33cbd]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Flushing IO for device /dev/sdc {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44797c5-8501-4434-8ea1-37544f354c88]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2b3aa7-ffbb-42f0-bbeb-c04ad403ce76]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] SCSI volumes sdc have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[018cb3f4-2c33-4958-b20e-32aad75c7e6f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:05:22 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:23 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43f3c17-e32c-4deb-8a4b-1fd929cdc9d6]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:23 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0, portal: 172.16.0.220,3260]
Nov 09 04:05:23 user nova-compute[75378]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0, portal: 172.16.0.220,3260] successful.
Nov 09 04:05:23 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:05:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:23 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a907c4f-5761-4bca-9eab-9af8beb70bd0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:23 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ee1315-68da-4633-bb79-e31c57a2b0bb]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:23 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:05:23 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:05:23 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] <== disconnect_volume: return (324ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:05:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 04:05:24 user nova-compute[75378]: DEBUG nova.objects.instance [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lazy-loading 'flavor' on Instance uuid a0a9882f-8b9f-4666-a9fe-0e23efd56616 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:05:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-0fd86552-3e1a-49d1-95ca-1a5087edfb31 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.225s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:05:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:05:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:05:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:05:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:05:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.004s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:05:25 user nova-compute[75378]: INFO nova.compute.manager [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Terminating instance
Nov 09 04:05:25 user nova-compute[75378]: DEBUG nova.compute.manager [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:05:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-d8810071-c6c8-464c-8ae3-6566be5f41d0 req-4ed882b3-296d-4dab-a81a-d3488200519d service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Received event network-vif-unplugged-971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:05:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d8810071-c6c8-464c-8ae3-6566be5f41d0 req-4ed882b3-296d-4dab-a81a-d3488200519d service nova] Acquiring lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:05:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d8810071-c6c8-464c-8ae3-6566be5f41d0 req-4ed882b3-296d-4dab-a81a-d3488200519d service nova] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:05:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d8810071-c6c8-464c-8ae3-6566be5f41d0 req-4ed882b3-296d-4dab-a81a-d3488200519d service nova] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:05:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-d8810071-c6c8-464c-8ae3-6566be5f41d0 req-4ed882b3-296d-4dab-a81a-d3488200519d service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] No waiting events found dispatching network-vif-unplugged-971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:05:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-d8810071-c6c8-464c-8ae3-6566be5f41d0 req-4ed882b3-296d-4dab-a81a-d3488200519d service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Received event network-vif-unplugged-971f6712-c5e7-4bb6-846d-e165e70fd45a for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:05:26 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Instance destroyed successfully.
Nov 09 04:05:26 user nova-compute[75378]: DEBUG nova.objects.instance [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lazy-loading 'resources' on Instance uuid 9dcaeb12-99bc-48f0-aec9-3de2a3770e01 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:58:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-313014061',display_name='tempest-ServerActionsTestOtherA-server-313014061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-313014061',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFabS+mewwrg7oOEw/0EoMWlEwIz3NoSF6MUhLgvIEWjSZH9d/Fg8M+DuLJkZN6SKSXE9qeztuGxbDfpg7EHMNtmRvy2F5yoI+XGOsX3tR4ssTADXmphKv1NsnpmlrDrQg==',key_name='tempest-keypair-138130530',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:01:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='548993d280024b60b3778b026177e356',ramdisk_id='',reservation_id='r-a17ajdc9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2010465588',owner_user_name='tempest-ServerActionsTestOtherA-2010465588-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T04:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d4f0858695e4509a6b0ab99a8212571',uuid=9dcaeb12-99bc-48f0-aec9-3de2a3770e01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "address": "fa:16:3e:68:d1:1a", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971f6712-c5", "ovs_interfaceid": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converting VIF {"id": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "address": "fa:16:3e:68:d1:1a", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap971f6712-c5", "ovs_interfaceid": "971f6712-c5e7-4bb6-846d-e165e70fd45a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:d1:1a,bridge_name='br-int',has_traffic_filtering=True,id=971f6712-c5e7-4bb6-846d-e165e70fd45a,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap971f6712-c5') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_vif [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:d1:1a,bridge_name='br-int',has_traffic_filtering=True,id=971f6712-c5e7-4bb6-846d-e165e70fd45a,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap971f6712-c5') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap971f6712-c5, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d80ea59-a3bd-4996-9978-3e3411d00502) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:26 user nova-compute[75378]: INFO os_vif [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:d1:1a,bridge_name='br-int',has_traffic_filtering=True,id=971f6712-c5e7-4bb6-846d-e165e70fd45a,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap971f6712-c5')
Nov 09 04:05:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPVFTdZG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:05:26 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[539c2b64-24e3-4324-a6e3-c94425548e0a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 04:05:26 user nova-compute[75378]: No targets found.
Nov 09 04:05:26 user nova-compute[75378]: iSNS:
Nov 09 04:05:26 user nova-compute[75378]: No targets found.
Nov 09 04:05:26 user nova-compute[75378]: STATIC:
Nov 09 04:05:26 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723
Nov 09 04:05:26 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:05:26 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:05:26 user nova-compute[75378]: FIRMWARE:
Nov 09 04:05:26 user nova-compute[75378]: No targets found.
Nov 09 04:05:26 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 04:05:26 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 04:05:26 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8672c1b1-b0e4-4feb-9c22-c4a1435ff11a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f9aedf-bd3d-4760-8757-19c02006dd79]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:05:26 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 (non-flash)
Nov 09 04:05:26 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c44a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723'): ({'sdb'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Removing single pathed devices sdb {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[12313f57-f5b1-4014-bf72-f236c66329c1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb383807-ce4b-4567-b076-50599156457b]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Flushing IO for device /dev/sdb {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ff49df-7522-4de3-b9cf-8b1018088875]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b82f4e6-e8f4-4424-9679-985670ac8b68]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23233633336393938', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a429d6c6', '/dev/disk/by-id/scsi-1SCST_BIOa429d6c6-23c369989fa74f1b') {{(pid=87049) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a5a758-e969-4bf0-94af-17e1d2f4acab]: (4, None) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[416aa435-b1be-4c57-865e-731ace81a1c0]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c38b15b-111e-4185-adca-cc1711855ed4]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723, portal: 172.16.0.220,3260]
Nov 09 04:05:26 user nova-compute[75378]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723, portal: 172.16.0.220,3260] successful.
Nov 09 04:05:26 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a973b815-15ca-43a6-acba-896d722ff723 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3488cc7-5d0f-44cc-8e4c-db7f524431ce]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] <== disconnect_volume: return (339ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 04:05:26 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Deleting instance files /opt/stack/data/nova/instances/9dcaeb12-99bc-48f0-aec9-3de2a3770e01_del
Nov 09 04:05:26 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Deletion of /opt/stack/data/nova/instances/9dcaeb12-99bc-48f0-aec9-3de2a3770e01_del complete
Nov 09 04:05:26 user nova-compute[75378]: INFO nova.compute.manager [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 09 04:05:26 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:05:26 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:05:27 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:05:27 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Took 0.79 seconds to deallocate network for instance.
Nov 09 04:05:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-48cbb5c4-70b4-4c5c-a2e4-cf89fe839902 req-85865929-9224-42b0-8df6-efd1ec6baa6e service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Received event network-vif-plugged-971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:05:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-48cbb5c4-70b4-4c5c-a2e4-cf89fe839902 req-85865929-9224-42b0-8df6-efd1ec6baa6e service nova] Acquiring lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:05:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-48cbb5c4-70b4-4c5c-a2e4-cf89fe839902 req-85865929-9224-42b0-8df6-efd1ec6baa6e service nova] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:05:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-48cbb5c4-70b4-4c5c-a2e4-cf89fe839902 req-85865929-9224-42b0-8df6-efd1ec6baa6e service nova] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:05:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-48cbb5c4-70b4-4c5c-a2e4-cf89fe839902 req-85865929-9224-42b0-8df6-efd1ec6baa6e service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] No waiting events found dispatching network-vif-plugged-971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:05:27 user nova-compute[75378]: WARNING nova.compute.manager [req-48cbb5c4-70b4-4c5c-a2e4-cf89fe839902 req-85865929-9224-42b0-8df6-efd1ec6baa6e service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Received unexpected event network-vif-plugged-971f6712-c5e7-4bb6-846d-e165e70fd45a for instance with vm_state active and task_state deleting.
Nov 09 04:05:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-48cbb5c4-70b4-4c5c-a2e4-cf89fe839902 req-85865929-9224-42b0-8df6-efd1ec6baa6e service nova] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Received event network-vif-deleted-971f6712-c5e7-4bb6-846d-e165e70fd45a {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:05:28 user nova-compute[75378]: INFO nova.compute.manager [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Took 1.02 seconds to detach 1 volumes for instance.
Nov 09 04:05:28 user nova-compute[75378]: DEBUG nova.compute.manager [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 9dcaeb12-99bc-48f0-aec9-3de2a3770e01] Deleting volume: a973b815-15ca-43a6-acba-896d722ff723 {{(pid=75378) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 09 04:05:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:05:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:05:28 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:05:28 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:05:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.234s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:05:28 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Deleted allocations for instance 9dcaeb12-99bc-48f0-aec9-3de2a3770e01
Nov 09 04:05:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-be8233ee-7aac-4e3d-842f-474350b8af63 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "9dcaeb12-99bc-48f0-aec9-3de2a3770e01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.561s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:05:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:05:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:05:31 user nova-compute[75378]: DEBUG nova.objects.instance [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lazy-loading 'pci_requests' on Instance uuid 00959e75-7446-4ff6-be3e-56d7146b3576 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:05:31 user nova-compute[75378]: DEBUG nova.objects.instance [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lazy-loading 'numa_topology' on Instance uuid 00959e75-7446-4ff6-be3e-56d7146b3576 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:05:31 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 04:05:31 user nova-compute[75378]: INFO nova.compute.claims [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Claim successful on node user
Nov 09 04:05:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:32 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:05:32 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:05:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:05:32 user nova-compute[75378]: INFO nova.network.neutron [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Updating port bd706a0c-ba99-42b7-bf21-898a277c3541 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 09 04:05:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquiring lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:05:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquired lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:05:32 user nova-compute[75378]: DEBUG nova.network.neutron [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.compute.manager [req-c78af979-7690-4eda-a4e0-75edfa31ae09 req-a90789a9-cfd9-48ab-8fa0-750f282943fe service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received event network-changed-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.compute.manager [req-c78af979-7690-4eda-a4e0-75edfa31ae09 req-a90789a9-cfd9-48ab-8fa0-750f282943fe service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Refreshing instance network info cache due to event network-changed-bd706a0c-ba99-42b7-bf21-898a277c3541. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c78af979-7690-4eda-a4e0-75edfa31ae09 req-a90789a9-cfd9-48ab-8fa0-750f282943fe service nova] Acquiring lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.network.neutron [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Updating instance_info_cache with network_info: [{"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Releasing lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 04:05:33 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Creating image(s)
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Did not create local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Ensure instance console log exists: /opt/stack/data/nova/instances/00959e75-7446-4ff6-be3e-56d7146b3576/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Start _get_guest_xml network_info=[{"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abmGJcwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '00959e75-7446-4ff6-be3e-56d7146b3576', 'attached_at': '', 'detached_at': '', 'volume_id': '073fc7a9-2698-4f96-888c-170888571f4d', 'serial': '073fc7a9-2698-4f96-888c-170888571f4d'}, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'ae4a7f79-4786-4191-ac89-5bfa6710eeea', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c78af979-7690-4eda-a4e0-75edfa31ae09 req-a90789a9-cfd9-48ab-8fa0-750f282943fe service nova] Acquired lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.network.neutron [req-c78af979-7690-4eda-a4e0-75edfa31ae09 req-a90789a9-cfd9-48ab-8fa0-750f282943fe service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Refreshing network info cache for port bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:05:33 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:05:33 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.objects.instance [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lazy-loading 'vcpu_model' on Instance uuid 00959e75-7446-4ff6-be3e-56d7146b3576 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.objects.base [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Object Instance<00959e75-7446-4ff6-be3e-56d7146b3576> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abmGJcwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:05:33 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:05:33 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:05:33 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafeb52f-32cc-43a3-b35b-1477abccf0c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 04:05:33 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0e92cf-2350-4061-8587-8effcdfe116b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d] added
Nov 09 04:05:33 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94a24ff-da66-4d66-8077-62529330c011]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad44fd0-c6be-4416-b5aa-79448c46b076]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abmGJcwI {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abmGJcwI" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18015ac-3e99-43b1-b7ec-6400de05b680]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'abmGJcwI'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f4d389-c850-4182-8da8-9ccf6c5829de]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5041e900-1170-4b2b-8aa0-91cc71dae4f5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 04:05:33 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 04:05:33 user nova-compute[75378]:  {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:05:33 user nova-compute[75378]: WARNING os_brick.initiator.connectors.iscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 04:05:33 user nova-compute[75378]: 
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1129ec5f-7374-40c7-966f-d41b2dd15915]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d, portal: 172.16.0.220,3260]
Nov 09 04:05:33 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d, portal: 172.16.0.220,3260] successful.
Nov 09 04:05:33 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5d3156-92e8-45dc-a54c-a9fc8fa0e6ab]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb152e2-29d7-4959-b001-dbeffcda73d7]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d (non-flash)
Nov 09 04:05:33 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d (non-flash)
Nov 09 04:05:33 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee849f6-7742-478a-87a8-d75a363decda]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.network.neutron [req-c78af979-7690-4eda-a4e0-75edfa31ae09 req-a90789a9-cfd9-48ab-8fa0-750f282943fe service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Updated VIF entry in instance network info cache for port bd706a0c-ba99-42b7-bf21-898a277c3541. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG nova.network.neutron [req-c78af979-7690-4eda-a4e0-75edfa31ae09 req-a90789a9-cfd9-48ab-8fa0-750f282943fe service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Updating instance_info_cache with network_info: [{"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:05:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c78af979-7690-4eda-a4e0-75edfa31ae09 req-a90789a9-cfd9-48ab-8fa0-750f282943fe service nova] Releasing lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abmGJcwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23431643333626231', 'path': '/dev/sdb'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431643333626231', 'path': '/dev/sdb'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T04:01:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1994468493',display_name='tempest-TestShelveInstance-server-1994468493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1994468493',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1433736735',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:02:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='473b18add01440c082dbe9f1503b075d',ramdisk_id='',reservation_id='r-0nv92eqt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-32995184',owner_user_name='tempest-TestShelveInstance-32995184-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T04:05:07Z,user_data=None,user_id='931191283d604e2a91bd3e4daceedebf',uuid=00959e75-7446-4ff6-be3e-56d7146b3576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Converting VIF {"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:4d:6f,bridge_name='br-int',has_traffic_filtering=True,id=bd706a0c-ba99-42b7-bf21-898a277c3541,network=Network(e2b2cd72-bdd1-484a-ace3-25029da9ac29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd706a0c-ba') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG nova.objects.instance [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lazy-loading 'pci_devices' on Instance uuid 00959e75-7446-4ff6-be3e-56d7146b3576 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG nova.objects.base [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Object Instance<00959e75-7446-4ff6-be3e-56d7146b3576> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] End _get_guest_xml xml=<domain type="kvm">
Nov 09 04:05:34 user nova-compute[75378]:   <uuid>00959e75-7446-4ff6-be3e-56d7146b3576</uuid>
Nov 09 04:05:34 user nova-compute[75378]:   <name>instance-00000027</name>
Nov 09 04:05:34 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 04:05:34 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 04:05:34 user nova-compute[75378]:   <metadata>
Nov 09 04:05:34 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 04:05:34 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 04:05:34 user nova-compute[75378]:       <nova:name>tempest-TestShelveInstance-server-1994468493</nova:name>
Nov 09 04:05:34 user nova-compute[75378]:       <nova:creationTime>2023-11-09 04:05:33</nova:creationTime>
Nov 09 04:05:34 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 04:05:34 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 04:05:34 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 04:05:34 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 04:05:34 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 04:05:34 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 04:05:34 user nova-compute[75378]:       </nova:flavor>
Nov 09 04:05:34 user nova-compute[75378]:       <nova:owner>
Nov 09 04:05:34 user nova-compute[75378]:         <nova:user uuid="931191283d604e2a91bd3e4daceedebf">tempest-TestShelveInstance-32995184-project-member</nova:user>
Nov 09 04:05:34 user nova-compute[75378]:         <nova:project uuid="473b18add01440c082dbe9f1503b075d">tempest-TestShelveInstance-32995184</nova:project>
Nov 09 04:05:34 user nova-compute[75378]:       </nova:owner>
Nov 09 04:05:34 user nova-compute[75378]:       <nova:ports>
Nov 09 04:05:34 user nova-compute[75378]:         <nova:port uuid="bd706a0c-ba99-42b7-bf21-898a277c3541">
Nov 09 04:05:34 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 04:05:34 user nova-compute[75378]:         </nova:port>
Nov 09 04:05:34 user nova-compute[75378]:       </nova:ports>
Nov 09 04:05:34 user nova-compute[75378]:     </nova:instance>
Nov 09 04:05:34 user nova-compute[75378]:   </metadata>
Nov 09 04:05:34 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 04:05:34 user nova-compute[75378]:     <system>
Nov 09 04:05:34 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 04:05:34 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 04:05:34 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 04:05:34 user nova-compute[75378]:       <entry name="serial">00959e75-7446-4ff6-be3e-56d7146b3576</entry>
Nov 09 04:05:34 user nova-compute[75378]:       <entry name="uuid">00959e75-7446-4ff6-be3e-56d7146b3576</entry>
Nov 09 04:05:34 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 04:05:34 user nova-compute[75378]:     </system>
Nov 09 04:05:34 user nova-compute[75378]:   </sysinfo>
Nov 09 04:05:34 user nova-compute[75378]:   <os>
Nov 09 04:05:34 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 04:05:34 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 04:05:34 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 04:05:34 user nova-compute[75378]:   </os>
Nov 09 04:05:34 user nova-compute[75378]:   <features>
Nov 09 04:05:34 user nova-compute[75378]:     <acpi/>
Nov 09 04:05:34 user nova-compute[75378]:     <apic/>
Nov 09 04:05:34 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 04:05:34 user nova-compute[75378]:   </features>
Nov 09 04:05:34 user nova-compute[75378]:   <clock offset="utc">
Nov 09 04:05:34 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 04:05:34 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 04:05:34 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 04:05:34 user nova-compute[75378]:   </clock>
Nov 09 04:05:34 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 04:05:34 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 04:05:34 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 04:05:34 user nova-compute[75378]:   </cpu>
Nov 09 04:05:34 user nova-compute[75378]:   <devices>
Nov 09 04:05:34 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 04:05:34 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:05:34 user nova-compute[75378]:       <source dev="/dev/sdb"/>
Nov 09 04:05:34 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 04:05:34 user nova-compute[75378]:       <serial>073fc7a9-2698-4f96-888c-170888571f4d</serial>
Nov 09 04:05:34 user nova-compute[75378]:     </disk>
Nov 09 04:05:34 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 04:05:34 user nova-compute[75378]:       <mac address="fa:16:3e:16:4d:6f"/>
Nov 09 04:05:34 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:05:34 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 04:05:34 user nova-compute[75378]:       <target dev="tapbd706a0c-ba"/>
Nov 09 04:05:34 user nova-compute[75378]:     </interface>
Nov 09 04:05:34 user nova-compute[75378]:     <serial type="pty">
Nov 09 04:05:34 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/00959e75-7446-4ff6-be3e-56d7146b3576/console.log" append="off"/>
Nov 09 04:05:34 user nova-compute[75378]:     </serial>
Nov 09 04:05:34 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 04:05:34 user nova-compute[75378]:     <video>
Nov 09 04:05:34 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:05:34 user nova-compute[75378]:     </video>
Nov 09 04:05:34 user nova-compute[75378]:     <rng model="virtio">
Nov 09 04:05:34 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 04:05:34 user nova-compute[75378]:     </rng>
Nov 09 04:05:34 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 04:05:34 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 04:05:34 user nova-compute[75378]:       <stats period="10"/>
Nov 09 04:05:34 user nova-compute[75378]:     </memballoon>
Nov 09 04:05:34 user nova-compute[75378]:   </devices>
Nov 09 04:05:34 user nova-compute[75378]: </domain>
Nov 09 04:05:34 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T04:01:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1994468493',display_name='tempest-TestShelveInstance-server-1994468493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1994468493',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1433736735',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:02:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='473b18add01440c082dbe9f1503b075d',ramdisk_id='',reservation_id='r-0nv92eqt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-32995184',owner_user_name='tempest-TestShelveInstance-32995184-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T04:05:07Z,user_data=None,user_id='931191283d604e2a91bd3e4daceedebf',uuid=00959e75-7446-4ff6-be3e-56d7146b3576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Converting VIF {"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:4d:6f,bridge_name='br-int',has_traffic_filtering=True,id=bd706a0c-ba99-42b7-bf21-898a277c3541,network=Network(e2b2cd72-bdd1-484a-ace3-25029da9ac29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd706a0c-ba') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG os_vif [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4d:6f,bridge_name='br-int',has_traffic_filtering=True,id=bd706a0c-ba99-42b7-bf21-898a277c3541,network=Network(e2b2cd72-bdd1-484a-ace3-25029da9ac29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd706a0c-ba') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5638648-d853-59b4-b910-8a2948aaf764', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd706a0c-ba, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd706a0c-ba, col_values=(('qos', UUID('29f7ea1e-475e-4fe6-a5d7-4c96d65921ef')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd706a0c-ba, col_values=(('external_ids', {'iface-id': 'bd706a0c-ba99-42b7-bf21-898a277c3541', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:4d:6f', 'vm-uuid': '00959e75-7446-4ff6-be3e-56d7146b3576'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:05:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:34 user nova-compute[75378]: INFO os_vif [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4d:6f,bridge_name='br-int',has_traffic_filtering=True,id=bd706a0c-ba99-42b7-bf21-898a277c3541,network=Network(e2b2cd72-bdd1-484a-ace3-25029da9ac29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd706a0c-ba')
Nov 09 04:05:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:05:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] No VIF found with MAC fa:16:3e:16:4d:6f, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:05:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:36 user nova-compute[75378]: DEBUG nova.compute.manager [req-9261dc3d-9eed-4c8d-9020-4c5e0d31a6ed req-41cc116b-7ac1-4861-8828-4f8e840fce8d service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received event network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:05:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9261dc3d-9eed-4c8d-9020-4c5e0d31a6ed req-41cc116b-7ac1-4861-8828-4f8e840fce8d service nova] Acquiring lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:05:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9261dc3d-9eed-4c8d-9020-4c5e0d31a6ed req-41cc116b-7ac1-4861-8828-4f8e840fce8d service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:05:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9261dc3d-9eed-4c8d-9020-4c5e0d31a6ed req-41cc116b-7ac1-4861-8828-4f8e840fce8d service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:05:36 user nova-compute[75378]: DEBUG nova.compute.manager [req-9261dc3d-9eed-4c8d-9020-4c5e0d31a6ed req-41cc116b-7ac1-4861-8828-4f8e840fce8d service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] No waiting events found dispatching network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:05:36 user nova-compute[75378]: WARNING nova.compute.manager [req-9261dc3d-9eed-4c8d-9020-4c5e0d31a6ed req-41cc116b-7ac1-4861-8828-4f8e840fce8d service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received unexpected event network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 09 04:05:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:38 user nova-compute[75378]: DEBUG nova.compute.manager [req-306e82b0-db10-432a-8648-71c45483f173 req-36064519-592d-46b5-ab8c-654b2ba6dfa1 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received event network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:05:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-306e82b0-db10-432a-8648-71c45483f173 req-36064519-592d-46b5-ab8c-654b2ba6dfa1 service nova] Acquiring lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:05:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-306e82b0-db10-432a-8648-71c45483f173 req-36064519-592d-46b5-ab8c-654b2ba6dfa1 service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:05:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-306e82b0-db10-432a-8648-71c45483f173 req-36064519-592d-46b5-ab8c-654b2ba6dfa1 service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:05:38 user nova-compute[75378]: DEBUG nova.compute.manager [req-306e82b0-db10-432a-8648-71c45483f173 req-36064519-592d-46b5-ab8c-654b2ba6dfa1 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] No waiting events found dispatching network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:05:38 user nova-compute[75378]: WARNING nova.compute.manager [req-306e82b0-db10-432a-8648-71c45483f173 req-36064519-592d-46b5-ab8c-654b2ba6dfa1 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received unexpected event network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 09 04:05:39 user nova-compute[75378]: DEBUG nova.compute.manager [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 04:05:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 04:05:39 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Instance spawned successfully.
Nov 09 04:05:39 user nova-compute[75378]: DEBUG nova.compute.manager [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:05:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-fadc5d7e-9838-407e-9add-e49aedabc8c3 tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "00959e75-7446-4ff6-be3e-56d7146b3576" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 32.030s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:05:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:43 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:05:43 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:05:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-a0a9882f-8b9f-4666-a9fe-0e23efd56616" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:05:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-a0a9882f-8b9f-4666-a9fe-0e23efd56616" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:05:43 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 04:05:43 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Updating instance_info_cache with network_info: [{"id": "8ee45305-d703-4e55-ac47-60d1407e2772", "address": "fa:16:3e:bb:23:47", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee45305-d7", "ovs_interfaceid": "8ee45305-d703-4e55-ac47-60d1407e2772", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:05:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-a0a9882f-8b9f-4666-a9fe-0e23efd56616" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:05:43 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 04:05:44 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:05:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:45 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:05:45 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:05:46 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:05:46 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:05:48 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:05:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:50 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:05:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:05:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:05:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:05:50 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:05:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:05:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:05:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:05:51 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:05:51 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:05:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8419MB free_disk=25.276885986328125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:05:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:05:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:05:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 2c2acb48-972a-41d7-987e-48e79b3bef93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:05:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance a0a9882f-8b9f-4666-a9fe-0e23efd56616 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:05:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 00959e75-7446-4ff6-be3e-56d7146b3576 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:05:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:05:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:05:51 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:05:51 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:05:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:05:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:05:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:05:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:05:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:05:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:05:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:05:52 user nova-compute[75378]: INFO nova.compute.manager [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Terminating instance
Nov 09 04:05:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:05:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:52 user nova-compute[75378]: DEBUG nova.compute.manager [req-a6b5bcd1-9b87-4883-9fb0-d0db6a9ed4e5 req-bde6279f-fe3a-4aba-b6d0-63e8c4cf65cb service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Received event network-vif-unplugged-8ee45305-d703-4e55-ac47-60d1407e2772 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:05:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a6b5bcd1-9b87-4883-9fb0-d0db6a9ed4e5 req-bde6279f-fe3a-4aba-b6d0-63e8c4cf65cb service nova] Acquiring lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:05:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a6b5bcd1-9b87-4883-9fb0-d0db6a9ed4e5 req-bde6279f-fe3a-4aba-b6d0-63e8c4cf65cb service nova] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:05:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a6b5bcd1-9b87-4883-9fb0-d0db6a9ed4e5 req-bde6279f-fe3a-4aba-b6d0-63e8c4cf65cb service nova] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.011s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:05:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-a6b5bcd1-9b87-4883-9fb0-d0db6a9ed4e5 req-bde6279f-fe3a-4aba-b6d0-63e8c4cf65cb service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] No waiting events found dispatching network-vif-unplugged-8ee45305-d703-4e55-ac47-60d1407e2772 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:05:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-a6b5bcd1-9b87-4883-9fb0-d0db6a9ed4e5 req-bde6279f-fe3a-4aba-b6d0-63e8c4cf65cb service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Received event network-vif-unplugged-8ee45305-d703-4e55-ac47-60d1407e2772 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:05:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:53 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Instance destroyed successfully.
Nov 09 04:05:53 user nova-compute[75378]: DEBUG nova.objects.instance [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lazy-loading 'resources' on Instance uuid a0a9882f-8b9f-4666-a9fe-0e23efd56616 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:05:53 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-188722783',display_name='tempest-AttachVolumeNegativeTest-server-188722783',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-188722783',id=40,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1TZH0O62HKjn0vS/q0MNFkPN9Q8NN0PnmzpccxUFD1gUV7esyKdOJtjvCw0DkXv7SIQv3bc2gnIztVd02s6M6H07C6yHyfWu2F/1OLcFFHxqvZCTPINes9LYKcwLvNLw==',key_name='tempest-keypair-1751897258',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:02:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d990b7b4c19436d8cd8f43d8d0facb9',ramdisk_id='',reservation_id='r-92o4kmoi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-921155549',owner_user_name='tempest-AttachVolumeNegativeTest-921155549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T04:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afcdb0627e34b6e893b7981ea4615e3',uuid=a0a9882f-8b9f-4666-a9fe-0e23efd56616,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ee45305-d703-4e55-ac47-60d1407e2772", "address": "fa:16:3e:bb:23:47", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee45305-d7", "ovs_interfaceid": "8ee45305-d703-4e55-ac47-60d1407e2772", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:05:53 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converting VIF {"id": "8ee45305-d703-4e55-ac47-60d1407e2772", "address": "fa:16:3e:bb:23:47", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee45305-d7", "ovs_interfaceid": "8ee45305-d703-4e55-ac47-60d1407e2772", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:05:53 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:23:47,bridge_name='br-int',has_traffic_filtering=True,id=8ee45305-d703-4e55-ac47-60d1407e2772,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee45305-d7') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:05:53 user nova-compute[75378]: DEBUG os_vif [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:23:47,bridge_name='br-int',has_traffic_filtering=True,id=8ee45305-d703-4e55-ac47-60d1407e2772,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee45305-d7') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:05:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ee45305-d7, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:05:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0102904-d72f-4717-b64e-a97ecd2e3107) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:05:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:53 user nova-compute[75378]: INFO os_vif [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:23:47,bridge_name='br-int',has_traffic_filtering=True,id=8ee45305-d703-4e55-ac47-60d1407e2772,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee45305-d7')
Nov 09 04:05:53 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Deleting instance files /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616_del
Nov 09 04:05:53 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Deletion of /opt/stack/data/nova/instances/a0a9882f-8b9f-4666-a9fe-0e23efd56616_del complete
Nov 09 04:05:53 user nova-compute[75378]: INFO nova.compute.manager [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 09 04:05:53 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:05:53 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:05:53 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:05:53 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:05:53 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:05:54 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Took 0.70 seconds to deallocate network for instance.
Nov 09 04:05:54 user nova-compute[75378]: DEBUG nova.compute.manager [req-69f9eb33-1dd8-41a8-b93e-c19958054915 req-84e54bd8-9af4-4ae8-9ace-0b586eba546f service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Received event network-vif-deleted-8ee45305-d703-4e55-ac47-60d1407e2772 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:05:54 user nova-compute[75378]: INFO nova.compute.manager [req-69f9eb33-1dd8-41a8-b93e-c19958054915 req-84e54bd8-9af4-4ae8-9ace-0b586eba546f service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Neutron deleted interface 8ee45305-d703-4e55-ac47-60d1407e2772; detaching it from the instance and deleting it from the info cache
Nov 09 04:05:54 user nova-compute[75378]: DEBUG nova.network.neutron [req-69f9eb33-1dd8-41a8-b93e-c19958054915 req-84e54bd8-9af4-4ae8-9ace-0b586eba546f service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:05:54 user nova-compute[75378]: DEBUG nova.compute.manager [req-69f9eb33-1dd8-41a8-b93e-c19958054915 req-84e54bd8-9af4-4ae8-9ace-0b586eba546f service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Detach interface failed, port_id=8ee45305-d703-4e55-ac47-60d1407e2772, reason: Instance a0a9882f-8b9f-4666-a9fe-0e23efd56616 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 04:05:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:05:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:05:54 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:05:54 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:05:54 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:05:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:05:54 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Deleted allocations for instance a0a9882f-8b9f-4666-a9fe-0e23efd56616
Nov 09 04:05:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7f87199a-0187-485e-94b3-40fb1694b98a tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.059s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:05:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-92a04b80-b2a1-4276-80f7-cbfcdb5e0f97 req-6528d3b9-cdc3-4582-ad08-cc92665818cd service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Received event network-vif-plugged-8ee45305-d703-4e55-ac47-60d1407e2772 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:05:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-92a04b80-b2a1-4276-80f7-cbfcdb5e0f97 req-6528d3b9-cdc3-4582-ad08-cc92665818cd service nova] Acquiring lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:05:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-92a04b80-b2a1-4276-80f7-cbfcdb5e0f97 req-6528d3b9-cdc3-4582-ad08-cc92665818cd service nova] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:05:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-92a04b80-b2a1-4276-80f7-cbfcdb5e0f97 req-6528d3b9-cdc3-4582-ad08-cc92665818cd service nova] Lock "a0a9882f-8b9f-4666-a9fe-0e23efd56616-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:05:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-92a04b80-b2a1-4276-80f7-cbfcdb5e0f97 req-6528d3b9-cdc3-4582-ad08-cc92665818cd service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] No waiting events found dispatching network-vif-plugged-8ee45305-d703-4e55-ac47-60d1407e2772 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:05:55 user nova-compute[75378]: WARNING nova.compute.manager [req-92a04b80-b2a1-4276-80f7-cbfcdb5e0f97 req-6528d3b9-cdc3-4582-ad08-cc92665818cd service nova] [instance: a0a9882f-8b9f-4666-a9fe-0e23efd56616] Received unexpected event network-vif-plugged-8ee45305-d703-4e55-ac47-60d1407e2772 for instance with vm_state deleted and task_state None.
Nov 09 04:05:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:05:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Acquiring lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG nova.compute.manager [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 04:06:13 user nova-compute[75378]: INFO nova.compute.claims [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Claim successful on node user
Nov 09 04:06:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG nova.compute.manager [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG nova.compute.manager [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG nova.network.neutron [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 04:06:13 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 04:06:13 user nova-compute[75378]: DEBUG nova.compute.manager [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG nova.policy [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5925b6900e6549c58b414a3438041195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b9133412a8747f2ab2c26619adff95a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG nova.compute.manager [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 04:06:13 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Creating image(s)
Nov 09 04:06:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "/opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "/opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.199s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.195s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk 1073741824" returned: 0 in 0.058s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:14 user nova-compute[75378]: DEBUG nova.network.neutron [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Successfully created port: 8136caa1-a38d-4c19-9c63-64f3e2be3794 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 04:06:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:14 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 04:06:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:14 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Cannot resize image /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 04:06:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 04:06:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Ensure instance console log exists: /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 04:06:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.network.neutron [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Successfully updated port: 8136caa1-a38d-4c19-9c63-64f3e2be3794 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Acquiring lock "refresh_cache-1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Acquired lock "refresh_cache-1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.network.neutron [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.compute.manager [req-4e83316b-df03-4f42-a56d-03f973fa0c74 req-40f3a099-97be-45cd-8654-ed452cef7906 service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Received event network-changed-8136caa1-a38d-4c19-9c63-64f3e2be3794 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.compute.manager [req-4e83316b-df03-4f42-a56d-03f973fa0c74 req-40f3a099-97be-45cd-8654-ed452cef7906 service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Refreshing instance network info cache due to event network-changed-8136caa1-a38d-4c19-9c63-64f3e2be3794. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4e83316b-df03-4f42-a56d-03f973fa0c74 req-40f3a099-97be-45cd-8654-ed452cef7906 service nova] Acquiring lock "refresh_cache-1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.network.neutron [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.network.neutron [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Updating instance_info_cache with network_info: [{"id": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "address": "fa:16:3e:da:50:7a", "network": {"id": "9b84419f-fb2f-455e-8788-7c8635dc5695", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-535897341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b9133412a8747f2ab2c26619adff95a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8136caa1-a3", "ovs_interfaceid": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Releasing lock "refresh_cache-1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.compute.manager [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Instance network_info: |[{"id": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "address": "fa:16:3e:da:50:7a", "network": {"id": "9b84419f-fb2f-455e-8788-7c8635dc5695", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-535897341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b9133412a8747f2ab2c26619adff95a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8136caa1-a3", "ovs_interfaceid": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4e83316b-df03-4f42-a56d-03f973fa0c74 req-40f3a099-97be-45cd-8654-ed452cef7906 service nova] Acquired lock "refresh_cache-1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.network.neutron [req-4e83316b-df03-4f42-a56d-03f973fa0c74 req-40f3a099-97be-45cd-8654-ed452cef7906 service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Refreshing network info cache for port 8136caa1-a38d-4c19-9c63-64f3e2be3794 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Start _get_guest_xml network_info=[{"id": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "address": "fa:16:3e:da:50:7a", "network": {"id": "9b84419f-fb2f-455e-8788-7c8635dc5695", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-535897341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b9133412a8747f2ab2c26619adff95a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8136caa1-a3", "ovs_interfaceid": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 04:06:15 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:06:15 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-708236328',display_name='tempest-SnapshotDataIntegrityTests-server-708236328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-708236328',id=41,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwiwjl5m88KX2C/xKxpTWv5pEOI4IlSj0vY53fLaYLUwKOVVR7mzKN0z7e+GOht18J7uLrXrQNY++ztWUOq5cQWZu5C/aeCwjYowggHuhfXe2JPk4eh1yi1Qzrp5JRrLQ==',key_name='tempest-keypair-6955039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b9133412a8747f2ab2c26619adff95a',ramdisk_id='',reservation_id='r-0dr50asb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1930868936',owner_user_name='tempest-SnapshotDataIntegrityTests-1930868936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5925b6900e6549c58b414a3438041195',uuid=1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "address": "fa:16:3e:da:50:7a", "network": {"id": "9b84419f-fb2f-455e-8788-7c8635dc5695", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-535897341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b9133412a8747f2ab2c26619adff95a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8136caa1-a3", "ovs_interfaceid": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Converting VIF {"id": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "address": "fa:16:3e:da:50:7a", "network": {"id": "9b84419f-fb2f-455e-8788-7c8635dc5695", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-535897341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b9133412a8747f2ab2c26619adff95a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8136caa1-a3", "ovs_interfaceid": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:50:7a,bridge_name='br-int',has_traffic_filtering=True,id=8136caa1-a38d-4c19-9c63-64f3e2be3794,network=Network(9b84419f-fb2f-455e-8788-7c8635dc5695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8136caa1-a3') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.objects.instance [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] End _get_guest_xml xml=<domain type="kvm">
Nov 09 04:06:15 user nova-compute[75378]:   <uuid>1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8</uuid>
Nov 09 04:06:15 user nova-compute[75378]:   <name>instance-00000029</name>
Nov 09 04:06:15 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 04:06:15 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 04:06:15 user nova-compute[75378]:   <metadata>
Nov 09 04:06:15 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 04:06:15 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 04:06:15 user nova-compute[75378]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-708236328</nova:name>
Nov 09 04:06:15 user nova-compute[75378]:       <nova:creationTime>2023-11-09 04:06:15</nova:creationTime>
Nov 09 04:06:15 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 04:06:15 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 04:06:15 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 04:06:15 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 04:06:15 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 04:06:15 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 04:06:15 user nova-compute[75378]:       </nova:flavor>
Nov 09 04:06:15 user nova-compute[75378]:       <nova:owner>
Nov 09 04:06:15 user nova-compute[75378]:         <nova:user uuid="5925b6900e6549c58b414a3438041195">tempest-SnapshotDataIntegrityTests-1930868936-project-member</nova:user>
Nov 09 04:06:15 user nova-compute[75378]:         <nova:project uuid="3b9133412a8747f2ab2c26619adff95a">tempest-SnapshotDataIntegrityTests-1930868936</nova:project>
Nov 09 04:06:15 user nova-compute[75378]:       </nova:owner>
Nov 09 04:06:15 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 04:06:15 user nova-compute[75378]:       <nova:ports>
Nov 09 04:06:15 user nova-compute[75378]:         <nova:port uuid="8136caa1-a38d-4c19-9c63-64f3e2be3794">
Nov 09 04:06:15 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 09 04:06:15 user nova-compute[75378]:         </nova:port>
Nov 09 04:06:15 user nova-compute[75378]:       </nova:ports>
Nov 09 04:06:15 user nova-compute[75378]:     </nova:instance>
Nov 09 04:06:15 user nova-compute[75378]:   </metadata>
Nov 09 04:06:15 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 04:06:15 user nova-compute[75378]:     <system>
Nov 09 04:06:15 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 04:06:15 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 04:06:15 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 04:06:15 user nova-compute[75378]:       <entry name="serial">1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8</entry>
Nov 09 04:06:15 user nova-compute[75378]:       <entry name="uuid">1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8</entry>
Nov 09 04:06:15 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 04:06:15 user nova-compute[75378]:     </system>
Nov 09 04:06:15 user nova-compute[75378]:   </sysinfo>
Nov 09 04:06:15 user nova-compute[75378]:   <os>
Nov 09 04:06:15 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 04:06:15 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 04:06:15 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 04:06:15 user nova-compute[75378]:   </os>
Nov 09 04:06:15 user nova-compute[75378]:   <features>
Nov 09 04:06:15 user nova-compute[75378]:     <acpi/>
Nov 09 04:06:15 user nova-compute[75378]:     <apic/>
Nov 09 04:06:15 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 04:06:15 user nova-compute[75378]:   </features>
Nov 09 04:06:15 user nova-compute[75378]:   <clock offset="utc">
Nov 09 04:06:15 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 04:06:15 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 04:06:15 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 04:06:15 user nova-compute[75378]:   </clock>
Nov 09 04:06:15 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 04:06:15 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 04:06:15 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 04:06:15 user nova-compute[75378]:   </cpu>
Nov 09 04:06:15 user nova-compute[75378]:   <devices>
Nov 09 04:06:15 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 04:06:15 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 04:06:15 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk"/>
Nov 09 04:06:15 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 04:06:15 user nova-compute[75378]:     </disk>
Nov 09 04:06:15 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 04:06:15 user nova-compute[75378]:       <mac address="fa:16:3e:da:50:7a"/>
Nov 09 04:06:15 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:06:15 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 04:06:15 user nova-compute[75378]:       <target dev="tap8136caa1-a3"/>
Nov 09 04:06:15 user nova-compute[75378]:     </interface>
Nov 09 04:06:15 user nova-compute[75378]:     <serial type="pty">
Nov 09 04:06:15 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/console.log" append="off"/>
Nov 09 04:06:15 user nova-compute[75378]:     </serial>
Nov 09 04:06:15 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 04:06:15 user nova-compute[75378]:     <video>
Nov 09 04:06:15 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:06:15 user nova-compute[75378]:     </video>
Nov 09 04:06:15 user nova-compute[75378]:     <rng model="virtio">
Nov 09 04:06:15 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 04:06:15 user nova-compute[75378]:     </rng>
Nov 09 04:06:15 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 04:06:15 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 04:06:15 user nova-compute[75378]:       <stats period="10"/>
Nov 09 04:06:15 user nova-compute[75378]:     </memballoon>
Nov 09 04:06:15 user nova-compute[75378]:   </devices>
Nov 09 04:06:15 user nova-compute[75378]: </domain>
Nov 09 04:06:15 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-708236328',display_name='tempest-SnapshotDataIntegrityTests-server-708236328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-708236328',id=41,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwiwjl5m88KX2C/xKxpTWv5pEOI4IlSj0vY53fLaYLUwKOVVR7mzKN0z7e+GOht18J7uLrXrQNY++ztWUOq5cQWZu5C/aeCwjYowggHuhfXe2JPk4eh1yi1Qzrp5JRrLQ==',key_name='tempest-keypair-6955039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b9133412a8747f2ab2c26619adff95a',ramdisk_id='',reservation_id='r-0dr50asb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1930868936',owner_user_name='tempest-SnapshotDataIntegrityTests-1930868936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5925b6900e6549c58b414a3438041195',uuid=1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "address": "fa:16:3e:da:50:7a", "network": {"id": "9b84419f-fb2f-455e-8788-7c8635dc5695", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-535897341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b9133412a8747f2ab2c26619adff95a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8136caa1-a3", "ovs_interfaceid": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Converting VIF {"id": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "address": "fa:16:3e:da:50:7a", "network": {"id": "9b84419f-fb2f-455e-8788-7c8635dc5695", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-535897341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b9133412a8747f2ab2c26619adff95a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8136caa1-a3", "ovs_interfaceid": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:50:7a,bridge_name='br-int',has_traffic_filtering=True,id=8136caa1-a38d-4c19-9c63-64f3e2be3794,network=Network(9b84419f-fb2f-455e-8788-7c8635dc5695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8136caa1-a3') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG os_vif [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:50:7a,bridge_name='br-int',has_traffic_filtering=True,id=8136caa1-a38d-4c19-9c63-64f3e2be3794,network=Network(9b84419f-fb2f-455e-8788-7c8635dc5695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8136caa1-a3') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72c9f493-631c-5bf2-a051-5afc97e00382', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8136caa1-a3, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8136caa1-a3, col_values=(('qos', UUID('ff8ae8f4-0daa-4971-b606-f3a4a861ffc4')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8136caa1-a3, col_values=(('external_ids', {'iface-id': '8136caa1-a38d-4c19-9c63-64f3e2be3794', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:50:7a', 'vm-uuid': '1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:15 user nova-compute[75378]: INFO os_vif [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:50:7a,bridge_name='br-int',has_traffic_filtering=True,id=8136caa1-a38d-4c19-9c63-64f3e2be3794,network=Network(9b84419f-fb2f-455e-8788-7c8635dc5695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8136caa1-a3')
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] No VIF found with MAC fa:16:3e:da:50:7a, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.network.neutron [req-4e83316b-df03-4f42-a56d-03f973fa0c74 req-40f3a099-97be-45cd-8654-ed452cef7906 service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Updated VIF entry in instance network info cache for port 8136caa1-a38d-4c19-9c63-64f3e2be3794. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:06:15 user nova-compute[75378]: DEBUG nova.network.neutron [req-4e83316b-df03-4f42-a56d-03f973fa0c74 req-40f3a099-97be-45cd-8654-ed452cef7906 service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Updating instance_info_cache with network_info: [{"id": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "address": "fa:16:3e:da:50:7a", "network": {"id": "9b84419f-fb2f-455e-8788-7c8635dc5695", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-535897341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b9133412a8747f2ab2c26619adff95a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8136caa1-a3", "ovs_interfaceid": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:06:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4e83316b-df03-4f42-a56d-03f973fa0c74 req-40f3a099-97be-45cd-8654-ed452cef7906 service nova] Releasing lock "refresh_cache-1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:06:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-bfc97a22-d48c-49fb-a589-bc8090aa2af5 req-da034b52-4d9e-4ee7-a973-00330b0821cf service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Received event network-vif-plugged-8136caa1-a38d-4c19-9c63-64f3e2be3794 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:06:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bfc97a22-d48c-49fb-a589-bc8090aa2af5 req-da034b52-4d9e-4ee7-a973-00330b0821cf service nova] Acquiring lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bfc97a22-d48c-49fb-a589-bc8090aa2af5 req-da034b52-4d9e-4ee7-a973-00330b0821cf service nova] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:17 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bfc97a22-d48c-49fb-a589-bc8090aa2af5 req-da034b52-4d9e-4ee7-a973-00330b0821cf service nova] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:17 user nova-compute[75378]: DEBUG nova.compute.manager [req-bfc97a22-d48c-49fb-a589-bc8090aa2af5 req-da034b52-4d9e-4ee7-a973-00330b0821cf service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] No waiting events found dispatching network-vif-plugged-8136caa1-a38d-4c19-9c63-64f3e2be3794 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:06:17 user nova-compute[75378]: WARNING nova.compute.manager [req-bfc97a22-d48c-49fb-a589-bc8090aa2af5 req-da034b52-4d9e-4ee7-a973-00330b0821cf service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Received unexpected event network-vif-plugged-8136caa1-a38d-4c19-9c63-64f3e2be3794 for instance with vm_state building and task_state spawning.
Nov 09 04:06:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-e79a38cd-f4c5-4881-818d-3b69445d0f48 req-c8b837f9-2c4a-4853-b91b-36a0fc7233df service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Received event network-vif-plugged-8136caa1-a38d-4c19-9c63-64f3e2be3794 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:06:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e79a38cd-f4c5-4881-818d-3b69445d0f48 req-c8b837f9-2c4a-4853-b91b-36a0fc7233df service nova] Acquiring lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e79a38cd-f4c5-4881-818d-3b69445d0f48 req-c8b837f9-2c4a-4853-b91b-36a0fc7233df service nova] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e79a38cd-f4c5-4881-818d-3b69445d0f48 req-c8b837f9-2c4a-4853-b91b-36a0fc7233df service nova] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:19 user nova-compute[75378]: DEBUG nova.compute.manager [req-e79a38cd-f4c5-4881-818d-3b69445d0f48 req-c8b837f9-2c4a-4853-b91b-36a0fc7233df service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] No waiting events found dispatching network-vif-plugged-8136caa1-a38d-4c19-9c63-64f3e2be3794 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:06:19 user nova-compute[75378]: WARNING nova.compute.manager [req-e79a38cd-f4c5-4881-818d-3b69445d0f48 req-c8b837f9-2c4a-4853-b91b-36a0fc7233df service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Received unexpected event network-vif-plugged-8136caa1-a38d-4c19-9c63-64f3e2be3794 for instance with vm_state building and task_state spawning.
Nov 09 04:06:19 user nova-compute[75378]: DEBUG nova.compute.manager [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 04:06:19 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 04:06:19 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Instance spawned successfully.
Nov 09 04:06:19 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 04:06:19 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:06:19 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:06:19 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:06:19 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:06:19 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:06:19 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:06:19 user nova-compute[75378]: INFO nova.compute.manager [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 09 04:06:19 user nova-compute[75378]: DEBUG nova.compute.manager [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:06:19 user nova-compute[75378]: INFO nova.compute.manager [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Took 6.57 seconds to build instance.
Nov 09 04:06:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-66aa877e-5baa-496c-a1ee-4eaed04e836c tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.682s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "2c2acb48-972a-41d7-987e-48e79b3bef93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "2c2acb48-972a-41d7-987e-48e79b3bef93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "2c2acb48-972a-41d7-987e-48e79b3bef93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "2c2acb48-972a-41d7-987e-48e79b3bef93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "2c2acb48-972a-41d7-987e-48e79b3bef93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:30 user nova-compute[75378]: INFO nova.compute.manager [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Terminating instance
Nov 09 04:06:30 user nova-compute[75378]: DEBUG nova.compute.manager [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG nova.compute.manager [req-505c0c7c-25e8-46f4-911e-673dbb42f8c1 req-551edbe0-27c8-4655-b10d-e8d6b9c530ea service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Received event network-vif-unplugged-70d7d7ee-d1e8-4b8c-981b-26394c1b1edc {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-505c0c7c-25e8-46f4-911e-673dbb42f8c1 req-551edbe0-27c8-4655-b10d-e8d6b9c530ea service nova] Acquiring lock "2c2acb48-972a-41d7-987e-48e79b3bef93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-505c0c7c-25e8-46f4-911e-673dbb42f8c1 req-551edbe0-27c8-4655-b10d-e8d6b9c530ea service nova] Lock "2c2acb48-972a-41d7-987e-48e79b3bef93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-505c0c7c-25e8-46f4-911e-673dbb42f8c1 req-551edbe0-27c8-4655-b10d-e8d6b9c530ea service nova] Lock "2c2acb48-972a-41d7-987e-48e79b3bef93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG nova.compute.manager [req-505c0c7c-25e8-46f4-911e-673dbb42f8c1 req-551edbe0-27c8-4655-b10d-e8d6b9c530ea service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] No waiting events found dispatching network-vif-unplugged-70d7d7ee-d1e8-4b8c-981b-26394c1b1edc {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG nova.compute.manager [req-505c0c7c-25e8-46f4-911e-673dbb42f8c1 req-551edbe0-27c8-4655-b10d-e8d6b9c530ea service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Received event network-vif-unplugged-70d7d7ee-d1e8-4b8c-981b-26394c1b1edc for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:30 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Instance destroyed successfully.
Nov 09 04:06:30 user nova-compute[75378]: DEBUG nova.objects.instance [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lazy-loading 'resources' on Instance uuid 2c2acb48-972a-41d7-987e-48e79b3bef93 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T03:45:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2036784727',display_name='tempest-ServerActionsTestOtherA-server-2036784727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2036784727',id=20,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFabS+mewwrg7oOEw/0EoMWlEwIz3NoSF6MUhLgvIEWjSZH9d/Fg8M+DuLJkZN6SKSXE9qeztuGxbDfpg7EHMNtmRvy2F5yoI+XGOsX3tR4ssTADXmphKv1NsnpmlrDrQg==',key_name='tempest-keypair-138130530',keypairs=<?>,launch_index=0,launched_at=2023-11-09T03:46:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='548993d280024b60b3778b026177e356',ramdisk_id='',reservation_id='r-aei2sweo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2010465588',owner_user_name='tempest-ServerActionsTestOtherA-2010465588-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T03:46:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d4f0858695e4509a6b0ab99a8212571',uuid=2c2acb48-972a-41d7-987e-48e79b3bef93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "address": "fa:16:3e:02:bc:fb", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d7d7ee-d1", "ovs_interfaceid": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converting VIF {"id": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "address": "fa:16:3e:02:bc:fb", "network": {"id": "ae8543c2-ace9-46dd-9348-959f07df0e1d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1061624576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "548993d280024b60b3778b026177e356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d7d7ee-d1", "ovs_interfaceid": "70d7d7ee-d1e8-4b8c-981b-26394c1b1edc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:bc:fb,bridge_name='br-int',has_traffic_filtering=True,id=70d7d7ee-d1e8-4b8c-981b-26394c1b1edc,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d7d7ee-d1') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG os_vif [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:bc:fb,bridge_name='br-int',has_traffic_filtering=True,id=70d7d7ee-d1e8-4b8c-981b-26394c1b1edc,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d7d7ee-d1') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70d7d7ee-d1, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5ad3942-2cf3-41d2-9724-6986e3d79b5a) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:30 user nova-compute[75378]: INFO os_vif [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:bc:fb,bridge_name='br-int',has_traffic_filtering=True,id=70d7d7ee-d1e8-4b8c-981b-26394c1b1edc,network=Network(ae8543c2-ace9-46dd-9348-959f07df0e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d7d7ee-d1')
Nov 09 04:06:31 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Deleting instance files /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93_del
Nov 09 04:06:31 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Deletion of /opt/stack/data/nova/instances/2c2acb48-972a-41d7-987e-48e79b3bef93_del complete
Nov 09 04:06:31 user nova-compute[75378]: INFO nova.compute.manager [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 09 04:06:31 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:06:31 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:06:31 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:06:31 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:06:31 user nova-compute[75378]: DEBUG nova.compute.manager [req-6df6c5f5-9d0d-4778-9df4-a0d11ea029ff req-74ce4d44-c566-4721-913d-96ef0ef81188 service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Received event network-vif-deleted-70d7d7ee-d1e8-4b8c-981b-26394c1b1edc {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:06:31 user nova-compute[75378]: INFO nova.compute.manager [req-6df6c5f5-9d0d-4778-9df4-a0d11ea029ff req-74ce4d44-c566-4721-913d-96ef0ef81188 service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Neutron deleted interface 70d7d7ee-d1e8-4b8c-981b-26394c1b1edc; detaching it from the instance and deleting it from the info cache
Nov 09 04:06:31 user nova-compute[75378]: DEBUG nova.network.neutron [req-6df6c5f5-9d0d-4778-9df4-a0d11ea029ff req-74ce4d44-c566-4721-913d-96ef0ef81188 service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:06:31 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Took 0.46 seconds to deallocate network for instance.
Nov 09 04:06:31 user nova-compute[75378]: DEBUG nova.compute.manager [req-6df6c5f5-9d0d-4778-9df4-a0d11ea029ff req-74ce4d44-c566-4721-913d-96ef0ef81188 service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Detach interface failed, port_id=70d7d7ee-d1e8-4b8c-981b-26394c1b1edc, reason: Instance 2c2acb48-972a-41d7-987e-48e79b3bef93 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 04:06:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:31 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:06:31 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:06:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:31 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Deleted allocations for instance 2c2acb48-972a-41d7-987e-48e79b3bef93
Nov 09 04:06:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a6a0b083-a8dd-43b9-810e-94aa5d43c6a8 tempest-ServerActionsTestOtherA-2010465588 tempest-ServerActionsTestOtherA-2010465588-project-member] Lock "2c2acb48-972a-41d7-987e-48e79b3bef93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.774s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:32 user nova-compute[75378]: DEBUG nova.compute.manager [req-0220ef12-4378-45c9-8b9c-6620096b5a2e req-11d3595a-b4d4-44c8-b76f-607d35d448fe service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Received event network-vif-plugged-70d7d7ee-d1e8-4b8c-981b-26394c1b1edc {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:06:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0220ef12-4378-45c9-8b9c-6620096b5a2e req-11d3595a-b4d4-44c8-b76f-607d35d448fe service nova] Acquiring lock "2c2acb48-972a-41d7-987e-48e79b3bef93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0220ef12-4378-45c9-8b9c-6620096b5a2e req-11d3595a-b4d4-44c8-b76f-607d35d448fe service nova] Lock "2c2acb48-972a-41d7-987e-48e79b3bef93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0220ef12-4378-45c9-8b9c-6620096b5a2e req-11d3595a-b4d4-44c8-b76f-607d35d448fe service nova] Lock "2c2acb48-972a-41d7-987e-48e79b3bef93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:32 user nova-compute[75378]: DEBUG nova.compute.manager [req-0220ef12-4378-45c9-8b9c-6620096b5a2e req-11d3595a-b4d4-44c8-b76f-607d35d448fe service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] No waiting events found dispatching network-vif-plugged-70d7d7ee-d1e8-4b8c-981b-26394c1b1edc {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:06:32 user nova-compute[75378]: WARNING nova.compute.manager [req-0220ef12-4378-45c9-8b9c-6620096b5a2e req-11d3595a-b4d4-44c8-b76f-607d35d448fe service nova] [instance: 2c2acb48-972a-41d7-987e-48e79b3bef93] Received unexpected event network-vif-plugged-70d7d7ee-d1e8-4b8c-981b-26394c1b1edc for instance with vm_state deleted and task_state None.
Nov 09 04:06:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:45 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:06:45 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:06:45 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Rebuilding the list of instances to heal {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 04:06:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:06:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:06:45 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 04:06:45 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lazy-loading 'info_cache' on Instance uuid 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:06:45 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Updating instance_info_cache with network_info: [{"id": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "address": "fa:16:3e:da:50:7a", "network": {"id": "9b84419f-fb2f-455e-8788-7c8635dc5695", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-535897341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b9133412a8747f2ab2c26619adff95a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8136caa1-a3", "ovs_interfaceid": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "8182b18c-8741-46b8-a431-269289955be4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "8182b18c-8741-46b8-a431-269289955be4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 04:06:46 user nova-compute[75378]: INFO nova.compute.claims [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Claim successful on node user
Nov 09 04:06:46 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.271s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 04:06:46 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 04:06:46 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG nova.policy [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2afcdb0627e34b6e893b7981ea4615e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d990b7b4c19436d8cd8f43d8d0facb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 04:06:46 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Creating image(s)
Nov 09 04:06:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "/opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "/opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "/opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:46 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.193s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.169s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk 1073741824" returned: 0 in 0.069s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Successfully created port: bd3e4c98-1f54-4074-b993-a1ee9a124bf2 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.174s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Cannot resize image /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Ensure instance console log exists: /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Successfully updated port: bd3e4c98-1f54-4074-b993-a1ee9a124bf2 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "refresh_cache-8182b18c-8741-46b8-a431-269289955be4" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquired lock "refresh_cache-8182b18c-8741-46b8-a431-269289955be4" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:06:47 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.compute.manager [req-4ac3b0e2-e608-433d-bfc2-a6fb96ef5ce0 req-548f5d26-4792-4ba7-9444-37a57d492764 service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] Received event network-changed-bd3e4c98-1f54-4074-b993-a1ee9a124bf2 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.compute.manager [req-4ac3b0e2-e608-433d-bfc2-a6fb96ef5ce0 req-548f5d26-4792-4ba7-9444-37a57d492764 service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] Refreshing instance network info cache due to event network-changed-bd3e4c98-1f54-4074-b993-a1ee9a124bf2. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4ac3b0e2-e608-433d-bfc2-a6fb96ef5ce0 req-548f5d26-4792-4ba7-9444-37a57d492764 service nova] Acquiring lock "refresh_cache-8182b18c-8741-46b8-a431-269289955be4" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Updating instance_info_cache with network_info: [{"id": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "address": "fa:16:3e:83:19:2a", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3e4c98-1f", "ovs_interfaceid": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Releasing lock "refresh_cache-8182b18c-8741-46b8-a431-269289955be4" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Instance network_info: |[{"id": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "address": "fa:16:3e:83:19:2a", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3e4c98-1f", "ovs_interfaceid": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4ac3b0e2-e608-433d-bfc2-a6fb96ef5ce0 req-548f5d26-4792-4ba7-9444-37a57d492764 service nova] Acquired lock "refresh_cache-8182b18c-8741-46b8-a431-269289955be4" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.network.neutron [req-4ac3b0e2-e608-433d-bfc2-a6fb96ef5ce0 req-548f5d26-4792-4ba7-9444-37a57d492764 service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] Refreshing network info cache for port bd3e4c98-1f54-4074-b993-a1ee9a124bf2 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Start _get_guest_xml network_info=[{"id": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "address": "fa:16:3e:83:19:2a", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3e4c98-1f", "ovs_interfaceid": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 04:06:48 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:06:48 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:06:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-776302532',display_name='tempest-AttachVolumeNegativeTest-server-776302532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-776302532',id=42,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI73Q9R6unwMr8QUouMdi+QYHxHeooHiCqdf60WuaDVjq2G4UpsYcyK4hncxD7ABYgwkODi9ZTmVge+ijzX3SObnao3lFft+VChT7M1IUDRMnVb7Ovn9NJWf4zKJHQdRGQ==',key_name='tempest-keypair-757121100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d990b7b4c19436d8cd8f43d8d0facb9',ramdisk_id='',reservation_id='r-0jm8wgab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-921155549',owner_user_name='tempest-AttachVolumeNegativeTest-921155549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:06:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afcdb0627e34b6e893b7981ea4615e3',uuid=8182b18c-8741-46b8-a431-269289955be4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "address": "fa:16:3e:83:19:2a", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3e4c98-1f", "ovs_interfaceid": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converting VIF {"id": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "address": "fa:16:3e:83:19:2a", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3e4c98-1f", "ovs_interfaceid": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:19:2a,bridge_name='br-int',has_traffic_filtering=True,id=bd3e4c98-1f54-4074-b993-a1ee9a124bf2,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd3e4c98-1f') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.objects.instance [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lazy-loading 'pci_devices' on Instance uuid 8182b18c-8741-46b8-a431-269289955be4 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] End _get_guest_xml xml=<domain type="kvm">
Nov 09 04:06:48 user nova-compute[75378]:   <uuid>8182b18c-8741-46b8-a431-269289955be4</uuid>
Nov 09 04:06:48 user nova-compute[75378]:   <name>instance-0000002a</name>
Nov 09 04:06:48 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 04:06:48 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 04:06:48 user nova-compute[75378]:   <metadata>
Nov 09 04:06:48 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 04:06:48 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 04:06:48 user nova-compute[75378]:       <nova:name>tempest-AttachVolumeNegativeTest-server-776302532</nova:name>
Nov 09 04:06:48 user nova-compute[75378]:       <nova:creationTime>2023-11-09 04:06:48</nova:creationTime>
Nov 09 04:06:48 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 04:06:48 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 04:06:48 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 04:06:48 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 04:06:48 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 04:06:48 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 04:06:48 user nova-compute[75378]:       </nova:flavor>
Nov 09 04:06:48 user nova-compute[75378]:       <nova:owner>
Nov 09 04:06:48 user nova-compute[75378]:         <nova:user uuid="2afcdb0627e34b6e893b7981ea4615e3">tempest-AttachVolumeNegativeTest-921155549-project-member</nova:user>
Nov 09 04:06:48 user nova-compute[75378]:         <nova:project uuid="6d990b7b4c19436d8cd8f43d8d0facb9">tempest-AttachVolumeNegativeTest-921155549</nova:project>
Nov 09 04:06:48 user nova-compute[75378]:       </nova:owner>
Nov 09 04:06:48 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 04:06:48 user nova-compute[75378]:       <nova:ports>
Nov 09 04:06:48 user nova-compute[75378]:         <nova:port uuid="bd3e4c98-1f54-4074-b993-a1ee9a124bf2">
Nov 09 04:06:48 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 04:06:48 user nova-compute[75378]:         </nova:port>
Nov 09 04:06:48 user nova-compute[75378]:       </nova:ports>
Nov 09 04:06:48 user nova-compute[75378]:     </nova:instance>
Nov 09 04:06:48 user nova-compute[75378]:   </metadata>
Nov 09 04:06:48 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 04:06:48 user nova-compute[75378]:     <system>
Nov 09 04:06:48 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 04:06:48 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 04:06:48 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 04:06:48 user nova-compute[75378]:       <entry name="serial">8182b18c-8741-46b8-a431-269289955be4</entry>
Nov 09 04:06:48 user nova-compute[75378]:       <entry name="uuid">8182b18c-8741-46b8-a431-269289955be4</entry>
Nov 09 04:06:48 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 04:06:48 user nova-compute[75378]:     </system>
Nov 09 04:06:48 user nova-compute[75378]:   </sysinfo>
Nov 09 04:06:48 user nova-compute[75378]:   <os>
Nov 09 04:06:48 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 04:06:48 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 04:06:48 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 04:06:48 user nova-compute[75378]:   </os>
Nov 09 04:06:48 user nova-compute[75378]:   <features>
Nov 09 04:06:48 user nova-compute[75378]:     <acpi/>
Nov 09 04:06:48 user nova-compute[75378]:     <apic/>
Nov 09 04:06:48 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 04:06:48 user nova-compute[75378]:   </features>
Nov 09 04:06:48 user nova-compute[75378]:   <clock offset="utc">
Nov 09 04:06:48 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 04:06:48 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 04:06:48 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 04:06:48 user nova-compute[75378]:   </clock>
Nov 09 04:06:48 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 04:06:48 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 04:06:48 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 04:06:48 user nova-compute[75378]:   </cpu>
Nov 09 04:06:48 user nova-compute[75378]:   <devices>
Nov 09 04:06:48 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 04:06:48 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 04:06:48 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk"/>
Nov 09 04:06:48 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 04:06:48 user nova-compute[75378]:     </disk>
Nov 09 04:06:48 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 04:06:48 user nova-compute[75378]:       <mac address="fa:16:3e:83:19:2a"/>
Nov 09 04:06:48 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:06:48 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 04:06:48 user nova-compute[75378]:       <target dev="tapbd3e4c98-1f"/>
Nov 09 04:06:48 user nova-compute[75378]:     </interface>
Nov 09 04:06:48 user nova-compute[75378]:     <serial type="pty">
Nov 09 04:06:48 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/console.log" append="off"/>
Nov 09 04:06:48 user nova-compute[75378]:     </serial>
Nov 09 04:06:48 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 04:06:48 user nova-compute[75378]:     <video>
Nov 09 04:06:48 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:06:48 user nova-compute[75378]:     </video>
Nov 09 04:06:48 user nova-compute[75378]:     <rng model="virtio">
Nov 09 04:06:48 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 04:06:48 user nova-compute[75378]:     </rng>
Nov 09 04:06:48 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 04:06:48 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 04:06:48 user nova-compute[75378]:       <stats period="10"/>
Nov 09 04:06:48 user nova-compute[75378]:     </memballoon>
Nov 09 04:06:48 user nova-compute[75378]:   </devices>
Nov 09 04:06:48 user nova-compute[75378]: </domain>
Nov 09 04:06:48 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:06:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-776302532',display_name='tempest-AttachVolumeNegativeTest-server-776302532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-776302532',id=42,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI73Q9R6unwMr8QUouMdi+QYHxHeooHiCqdf60WuaDVjq2G4UpsYcyK4hncxD7ABYgwkODi9ZTmVge+ijzX3SObnao3lFft+VChT7M1IUDRMnVb7Ovn9NJWf4zKJHQdRGQ==',key_name='tempest-keypair-757121100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d990b7b4c19436d8cd8f43d8d0facb9',ramdisk_id='',reservation_id='r-0jm8wgab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-921155549',owner_user_name='tempest-AttachVolumeNegativeTest-921155549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:06:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afcdb0627e34b6e893b7981ea4615e3',uuid=8182b18c-8741-46b8-a431-269289955be4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "address": "fa:16:3e:83:19:2a", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3e4c98-1f", "ovs_interfaceid": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converting VIF {"id": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "address": "fa:16:3e:83:19:2a", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3e4c98-1f", "ovs_interfaceid": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:19:2a,bridge_name='br-int',has_traffic_filtering=True,id=bd3e4c98-1f54-4074-b993-a1ee9a124bf2,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd3e4c98-1f') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG os_vif [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:19:2a,bridge_name='br-int',has_traffic_filtering=True,id=bd3e4c98-1f54-4074-b993-a1ee9a124bf2,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd3e4c98-1f') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f0afc53-2a8b-5d62-9ed6-ae5b8344792e', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd3e4c98-1f, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd3e4c98-1f, col_values=(('qos', UUID('b078d5ce-cf06-4569-a690-3afae49b3c99')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd3e4c98-1f, col_values=(('external_ids', {'iface-id': 'bd3e4c98-1f54-4074-b993-a1ee9a124bf2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:19:2a', 'vm-uuid': '8182b18c-8741-46b8-a431-269289955be4'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:48 user nova-compute[75378]: INFO os_vif [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:19:2a,bridge_name='br-int',has_traffic_filtering=True,id=bd3e4c98-1f54-4074-b993-a1ee9a124bf2,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd3e4c98-1f')
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] No VIF found with MAC fa:16:3e:83:19:2a, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.network.neutron [req-4ac3b0e2-e608-433d-bfc2-a6fb96ef5ce0 req-548f5d26-4792-4ba7-9444-37a57d492764 service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] Updated VIF entry in instance network info cache for port bd3e4c98-1f54-4074-b993-a1ee9a124bf2. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG nova.network.neutron [req-4ac3b0e2-e608-433d-bfc2-a6fb96ef5ce0 req-548f5d26-4792-4ba7-9444-37a57d492764 service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] Updating instance_info_cache with network_info: [{"id": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "address": "fa:16:3e:83:19:2a", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3e4c98-1f", "ovs_interfaceid": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:06:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4ac3b0e2-e608-433d-bfc2-a6fb96ef5ce0 req-548f5d26-4792-4ba7-9444-37a57d492764 service nova] Releasing lock "refresh_cache-8182b18c-8741-46b8-a431-269289955be4" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:06:49 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:06:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-9f36d0e6-7249-4345-8081-cde024e5738b req-bfece0d7-8085-4460-9d51-2715c7578768 service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] Received event network-vif-plugged-bd3e4c98-1f54-4074-b993-a1ee9a124bf2 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:06:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9f36d0e6-7249-4345-8081-cde024e5738b req-bfece0d7-8085-4460-9d51-2715c7578768 service nova] Acquiring lock "8182b18c-8741-46b8-a431-269289955be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9f36d0e6-7249-4345-8081-cde024e5738b req-bfece0d7-8085-4460-9d51-2715c7578768 service nova] Lock "8182b18c-8741-46b8-a431-269289955be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9f36d0e6-7249-4345-8081-cde024e5738b req-bfece0d7-8085-4460-9d51-2715c7578768 service nova] Lock "8182b18c-8741-46b8-a431-269289955be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-9f36d0e6-7249-4345-8081-cde024e5738b req-bfece0d7-8085-4460-9d51-2715c7578768 service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] No waiting events found dispatching network-vif-plugged-bd3e4c98-1f54-4074-b993-a1ee9a124bf2 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:06:50 user nova-compute[75378]: WARNING nova.compute.manager [req-9f36d0e6-7249-4345-8081-cde024e5738b req-bfece0d7-8085-4460-9d51-2715c7578768 service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] Received unexpected event network-vif-plugged-bd3e4c98-1f54-4074-b993-a1ee9a124bf2 for instance with vm_state building and task_state spawning.
Nov 09 04:06:50 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:06:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:50 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:06:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:06:51 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:06:51 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:06:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8589MB free_disk=25.299564361572266GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:06:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 00959e75-7446-4ff6-be3e-56d7146b3576 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:06:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:06:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 8182b18c-8741-46b8-a431-269289955be4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:06:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:06:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:06:51 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:06:51 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:06:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:06:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 04:06:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 04:06:52 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 8182b18c-8741-46b8-a431-269289955be4] Instance spawned successfully.
Nov 09 04:06:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 04:06:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:06:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:06:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:06:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:06:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:06:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:06:52 user nova-compute[75378]: INFO nova.compute.manager [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 09 04:06:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:06:52 user nova-compute[75378]: DEBUG nova.compute.manager [req-8c0f1a96-8e7b-47b9-bbc4-0cbb80bb7518 req-5fadcb49-ddf4-4ea7-ac96-72bdb7a2d7ea service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] Received event network-vif-plugged-bd3e4c98-1f54-4074-b993-a1ee9a124bf2 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:06:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8c0f1a96-8e7b-47b9-bbc4-0cbb80bb7518 req-5fadcb49-ddf4-4ea7-ac96-72bdb7a2d7ea service nova] Acquiring lock "8182b18c-8741-46b8-a431-269289955be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8c0f1a96-8e7b-47b9-bbc4-0cbb80bb7518 req-5fadcb49-ddf4-4ea7-ac96-72bdb7a2d7ea service nova] Lock "8182b18c-8741-46b8-a431-269289955be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8c0f1a96-8e7b-47b9-bbc4-0cbb80bb7518 req-5fadcb49-ddf4-4ea7-ac96-72bdb7a2d7ea service nova] Lock "8182b18c-8741-46b8-a431-269289955be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:52 user nova-compute[75378]: DEBUG nova.compute.manager [req-8c0f1a96-8e7b-47b9-bbc4-0cbb80bb7518 req-5fadcb49-ddf4-4ea7-ac96-72bdb7a2d7ea service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] No waiting events found dispatching network-vif-plugged-bd3e4c98-1f54-4074-b993-a1ee9a124bf2 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:06:52 user nova-compute[75378]: WARNING nova.compute.manager [req-8c0f1a96-8e7b-47b9-bbc4-0cbb80bb7518 req-5fadcb49-ddf4-4ea7-ac96-72bdb7a2d7ea service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] Received unexpected event network-vif-plugged-bd3e4c98-1f54-4074-b993-a1ee9a124bf2 for instance with vm_state active and task_state None.
Nov 09 04:06:52 user nova-compute[75378]: INFO nova.compute.manager [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Took 5.99 seconds to build instance.
Nov 09 04:06:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9fb95b33-9d7e-493c-9fd9-e57cc79a4d21 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "8182b18c-8741-46b8-a431-269289955be4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.089s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:55 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:06:55 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:06:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:58 user nova-compute[75378]: DEBUG nova.compute.manager [req-bba412d1-5e5b-486a-9b9f-dbaff12f032b req-0e88f026-7585-4fb0-9971-86aa74fd0c2b service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received event network-changed-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:06:58 user nova-compute[75378]: DEBUG nova.compute.manager [req-bba412d1-5e5b-486a-9b9f-dbaff12f032b req-0e88f026-7585-4fb0-9971-86aa74fd0c2b service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Refreshing instance network info cache due to event network-changed-bd706a0c-ba99-42b7-bf21-898a277c3541. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:06:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bba412d1-5e5b-486a-9b9f-dbaff12f032b req-0e88f026-7585-4fb0-9971-86aa74fd0c2b service nova] Acquiring lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:06:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bba412d1-5e5b-486a-9b9f-dbaff12f032b req-0e88f026-7585-4fb0-9971-86aa74fd0c2b service nova] Acquired lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:06:58 user nova-compute[75378]: DEBUG nova.network.neutron [req-bba412d1-5e5b-486a-9b9f-dbaff12f032b req-0e88f026-7585-4fb0-9971-86aa74fd0c2b service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Refreshing network info cache for port bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:06:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquiring lock "00959e75-7446-4ff6-be3e-56d7146b3576" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "00959e75-7446-4ff6-be3e-56d7146b3576" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquiring lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:06:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:06:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:06:58 user nova-compute[75378]: INFO nova.compute.manager [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Terminating instance
Nov 09 04:06:58 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:06:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:58 user nova-compute[75378]: DEBUG nova.network.neutron [req-bba412d1-5e5b-486a-9b9f-dbaff12f032b req-0e88f026-7585-4fb0-9971-86aa74fd0c2b service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Updated VIF entry in instance network info cache for port bd706a0c-ba99-42b7-bf21-898a277c3541. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:06:58 user nova-compute[75378]: DEBUG nova.network.neutron [req-bba412d1-5e5b-486a-9b9f-dbaff12f032b req-0e88f026-7585-4fb0-9971-86aa74fd0c2b service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Updating instance_info_cache with network_info: [{"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:06:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bba412d1-5e5b-486a-9b9f-dbaff12f032b req-0e88f026-7585-4fb0-9971-86aa74fd0c2b service nova] Releasing lock "refresh_cache-00959e75-7446-4ff6-be3e-56d7146b3576" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:06:59 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Instance destroyed successfully.
Nov 09 04:06:59 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lazy-loading 'resources' on Instance uuid 00959e75-7446-4ff6-be3e-56d7146b3576 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T04:01:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1994468493',display_name='tempest-TestShelveInstance-server-1994468493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1994468493',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCm0omUjoHyl4PvBkF16sxOWjYLeE1jTtpfJdDjNGvyhYeGuWjjLfukGm/WTTPWNWVyCXy66zTOjquQm5tfvYMzeICuPOlLbQx91KPbah5m5G55l9OSLgMebWgd7GFg0Hw==',key_name='tempest-TestShelveInstance-1433736735',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:05:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='473b18add01440c082dbe9f1503b075d',ramdisk_id='',reservation_id='r-0nv92eqt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-32995184',owner_user_name='tempest-TestShelveInstance-32995184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T04:05:39Z,user_data=None,user_id='931191283d604e2a91bd3e4daceedebf',uuid=00959e75-7446-4ff6-be3e-56d7146b3576,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Converting VIF {"id": "bd706a0c-ba99-42b7-bf21-898a277c3541", "address": "fa:16:3e:16:4d:6f", "network": {"id": "e2b2cd72-bdd1-484a-ace3-25029da9ac29", "bridge": "br-int", "label": "tempest-TestShelveInstance-1914745075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "473b18add01440c082dbe9f1503b075d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd706a0c-ba", "ovs_interfaceid": "bd706a0c-ba99-42b7-bf21-898a277c3541", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:4d:6f,bridge_name='br-int',has_traffic_filtering=True,id=bd706a0c-ba99-42b7-bf21-898a277c3541,network=Network(e2b2cd72-bdd1-484a-ace3-25029da9ac29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd706a0c-ba') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_vif [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4d:6f,bridge_name='br-int',has_traffic_filtering=True,id=bd706a0c-ba99-42b7-bf21-898a277c3541,network=Network(e2b2cd72-bdd1-484a-ace3-25029da9ac29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd706a0c-ba') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd706a0c-ba, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29f7ea1e-475e-4fe6-a5d7-4c96d65921ef) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:06:59 user nova-compute[75378]: INFO os_vif [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:4d:6f,bridge_name='br-int',has_traffic_filtering=True,id=bd706a0c-ba99-42b7-bf21-898a277c3541,network=Network(e2b2cd72-bdd1-484a-ace3-25029da9ac29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd706a0c-ba')
Nov 09 04:06:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abmGJcwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:06:59 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b54d86a-16fc-4e4f-b2d4-40779999abd2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 04:06:59 user nova-compute[75378]: No targets found.
Nov 09 04:06:59 user nova-compute[75378]: iSNS:
Nov 09 04:06:59 user nova-compute[75378]: No targets found.
Nov 09 04:06:59 user nova-compute[75378]: STATIC:
Nov 09 04:06:59 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d
Nov 09 04:06:59 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:06:59 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:06:59 user nova-compute[75378]: FIRMWARE:
Nov 09 04:06:59 user nova-compute[75378]: No targets found.
Nov 09 04:06:59 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 04:06:59 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 04:06:59 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5580a5-4124-46a1-82da-dbe397647084]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce3519a-a4f8-4a35-8820-6079c99054e8]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d (non-flash)
Nov 09 04:06:59 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d (non-flash)
Nov 09 04:06:59 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c6b0040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d'): ({'sdb'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Removing single pathed devices sdb {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e847746-5f5c-4aa0-8334-10763bb2a3dd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[db360afd-1ae6-4340-8ae8-afd8a38fd97e]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Flushing IO for device /dev/sdb {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[655cfa47-83ef-465c-9e00-cb635f52f314]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6e5dab-8828-44d6-9f9e-51d4292bc205]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_64a76e10', '/dev/disk/by-id/scsi-23431643333626231', '/dev/disk/by-id/scsi-1SCST_BIO64a76e10-41d33bb1d596371a') {{(pid=87049) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e926ac0-8c0e-4ee2-bb35-bfc90849ed0c]: (4, None) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c6a40b-3e6b-4a47-ab53-8ef3e5d9bb9c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac96e34d-a036-412c-bd94-3014b3b787d1]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d, portal: 172.16.0.220,3260]
Nov 09 04:06:59 user nova-compute[75378]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d, portal: 172.16.0.220,3260] successful.
Nov 09 04:06:59 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:073fc7a9-2698-4f96-888c-170888571f4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3190737e-6e89-4daa-aa16-8d585a13713b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] <== disconnect_volume: return (325ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 04:06:59 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Deleting instance files /opt/stack/data/nova/instances/00959e75-7446-4ff6-be3e-56d7146b3576_del
Nov 09 04:06:59 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Deletion of /opt/stack/data/nova/instances/00959e75-7446-4ff6-be3e-56d7146b3576_del complete
Nov 09 04:06:59 user nova-compute[75378]: INFO nova.compute.manager [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 09 04:06:59 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:06:59 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:07:00 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:07:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-7b55cfab-337c-4acf-b6c2-81d7548a818c req-3dfb7185-030b-46c2-ae0c-5e239964cd70 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received event network-vif-deleted-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:07:00 user nova-compute[75378]: INFO nova.compute.manager [req-7b55cfab-337c-4acf-b6c2-81d7548a818c req-3dfb7185-030b-46c2-ae0c-5e239964cd70 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Neutron deleted interface bd706a0c-ba99-42b7-bf21-898a277c3541; detaching it from the instance and deleting it from the info cache
Nov 09 04:07:00 user nova-compute[75378]: DEBUG nova.network.neutron [req-7b55cfab-337c-4acf-b6c2-81d7548a818c req-3dfb7185-030b-46c2-ae0c-5e239964cd70 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:07:00 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Took 0.59 seconds to deallocate network for instance.
Nov 09 04:07:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-7b55cfab-337c-4acf-b6c2-81d7548a818c req-3dfb7185-030b-46c2-ae0c-5e239964cd70 service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Detach interface failed, port_id=bd706a0c-ba99-42b7-bf21-898a277c3541, reason: Instance 00959e75-7446-4ff6-be3e-56d7146b3576 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 04:07:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-364341a2-cf55-4dcd-99cb-72d8207613c7 req-156ce1c4-71ad-41e4-97a7-471ccf79e52e service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received event network-vif-unplugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:07:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-364341a2-cf55-4dcd-99cb-72d8207613c7 req-156ce1c4-71ad-41e4-97a7-471ccf79e52e service nova] Acquiring lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:07:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-364341a2-cf55-4dcd-99cb-72d8207613c7 req-156ce1c4-71ad-41e4-97a7-471ccf79e52e service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:07:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-364341a2-cf55-4dcd-99cb-72d8207613c7 req-156ce1c4-71ad-41e4-97a7-471ccf79e52e service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:07:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-364341a2-cf55-4dcd-99cb-72d8207613c7 req-156ce1c4-71ad-41e4-97a7-471ccf79e52e service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] No waiting events found dispatching network-vif-unplugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:07:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-364341a2-cf55-4dcd-99cb-72d8207613c7 req-156ce1c4-71ad-41e4-97a7-471ccf79e52e service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received event network-vif-unplugged-bd706a0c-ba99-42b7-bf21-898a277c3541 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:07:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-364341a2-cf55-4dcd-99cb-72d8207613c7 req-156ce1c4-71ad-41e4-97a7-471ccf79e52e service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received event network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:07:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-364341a2-cf55-4dcd-99cb-72d8207613c7 req-156ce1c4-71ad-41e4-97a7-471ccf79e52e service nova] Acquiring lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:07:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-364341a2-cf55-4dcd-99cb-72d8207613c7 req-156ce1c4-71ad-41e4-97a7-471ccf79e52e service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:07:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-364341a2-cf55-4dcd-99cb-72d8207613c7 req-156ce1c4-71ad-41e4-97a7-471ccf79e52e service nova] Lock "00959e75-7446-4ff6-be3e-56d7146b3576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:07:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-364341a2-cf55-4dcd-99cb-72d8207613c7 req-156ce1c4-71ad-41e4-97a7-471ccf79e52e service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] No waiting events found dispatching network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:07:00 user nova-compute[75378]: WARNING nova.compute.manager [req-364341a2-cf55-4dcd-99cb-72d8207613c7 req-156ce1c4-71ad-41e4-97a7-471ccf79e52e service nova] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Received unexpected event network-vif-plugged-bd706a0c-ba99-42b7-bf21-898a277c3541 for instance with vm_state active and task_state deleting.
Nov 09 04:07:01 user nova-compute[75378]: INFO nova.compute.manager [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Took 1.04 seconds to detach 1 volumes for instance.
Nov 09 04:07:01 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] [instance: 00959e75-7446-4ff6-be3e-56d7146b3576] Deleting volume: 073fc7a9-2698-4f96-888c-170888571f4d {{(pid=75378) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 09 04:07:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:07:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:07:01 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:07:01 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:07:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:07:01 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Deleted allocations for instance 00959e75-7446-4ff6-be3e-56d7146b3576
Nov 09 04:07:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ba1d06e9-030a-4035-94cc-758c9526450a tempest-TestShelveInstance-32995184 tempest-TestShelveInstance-32995184-project-member] Lock "00959e75-7446-4ff6-be3e-56d7146b3576" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.371s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:07:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:10 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:07:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:07:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:07:33 user nova-compute[75378]: DEBUG nova.compute.manager [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 04:07:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:07:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:07:33 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 04:07:33 user nova-compute[75378]: INFO nova.compute.claims [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Claim successful on node user
Nov 09 04:07:34 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG nova.compute.manager [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG nova.compute.manager [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG nova.network.neutron [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 04:07:34 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 04:07:34 user nova-compute[75378]: DEBUG nova.compute.manager [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG nova.policy [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f996e26d3a04dd8ba5a64eaa218a9b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5788a86f2c4fcab582d65b471fe27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG nova.compute.manager [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 04:07:34 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Creating image(s)
Nov 09 04:07:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "/opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "/opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.197s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.180s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk 1073741824" returned: 0 in 0.053s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.203s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 04:07:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:07:35 user nova-compute[75378]: DEBUG nova.network.neutron [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Successfully created port: 9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 04:07:35 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:07:35 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Cannot resize image /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 04:07:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 04:07:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Ensure instance console log exists: /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 04:07:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:07:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:07:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:07:35 user nova-compute[75378]: DEBUG nova.network.neutron [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Successfully updated port: 9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 04:07:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:07:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquired lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:07:35 user nova-compute[75378]: DEBUG nova.network.neutron [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:07:35 user nova-compute[75378]: DEBUG nova.compute.manager [req-e1ee60f5-28bb-4209-ae04-4af98b4b15dc req-f6004635-db1f-4ab5-8bb5-49a4ad66b4a4 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Received event network-changed-9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:07:35 user nova-compute[75378]: DEBUG nova.compute.manager [req-e1ee60f5-28bb-4209-ae04-4af98b4b15dc req-f6004635-db1f-4ab5-8bb5-49a4ad66b4a4 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Refreshing instance network info cache due to event network-changed-9581b2b1-98c1-465a-baaf-4c83ed1c0534. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:07:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e1ee60f5-28bb-4209-ae04-4af98b4b15dc req-f6004635-db1f-4ab5-8bb5-49a4ad66b4a4 service nova] Acquiring lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:07:35 user nova-compute[75378]: DEBUG nova.network.neutron [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.network.neutron [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Updating instance_info_cache with network_info: [{"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Releasing lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.compute.manager [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Instance network_info: |[{"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e1ee60f5-28bb-4209-ae04-4af98b4b15dc req-f6004635-db1f-4ab5-8bb5-49a4ad66b4a4 service nova] Acquired lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.network.neutron [req-e1ee60f5-28bb-4209-ae04-4af98b4b15dc req-f6004635-db1f-4ab5-8bb5-49a4ad66b4a4 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Refreshing network info cache for port 9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Start _get_guest_xml network_info=[{"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 04:07:36 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:07:36 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-626146740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-626146740',id=43,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNdNbsM06LFH67hTOYVSFjv3SWEewGCWPMCXdcIsGG2FPHFKsqe6q0hkrIVRviAneLUPy2vjl4HQ3MWP8we2RkWFKAO29DeoI3Ewk36iVZA1Ji+4rCe7AEDvZdXS7gOYQ==',key_name='tempest-keypair-1732741146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c5788a86f2c4fcab582d65b471fe27e',ramdisk_id='',reservation_id='r-e0hnehzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1244090539',owner_user_name='tempest-AttachVolumeShelveTestJSON-1244090539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:07:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f996e26d3a04dd8ba5a64eaa218a9b3',uuid=a2b8cb57-54fb-4474-88dd-891c8e1638e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converting VIF {"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=9581b2b1-98c1-465a-baaf-4c83ed1c0534,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581b2b1-98') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.objects.instance [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lazy-loading 'pci_devices' on Instance uuid a2b8cb57-54fb-4474-88dd-891c8e1638e9 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] End _get_guest_xml xml=<domain type="kvm">
Nov 09 04:07:36 user nova-compute[75378]:   <uuid>a2b8cb57-54fb-4474-88dd-891c8e1638e9</uuid>
Nov 09 04:07:36 user nova-compute[75378]:   <name>instance-0000002b</name>
Nov 09 04:07:36 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 04:07:36 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 04:07:36 user nova-compute[75378]:   <metadata>
Nov 09 04:07:36 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 04:07:36 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 04:07:36 user nova-compute[75378]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-626146740</nova:name>
Nov 09 04:07:36 user nova-compute[75378]:       <nova:creationTime>2023-11-09 04:07:36</nova:creationTime>
Nov 09 04:07:36 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 04:07:36 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 04:07:36 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 04:07:36 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 04:07:36 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 04:07:36 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 04:07:36 user nova-compute[75378]:       </nova:flavor>
Nov 09 04:07:36 user nova-compute[75378]:       <nova:owner>
Nov 09 04:07:36 user nova-compute[75378]:         <nova:user uuid="5f996e26d3a04dd8ba5a64eaa218a9b3">tempest-AttachVolumeShelveTestJSON-1244090539-project-member</nova:user>
Nov 09 04:07:36 user nova-compute[75378]:         <nova:project uuid="3c5788a86f2c4fcab582d65b471fe27e">tempest-AttachVolumeShelveTestJSON-1244090539</nova:project>
Nov 09 04:07:36 user nova-compute[75378]:       </nova:owner>
Nov 09 04:07:36 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 04:07:36 user nova-compute[75378]:       <nova:ports>
Nov 09 04:07:36 user nova-compute[75378]:         <nova:port uuid="9581b2b1-98c1-465a-baaf-4c83ed1c0534">
Nov 09 04:07:36 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 09 04:07:36 user nova-compute[75378]:         </nova:port>
Nov 09 04:07:36 user nova-compute[75378]:       </nova:ports>
Nov 09 04:07:36 user nova-compute[75378]:     </nova:instance>
Nov 09 04:07:36 user nova-compute[75378]:   </metadata>
Nov 09 04:07:36 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 04:07:36 user nova-compute[75378]:     <system>
Nov 09 04:07:36 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 04:07:36 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 04:07:36 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 04:07:36 user nova-compute[75378]:       <entry name="serial">a2b8cb57-54fb-4474-88dd-891c8e1638e9</entry>
Nov 09 04:07:36 user nova-compute[75378]:       <entry name="uuid">a2b8cb57-54fb-4474-88dd-891c8e1638e9</entry>
Nov 09 04:07:36 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 04:07:36 user nova-compute[75378]:     </system>
Nov 09 04:07:36 user nova-compute[75378]:   </sysinfo>
Nov 09 04:07:36 user nova-compute[75378]:   <os>
Nov 09 04:07:36 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 04:07:36 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 04:07:36 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 04:07:36 user nova-compute[75378]:   </os>
Nov 09 04:07:36 user nova-compute[75378]:   <features>
Nov 09 04:07:36 user nova-compute[75378]:     <acpi/>
Nov 09 04:07:36 user nova-compute[75378]:     <apic/>
Nov 09 04:07:36 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 04:07:36 user nova-compute[75378]:   </features>
Nov 09 04:07:36 user nova-compute[75378]:   <clock offset="utc">
Nov 09 04:07:36 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 04:07:36 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 04:07:36 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 04:07:36 user nova-compute[75378]:   </clock>
Nov 09 04:07:36 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 04:07:36 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 04:07:36 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 04:07:36 user nova-compute[75378]:   </cpu>
Nov 09 04:07:36 user nova-compute[75378]:   <devices>
Nov 09 04:07:36 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 04:07:36 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 04:07:36 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk"/>
Nov 09 04:07:36 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 04:07:36 user nova-compute[75378]:     </disk>
Nov 09 04:07:36 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 04:07:36 user nova-compute[75378]:       <mac address="fa:16:3e:08:cb:4e"/>
Nov 09 04:07:36 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:07:36 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 04:07:36 user nova-compute[75378]:       <target dev="tap9581b2b1-98"/>
Nov 09 04:07:36 user nova-compute[75378]:     </interface>
Nov 09 04:07:36 user nova-compute[75378]:     <serial type="pty">
Nov 09 04:07:36 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/console.log" append="off"/>
Nov 09 04:07:36 user nova-compute[75378]:     </serial>
Nov 09 04:07:36 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 04:07:36 user nova-compute[75378]:     <video>
Nov 09 04:07:36 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:07:36 user nova-compute[75378]:     </video>
Nov 09 04:07:36 user nova-compute[75378]:     <rng model="virtio">
Nov 09 04:07:36 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 04:07:36 user nova-compute[75378]:     </rng>
Nov 09 04:07:36 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 04:07:36 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 04:07:36 user nova-compute[75378]:       <stats period="10"/>
Nov 09 04:07:36 user nova-compute[75378]:     </memballoon>
Nov 09 04:07:36 user nova-compute[75378]:   </devices>
Nov 09 04:07:36 user nova-compute[75378]: </domain>
Nov 09 04:07:36 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-626146740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-626146740',id=43,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNdNbsM06LFH67hTOYVSFjv3SWEewGCWPMCXdcIsGG2FPHFKsqe6q0hkrIVRviAneLUPy2vjl4HQ3MWP8we2RkWFKAO29DeoI3Ewk36iVZA1Ji+4rCe7AEDvZdXS7gOYQ==',key_name='tempest-keypair-1732741146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c5788a86f2c4fcab582d65b471fe27e',ramdisk_id='',reservation_id='r-e0hnehzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1244090539',owner_user_name='tempest-AttachVolumeShelveTestJSON-1244090539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:07:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f996e26d3a04dd8ba5a64eaa218a9b3',uuid=a2b8cb57-54fb-4474-88dd-891c8e1638e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converting VIF {"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=9581b2b1-98c1-465a-baaf-4c83ed1c0534,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581b2b1-98') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG os_vif [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=9581b2b1-98c1-465a-baaf-4c83ed1c0534,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581b2b1-98') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2482b2b-86ae-5efb-90b5-6770fa7e54e7', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9581b2b1-98, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9581b2b1-98, col_values=(('qos', UUID('1d57a012-bd9b-456a-97fb-722710de1140')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9581b2b1-98, col_values=(('external_ids', {'iface-id': '9581b2b1-98c1-465a-baaf-4c83ed1c0534', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:cb:4e', 'vm-uuid': 'a2b8cb57-54fb-4474-88dd-891c8e1638e9'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:36 user nova-compute[75378]: INFO os_vif [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=9581b2b1-98c1-465a-baaf-4c83ed1c0534,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581b2b1-98')
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] No VIF found with MAC fa:16:3e:08:cb:4e, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.network.neutron [req-e1ee60f5-28bb-4209-ae04-4af98b4b15dc req-f6004635-db1f-4ab5-8bb5-49a4ad66b4a4 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Updated VIF entry in instance network info cache for port 9581b2b1-98c1-465a-baaf-4c83ed1c0534. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG nova.network.neutron [req-e1ee60f5-28bb-4209-ae04-4af98b4b15dc req-f6004635-db1f-4ab5-8bb5-49a4ad66b4a4 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Updating instance_info_cache with network_info: [{"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:07:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e1ee60f5-28bb-4209-ae04-4af98b4b15dc req-f6004635-db1f-4ab5-8bb5-49a4ad66b4a4 service nova] Releasing lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:07:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:37 user nova-compute[75378]: DEBUG nova.compute.manager [req-f6131f10-a548-439c-821c-abcf977c8cae req-792c095d-eada-4a8a-9f76-24590fe1cce8 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Received event network-vif-plugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:07:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f6131f10-a548-439c-821c-abcf977c8cae req-792c095d-eada-4a8a-9f76-24590fe1cce8 service nova] Acquiring lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:07:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f6131f10-a548-439c-821c-abcf977c8cae req-792c095d-eada-4a8a-9f76-24590fe1cce8 service nova] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:07:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f6131f10-a548-439c-821c-abcf977c8cae req-792c095d-eada-4a8a-9f76-24590fe1cce8 service nova] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:07:37 user nova-compute[75378]: DEBUG nova.compute.manager [req-f6131f10-a548-439c-821c-abcf977c8cae req-792c095d-eada-4a8a-9f76-24590fe1cce8 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] No waiting events found dispatching network-vif-plugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:07:37 user nova-compute[75378]: WARNING nova.compute.manager [req-f6131f10-a548-439c-821c-abcf977c8cae req-792c095d-eada-4a8a-9f76-24590fe1cce8 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Received unexpected event network-vif-plugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 for instance with vm_state building and task_state spawning.
Nov 09 04:07:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:39 user nova-compute[75378]: DEBUG nova.compute.manager [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 04:07:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 04:07:39 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Instance spawned successfully.
Nov 09 04:07:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 04:07:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:07:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:07:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:07:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:07:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:07:39 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:07:39 user nova-compute[75378]: INFO nova.compute.manager [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Took 5.62 seconds to spawn the instance on the hypervisor.
Nov 09 04:07:39 user nova-compute[75378]: DEBUG nova.compute.manager [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:07:39 user nova-compute[75378]: DEBUG nova.compute.manager [req-4464c7d6-f2cd-4e63-bbb7-d243e4ee3572 req-c7440553-39e6-4ac2-b846-f7008ba77141 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Received event network-vif-plugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:07:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4464c7d6-f2cd-4e63-bbb7-d243e4ee3572 req-c7440553-39e6-4ac2-b846-f7008ba77141 service nova] Acquiring lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:07:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4464c7d6-f2cd-4e63-bbb7-d243e4ee3572 req-c7440553-39e6-4ac2-b846-f7008ba77141 service nova] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:07:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4464c7d6-f2cd-4e63-bbb7-d243e4ee3572 req-c7440553-39e6-4ac2-b846-f7008ba77141 service nova] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:07:39 user nova-compute[75378]: DEBUG nova.compute.manager [req-4464c7d6-f2cd-4e63-bbb7-d243e4ee3572 req-c7440553-39e6-4ac2-b846-f7008ba77141 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] No waiting events found dispatching network-vif-plugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:07:39 user nova-compute[75378]: WARNING nova.compute.manager [req-4464c7d6-f2cd-4e63-bbb7-d243e4ee3572 req-c7440553-39e6-4ac2-b846-f7008ba77141 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Received unexpected event network-vif-plugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 for instance with vm_state building and task_state spawning.
Nov 09 04:07:39 user nova-compute[75378]: INFO nova.compute.manager [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Took 6.18 seconds to build instance.
Nov 09 04:07:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a5f4ab5b-dcf5-430a-8b13-c8a314fccaae tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.279s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:07:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:46 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:07:46 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:07:46 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:07:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:47 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:07:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:07:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Didn't find any instances for network info cache update. {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 04:07:47 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:07:50 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:07:50 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:07:51 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:07:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:07:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:07:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:07:51 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:07:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:07:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:07:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:07:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:07:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:07:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:07:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:07:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:07:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:07:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:07:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:07:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:07:53 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:07:53 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:07:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8462MB free_disk=25.259906768798828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:07:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:07:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:07:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:07:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 8182b18c-8741-46b8-a431-269289955be4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:07:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance a2b8cb57-54fb-4474-88dd-891c8e1638e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:07:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:07:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:07:53 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing inventories for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 04:07:53 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Updating ProviderTree inventory for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 04:07:53 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Updating inventory in ProviderTree for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 04:07:53 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing aggregate associations for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8, aggregates: None {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 04:07:53 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing trait associations for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8, traits: HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 04:07:53 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:07:53 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:07:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:07:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.709s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:07:53 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:07:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:07:58 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:07:58 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:07:59 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:07:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Cleaning up deleted instances {{(pid=75378) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 04:07:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] There are 0 instances to clean {{(pid=75378) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 04:07:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-974286a0-fdd8-44de-b0cc-a6e7b70ca65d req-9c735df8-5c0a-47a1-bad3-168d148bec66 service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Received event network-changed-8136caa1-a38d-4c19-9c63-64f3e2be3794 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:08:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-974286a0-fdd8-44de-b0cc-a6e7b70ca65d req-9c735df8-5c0a-47a1-bad3-168d148bec66 service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Refreshing instance network info cache due to event network-changed-8136caa1-a38d-4c19-9c63-64f3e2be3794. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:08:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-974286a0-fdd8-44de-b0cc-a6e7b70ca65d req-9c735df8-5c0a-47a1-bad3-168d148bec66 service nova] Acquiring lock "refresh_cache-1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:08:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-974286a0-fdd8-44de-b0cc-a6e7b70ca65d req-9c735df8-5c0a-47a1-bad3-168d148bec66 service nova] Acquired lock "refresh_cache-1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:08:04 user nova-compute[75378]: DEBUG nova.network.neutron [req-974286a0-fdd8-44de-b0cc-a6e7b70ca65d req-9c735df8-5c0a-47a1-bad3-168d148bec66 service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Refreshing network info cache for port 8136caa1-a38d-4c19-9c63-64f3e2be3794 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:08:05 user nova-compute[75378]: DEBUG nova.network.neutron [req-974286a0-fdd8-44de-b0cc-a6e7b70ca65d req-9c735df8-5c0a-47a1-bad3-168d148bec66 service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Updated VIF entry in instance network info cache for port 8136caa1-a38d-4c19-9c63-64f3e2be3794. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:08:05 user nova-compute[75378]: DEBUG nova.network.neutron [req-974286a0-fdd8-44de-b0cc-a6e7b70ca65d req-9c735df8-5c0a-47a1-bad3-168d148bec66 service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Updating instance_info_cache with network_info: [{"id": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "address": "fa:16:3e:da:50:7a", "network": {"id": "9b84419f-fb2f-455e-8788-7c8635dc5695", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-535897341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b9133412a8747f2ab2c26619adff95a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8136caa1-a3", "ovs_interfaceid": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:08:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-974286a0-fdd8-44de-b0cc-a6e7b70ca65d req-9c735df8-5c0a-47a1-bad3-168d148bec66 service nova] Releasing lock "refresh_cache-1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:08:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Acquiring lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG nova.objects.instance [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lazy-loading 'flavor' on Instance uuid 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Acquiring lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:08:11 user nova-compute[75378]: INFO nova.compute.manager [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Attaching volume 10622957-d91e-48d3-b55d-9d4ecdc628ac to /dev/vdb
Nov 09 04:08:11 user nova-compute[75378]: DEBUG os_brick.utils [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac38eb14-7c2a-4c50-aa8b-323e50a4fea3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[06205a1f-7016-4750-8ef4-a0251df5655b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a7c56e-feff-4009-b8b3-9fcd56e1113c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f20e64-2c6b-494a-beaf-aac9ac603fa0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:08:11 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 04:08:11 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3a4567-fa06-4715-830a-cc7cfa233659]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG os_brick.utils [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:08:11 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Updating existing volume attachment record: 0f9e9a68-8417-4f3a-8fa6-ae230f06c947 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 04:08:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:08:14 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75378) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 04:08:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:08:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:08:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:08:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:08:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ubrBtSTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:08:34 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:08:34 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:08:34 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[16485d2b-4758-4f1c-8118-219a01f0452e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 04:08:34 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[249dc59f-c167-4780-a8ee-904a0281c54b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac] added
Nov 09 04:08:34 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[47418736-982e-43ff-9ca5-d95c72078e3f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ee7996-1092-44df-9db4-05340aaf3593]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ubrBtSTU {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ubrBtSTU" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fb6072-9d90-4afb-918a-6e73ff013983]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ubrBtSTU'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[379f6c2d-2192-4070-b3cb-a067b06b92d7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0047e30b-ad4a-45cb-af3d-1f103ea9fe2e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 04:08:34 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 04:08:34 user nova-compute[75378]:  {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:08:34 user nova-compute[75378]: WARNING os_brick.initiator.connectors.iscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 04:08:34 user nova-compute[75378]: 
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[720709d8-e5d9-44e1-bdb8-3007db2ccde6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac, portal: 172.16.0.220,3260]
Nov 09 04:08:34 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac, portal: 172.16.0.220,3260] successful.
Nov 09 04:08:34 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35dd8b1-e26f-40d3-b8c8-2a074d285a35]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[47061516-7d63-4948-a524-57d818c2a33d]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac (non-flash)
Nov 09 04:08:34 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac (non-flash)
Nov 09 04:08:34 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c01aaf-985d-48e3-b4a7-693dc4b4c69a]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:08:34 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ubrBtSTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 04:08:35 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:08:35 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23533393839623861', 'path': '/dev/sdb'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:08:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533393839623861', 'path': '/dev/sdb'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 04:08:35 user nova-compute[75378]: DEBUG nova.objects.instance [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lazy-loading 'flavor' on Instance uuid 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:08:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 04:08:35 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:08:35 user nova-compute[75378]:   <source dev="/dev/sdb"/>
Nov 09 04:08:35 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 04:08:35 user nova-compute[75378]:   <serial>10622957-d91e-48d3-b55d-9d4ecdc628ac</serial>
Nov 09 04:08:35 user nova-compute[75378]: </disk>
Nov 09 04:08:35 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 04:08:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:08:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:08:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] No VIF found with MAC fa:16:3e:da:50:7a, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:08:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-87eee13f-4069-490f-b29e-58c23d0bec17 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.274s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:08:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "90528ac4-b8d9-412c-a1de-d78faaa53353" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:08:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "90528ac4-b8d9-412c-a1de-d78faaa53353" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:08:36 user nova-compute[75378]: DEBUG nova.compute.manager [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 04:08:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:08:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:08:36 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 04:08:36 user nova-compute[75378]: INFO nova.compute.claims [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Claim successful on node user
Nov 09 04:08:36 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:08:36 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:08:36 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:08:36 user nova-compute[75378]: DEBUG nova.compute.manager [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 04:08:36 user nova-compute[75378]: DEBUG nova.compute.manager [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 04:08:36 user nova-compute[75378]: DEBUG nova.network.neutron [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 04:08:36 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 04:08:36 user nova-compute[75378]: DEBUG nova.compute.manager [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 04:08:36 user nova-compute[75378]: DEBUG nova.policy [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23b841529aaf42c29a442ef9524422b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5a4bfe6ce546d2acfbf7be75334d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 04:08:36 user nova-compute[75378]: INFO nova.virt.block_device [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Booting with volume snapshot a6f16a5c-951a-44b8-9108-43ecc4b75611 at /dev/vda
Nov 09 04:08:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:37 user nova-compute[75378]: DEBUG nova.compute.manager [req-01afcb68-b9c0-4fac-bb2c-a58f87999222 req-7401a43e-8e0e-477d-ab74-83b2022a6e8d service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] Received event network-changed-bd3e4c98-1f54-4074-b993-a1ee9a124bf2 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:08:37 user nova-compute[75378]: DEBUG nova.compute.manager [req-01afcb68-b9c0-4fac-bb2c-a58f87999222 req-7401a43e-8e0e-477d-ab74-83b2022a6e8d service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] Refreshing instance network info cache due to event network-changed-bd3e4c98-1f54-4074-b993-a1ee9a124bf2. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:08:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-01afcb68-b9c0-4fac-bb2c-a58f87999222 req-7401a43e-8e0e-477d-ab74-83b2022a6e8d service nova] Acquiring lock "refresh_cache-8182b18c-8741-46b8-a431-269289955be4" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:08:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-01afcb68-b9c0-4fac-bb2c-a58f87999222 req-7401a43e-8e0e-477d-ab74-83b2022a6e8d service nova] Acquired lock "refresh_cache-8182b18c-8741-46b8-a431-269289955be4" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:08:37 user nova-compute[75378]: DEBUG nova.network.neutron [req-01afcb68-b9c0-4fac-bb2c-a58f87999222 req-7401a43e-8e0e-477d-ab74-83b2022a6e8d service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] Refreshing network info cache for port bd3e4c98-1f54-4074-b993-a1ee9a124bf2 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:08:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:37 user nova-compute[75378]: DEBUG nova.network.neutron [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Successfully created port: 8019be7d-ce14-4310-b86a-b9aea64fd032 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 04:08:37 user nova-compute[75378]: DEBUG nova.network.neutron [req-01afcb68-b9c0-4fac-bb2c-a58f87999222 req-7401a43e-8e0e-477d-ab74-83b2022a6e8d service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] Updated VIF entry in instance network info cache for port bd3e4c98-1f54-4074-b993-a1ee9a124bf2. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:08:37 user nova-compute[75378]: DEBUG nova.network.neutron [req-01afcb68-b9c0-4fac-bb2c-a58f87999222 req-7401a43e-8e0e-477d-ab74-83b2022a6e8d service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] Updating instance_info_cache with network_info: [{"id": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "address": "fa:16:3e:83:19:2a", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3e4c98-1f", "ovs_interfaceid": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:08:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-01afcb68-b9c0-4fac-bb2c-a58f87999222 req-7401a43e-8e0e-477d-ab74-83b2022a6e8d service nova] Releasing lock "refresh_cache-8182b18c-8741-46b8-a431-269289955be4" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:08:38 user nova-compute[75378]: DEBUG nova.network.neutron [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Successfully updated port: 8019be7d-ce14-4310-b86a-b9aea64fd032 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 04:08:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "refresh_cache-90528ac4-b8d9-412c-a1de-d78faaa53353" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:08:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquired lock "refresh_cache-90528ac4-b8d9-412c-a1de-d78faaa53353" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:08:38 user nova-compute[75378]: DEBUG nova.network.neutron [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:08:38 user nova-compute[75378]: DEBUG nova.network.neutron [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 04:08:38 user nova-compute[75378]: DEBUG nova.compute.manager [req-27aa90e4-686d-4cad-bd27-727aa993c109 req-ff56c3d3-bbc7-482b-9092-eb3307316984 service nova] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Received event network-changed-8019be7d-ce14-4310-b86a-b9aea64fd032 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:08:38 user nova-compute[75378]: DEBUG nova.compute.manager [req-27aa90e4-686d-4cad-bd27-727aa993c109 req-ff56c3d3-bbc7-482b-9092-eb3307316984 service nova] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Refreshing instance network info cache due to event network-changed-8019be7d-ce14-4310-b86a-b9aea64fd032. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:08:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-27aa90e4-686d-4cad-bd27-727aa993c109 req-ff56c3d3-bbc7-482b-9092-eb3307316984 service nova] Acquiring lock "refresh_cache-90528ac4-b8d9-412c-a1de-d78faaa53353" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:08:38 user nova-compute[75378]: DEBUG nova.network.neutron [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Updating instance_info_cache with network_info: [{"id": "8019be7d-ce14-4310-b86a-b9aea64fd032", "address": "fa:16:3e:2e:6a:30", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8019be7d-ce", "ovs_interfaceid": "8019be7d-ce14-4310-b86a-b9aea64fd032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:08:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Releasing lock "refresh_cache-90528ac4-b8d9-412c-a1de-d78faaa53353" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:08:38 user nova-compute[75378]: DEBUG nova.compute.manager [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Instance network_info: |[{"id": "8019be7d-ce14-4310-b86a-b9aea64fd032", "address": "fa:16:3e:2e:6a:30", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8019be7d-ce", "ovs_interfaceid": "8019be7d-ce14-4310-b86a-b9aea64fd032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 04:08:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-27aa90e4-686d-4cad-bd27-727aa993c109 req-ff56c3d3-bbc7-482b-9092-eb3307316984 service nova] Acquired lock "refresh_cache-90528ac4-b8d9-412c-a1de-d78faaa53353" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:08:38 user nova-compute[75378]: DEBUG nova.network.neutron [req-27aa90e4-686d-4cad-bd27-727aa993c109 req-ff56c3d3-bbc7-482b-9092-eb3307316984 service nova] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Refreshing network info cache for port 8019be7d-ce14-4310-b86a-b9aea64fd032 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:08:39 user nova-compute[75378]: DEBUG nova.network.neutron [req-27aa90e4-686d-4cad-bd27-727aa993c109 req-ff56c3d3-bbc7-482b-9092-eb3307316984 service nova] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Updated VIF entry in instance network info cache for port 8019be7d-ce14-4310-b86a-b9aea64fd032. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:08:39 user nova-compute[75378]: DEBUG nova.network.neutron [req-27aa90e4-686d-4cad-bd27-727aa993c109 req-ff56c3d3-bbc7-482b-9092-eb3307316984 service nova] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Updating instance_info_cache with network_info: [{"id": "8019be7d-ce14-4310-b86a-b9aea64fd032", "address": "fa:16:3e:2e:6a:30", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8019be7d-ce", "ovs_interfaceid": "8019be7d-ce14-4310-b86a-b9aea64fd032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:08:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-27aa90e4-686d-4cad-bd27-727aa993c109 req-ff56c3d3-bbc7-482b-9092-eb3307316984 service nova] Releasing lock "refresh_cache-90528ac4-b8d9-412c-a1de-d78faaa53353" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:08:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG os_brick.utils [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e03dbe-e60f-46c4-bbcb-6210db2bbc89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccbb7e0-a5c5-40b4-9b64-9961e114b42c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50dc5e6-de99-414b-8134-f90fdc2b56d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20803d6-2985-46c8-834d-1fea19515701]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:08:42 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 04:08:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d89ba44-52a0-4df9-a412-885b44c67d81]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG os_brick.utils [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:08:42 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Updating existing volume attachment record: ff4eb84a-6acb-42f5-a8a5-59779399bbde {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "8182b18c-8741-46b8-a431-269289955be4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "8182b18c-8741-46b8-a431-269289955be4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG nova.objects.instance [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lazy-loading 'flavor' on Instance uuid 8182b18c-8741-46b8-a431-269289955be4 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "8182b18c-8741-46b8-a431-269289955be4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "8182b18c-8741-46b8-a431-269289955be4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "8182b18c-8741-46b8-a431-269289955be4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:08:44 user nova-compute[75378]: INFO nova.compute.manager [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Attaching volume c3d8589e-b230-4dfe-8362-a3de7a07b78c to /dev/vdb
Nov 09 04:08:44 user nova-compute[75378]: DEBUG os_brick.utils [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6924514-fb15-46a5-bc61-c3f835dd77ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9350ff0b-d5c6-46e1-bbf9-b19657bcf86e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[df336d25-937c-4f0a-989c-1e613d623bc3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[85acdde2-ba41-46d9-9fb4-ace687c7b0d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:08:44 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 04:08:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[52180eeb-bae5-444d-bc1d-9b804f8642a7]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG os_brick.utils [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:08:44 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Updating existing volume attachment record: 26e20cac-3d8e-4898-ac68-0da410f84e49 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 04:08:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:47 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:08:47 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:08:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:08:48 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:08:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:08:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Rebuilding the list of instances to heal {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 04:08:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Skipping network cache update for instance because it is Building. {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 09 04:08:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:08:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:08:48 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 04:08:48 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lazy-loading 'info_cache' on Instance uuid 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:08:48 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Updating instance_info_cache with network_info: [{"id": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "address": "fa:16:3e:da:50:7a", "network": {"id": "9b84419f-fb2f-455e-8788-7c8635dc5695", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-535897341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b9133412a8747f2ab2c26619adff95a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8136caa1-a3", "ovs_interfaceid": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:08:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:08:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 04:08:49 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:08:51 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:08:51 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:08:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:52 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:08:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:08:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:08:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:08:52 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:08:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:08:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:08:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:08:53 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:08:53 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:08:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8603MB free_disk=25.220775604248047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:08:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:08:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:08:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:08:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 8182b18c-8741-46b8-a431-269289955be4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:08:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance a2b8cb57-54fb-4474-88dd-891c8e1638e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:08:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 90528ac4-b8d9-412c-a1de-d78faaa53353 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:08:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:08:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:08:53 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:08:54 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:08:54 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:08:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:08:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:08:59 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:08:59 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:09:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.compute.manager [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 04:09:06 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Creating image(s)
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Did not create local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Ensure instance console log exists: /opt/stack/data/nova/instances/90528ac4-b8d9-412c-a1de-d78faaa53353/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Start _get_guest_xml network_info=[{"id": "8019be7d-ce14-4310-b86a-b9aea64fd032", "address": "fa:16:3e:2e:6a:30", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8019be7d-ce", "ovs_interfaceid": "8019be7d-ce14-4310-b86a-b9aea64fd032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puzAlQDM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '90528ac4-b8d9-412c-a1de-d78faaa53353', 'attached_at': '', 'detached_at': '', 'volume_id': 'df2bdbf9-1ee6-4f74-854d-7790dd7336d2', 'serial': 'df2bdbf9-1ee6-4f74-854d-7790dd7336d2'}, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'ff4eb84a-6acb-42f5-a8a5-59779399bbde', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 04:09:06 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:09:06 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puzAlQDM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:09:06 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:09:06 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:09:06 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04638ea-63b1-40cb-9c65-27b32d843e95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 04:09:06 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4433a126-4cf2-4eb2-84b8-0fa18e194f29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2] added
Nov 09 04:09:06 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[af62cd04-7697-40af-8385-6542a8d2e965]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c2e659-8f85-4bb8-b2ab-3adbf32cd364]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v puzAlQDM {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v puzAlQDM" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[42af3c87-7eeb-4c77-aa6d-95bd36c67918]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'puzAlQDM'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfed624-3608-41a2-9481-5b51976b85af]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b55a65-bb5e-44ca-b194-632d6b625931]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac (non-flash)
Nov 09 04:09:06 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac (non-flash)
Nov 09 04:09:06 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[385dc886-6029-4a9e-803a-fe3536e6dcef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2, portal: 172.16.0.220,3260]
Nov 09 04:09:06 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2, portal: 172.16.0.220,3260] successful.
Nov 09 04:09:06 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fb55f0-07e4-4f7e-a425-86f84ca9ee29]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a72960-ef00-44b2-b011-3a1af800d9cc]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac (non-flash)
Nov 09 04:09:06 user nova-compute[75378]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 (non-flash)
Nov 09 04:09:06 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac (non-flash)
Nov 09 04:09:06 user nova-compute[75378]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 (non-flash)
Nov 09 04:09:06 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b53ff5e-d381-4946-aa5c-f958db4e57de]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:09:06 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puzAlQDM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23161396439363362', 'path': '/dev/sdc'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161396439363362', 'path': '/dev/sdc'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:08:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2096428556',display_name='tempest-TestVolumeBootPattern-server-2096428556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2096428556',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed5a4bfe6ce546d2acfbf7be75334d1a',ramdisk_id='',reservation_id='r-njmq6hk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1436829014',owner_user_name='tempest-TestVolumeBootPattern-1436829014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:08:37Z,user_data=None,user_id='23b841529aaf42c29a442ef9524422b2',uuid=90528ac4-b8d9-412c-a1de-d78faaa53353,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8019be7d-ce14-4310-b86a-b9aea64fd032", "address": "fa:16:3e:2e:6a:30", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8019be7d-ce", "ovs_interfaceid": "8019be7d-ce14-4310-b86a-b9aea64fd032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converting VIF {"id": "8019be7d-ce14-4310-b86a-b9aea64fd032", "address": "fa:16:3e:2e:6a:30", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8019be7d-ce", "ovs_interfaceid": "8019be7d-ce14-4310-b86a-b9aea64fd032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:6a:30,bridge_name='br-int',has_traffic_filtering=True,id=8019be7d-ce14-4310-b86a-b9aea64fd032,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8019be7d-ce') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG nova.objects.instance [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lazy-loading 'pci_devices' on Instance uuid 90528ac4-b8d9-412c-a1de-d78faaa53353 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] End _get_guest_xml xml=<domain type="kvm">
Nov 09 04:09:07 user nova-compute[75378]:   <uuid>90528ac4-b8d9-412c-a1de-d78faaa53353</uuid>
Nov 09 04:09:07 user nova-compute[75378]:   <name>instance-0000002c</name>
Nov 09 04:09:07 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 04:09:07 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 04:09:07 user nova-compute[75378]:   <metadata>
Nov 09 04:09:07 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 04:09:07 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 04:09:07 user nova-compute[75378]:       <nova:name>tempest-TestVolumeBootPattern-server-2096428556</nova:name>
Nov 09 04:09:07 user nova-compute[75378]:       <nova:creationTime>2023-11-09 04:09:06</nova:creationTime>
Nov 09 04:09:07 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 04:09:07 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 04:09:07 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 04:09:07 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 04:09:07 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 04:09:07 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 04:09:07 user nova-compute[75378]:       </nova:flavor>
Nov 09 04:09:07 user nova-compute[75378]:       <nova:owner>
Nov 09 04:09:07 user nova-compute[75378]:         <nova:user uuid="23b841529aaf42c29a442ef9524422b2">tempest-TestVolumeBootPattern-1436829014-project-member</nova:user>
Nov 09 04:09:07 user nova-compute[75378]:         <nova:project uuid="ed5a4bfe6ce546d2acfbf7be75334d1a">tempest-TestVolumeBootPattern-1436829014</nova:project>
Nov 09 04:09:07 user nova-compute[75378]:       </nova:owner>
Nov 09 04:09:07 user nova-compute[75378]:       <nova:ports>
Nov 09 04:09:07 user nova-compute[75378]:         <nova:port uuid="8019be7d-ce14-4310-b86a-b9aea64fd032">
Nov 09 04:09:07 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 04:09:07 user nova-compute[75378]:         </nova:port>
Nov 09 04:09:07 user nova-compute[75378]:       </nova:ports>
Nov 09 04:09:07 user nova-compute[75378]:     </nova:instance>
Nov 09 04:09:07 user nova-compute[75378]:   </metadata>
Nov 09 04:09:07 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 04:09:07 user nova-compute[75378]:     <system>
Nov 09 04:09:07 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 04:09:07 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 04:09:07 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 04:09:07 user nova-compute[75378]:       <entry name="serial">90528ac4-b8d9-412c-a1de-d78faaa53353</entry>
Nov 09 04:09:07 user nova-compute[75378]:       <entry name="uuid">90528ac4-b8d9-412c-a1de-d78faaa53353</entry>
Nov 09 04:09:07 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 04:09:07 user nova-compute[75378]:     </system>
Nov 09 04:09:07 user nova-compute[75378]:   </sysinfo>
Nov 09 04:09:07 user nova-compute[75378]:   <os>
Nov 09 04:09:07 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 04:09:07 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 04:09:07 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 04:09:07 user nova-compute[75378]:   </os>
Nov 09 04:09:07 user nova-compute[75378]:   <features>
Nov 09 04:09:07 user nova-compute[75378]:     <acpi/>
Nov 09 04:09:07 user nova-compute[75378]:     <apic/>
Nov 09 04:09:07 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 04:09:07 user nova-compute[75378]:   </features>
Nov 09 04:09:07 user nova-compute[75378]:   <clock offset="utc">
Nov 09 04:09:07 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 04:09:07 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 04:09:07 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 04:09:07 user nova-compute[75378]:   </clock>
Nov 09 04:09:07 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 04:09:07 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 04:09:07 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 04:09:07 user nova-compute[75378]:   </cpu>
Nov 09 04:09:07 user nova-compute[75378]:   <devices>
Nov 09 04:09:07 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 04:09:07 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:09:07 user nova-compute[75378]:       <source dev="/dev/sdc"/>
Nov 09 04:09:07 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 04:09:07 user nova-compute[75378]:       <serial>df2bdbf9-1ee6-4f74-854d-7790dd7336d2</serial>
Nov 09 04:09:07 user nova-compute[75378]:     </disk>
Nov 09 04:09:07 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 04:09:07 user nova-compute[75378]:       <mac address="fa:16:3e:2e:6a:30"/>
Nov 09 04:09:07 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:09:07 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 04:09:07 user nova-compute[75378]:       <target dev="tap8019be7d-ce"/>
Nov 09 04:09:07 user nova-compute[75378]:     </interface>
Nov 09 04:09:07 user nova-compute[75378]:     <serial type="pty">
Nov 09 04:09:07 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/90528ac4-b8d9-412c-a1de-d78faaa53353/console.log" append="off"/>
Nov 09 04:09:07 user nova-compute[75378]:     </serial>
Nov 09 04:09:07 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 04:09:07 user nova-compute[75378]:     <video>
Nov 09 04:09:07 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:09:07 user nova-compute[75378]:     </video>
Nov 09 04:09:07 user nova-compute[75378]:     <rng model="virtio">
Nov 09 04:09:07 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 04:09:07 user nova-compute[75378]:     </rng>
Nov 09 04:09:07 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 04:09:07 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 04:09:07 user nova-compute[75378]:       <stats period="10"/>
Nov 09 04:09:07 user nova-compute[75378]:     </memballoon>
Nov 09 04:09:07 user nova-compute[75378]:   </devices>
Nov 09 04:09:07 user nova-compute[75378]: </domain>
Nov 09 04:09:07 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:08:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2096428556',display_name='tempest-TestVolumeBootPattern-server-2096428556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2096428556',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed5a4bfe6ce546d2acfbf7be75334d1a',ramdisk_id='',reservation_id='r-njmq6hk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1436829014',owner_user_name='tempest-TestVolumeBootPattern-1436829014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:08:37Z,user_data=None,user_id='23b841529aaf42c29a442ef9524422b2',uuid=90528ac4-b8d9-412c-a1de-d78faaa53353,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8019be7d-ce14-4310-b86a-b9aea64fd032", "address": "fa:16:3e:2e:6a:30", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8019be7d-ce", "ovs_interfaceid": "8019be7d-ce14-4310-b86a-b9aea64fd032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converting VIF {"id": "8019be7d-ce14-4310-b86a-b9aea64fd032", "address": "fa:16:3e:2e:6a:30", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8019be7d-ce", "ovs_interfaceid": "8019be7d-ce14-4310-b86a-b9aea64fd032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:6a:30,bridge_name='br-int',has_traffic_filtering=True,id=8019be7d-ce14-4310-b86a-b9aea64fd032,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8019be7d-ce') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG os_vif [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:6a:30,bridge_name='br-int',has_traffic_filtering=True,id=8019be7d-ce14-4310-b86a-b9aea64fd032,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8019be7d-ce') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79cb21ae-a45a-55f6-ac2e-9e1bda87b998', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8019be7d-ce, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8019be7d-ce, col_values=(('qos', UUID('4efb2455-50cb-453c-901b-0b019474fef4')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8019be7d-ce, col_values=(('external_ids', {'iface-id': '8019be7d-ce14-4310-b86a-b9aea64fd032', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:6a:30', 'vm-uuid': '90528ac4-b8d9-412c-a1de-d78faaa53353'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:07 user nova-compute[75378]: INFO os_vif [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:6a:30,bridge_name='br-int',has_traffic_filtering=True,id=8019be7d-ce14-4310-b86a-b9aea64fd032,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8019be7d-ce')
Nov 09 04:09:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:09:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] No VIF found with MAC fa:16:3e:2e:6a:30, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNtTjzSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:09:08 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:09:08 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:09:08 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39f2042-0071-4c42-b1a6-b1a0ade17339]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 04:09:08 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b254a5-0f37-4f25-9414-eef64b817271]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c] added
Nov 09 04:09:08 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fa71d5-3c58-46a6-a9a4-1085f009ffd1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3bf21a-9de5-479d-907c-1f545492f075]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eNtTjzSg {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eNtTjzSg" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0349a6-4d5e-430f-8997-2f2182f62f9d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eNtTjzSg'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9f4a42-c902-4ab4-ae87-187228ccc4be]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[209a4fe2-573d-488e-b78f-54c2a5fa731c]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac (non-flash)
Nov 09 04:09:08 user nova-compute[75378]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 (non-flash)
Nov 09 04:09:08 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac (non-flash)
Nov 09 04:09:08 user nova-compute[75378]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 (non-flash)
Nov 09 04:09:08 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fb07b0-4f6d-43fb-a005-ab32e07932f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c, portal: 172.16.0.220,3260]
Nov 09 04:09:08 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c, portal: 172.16.0.220,3260] successful.
Nov 09 04:09:08 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa858a2-c134-49d8-a943-0991934cc877]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e1b76b-ab02-4d68-8ff1-e3dc3ae4d85a]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac (non-flash)
Nov 09 04:09:08 user nova-compute[75378]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 (non-flash)
Nov 09 04:09:08 user nova-compute[75378]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c (non-flash)
Nov 09 04:09:08 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac (non-flash)
Nov 09 04:09:08 user nova-compute[75378]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 (non-flash)
Nov 09 04:09:08 user nova-compute[75378]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c (non-flash)
Nov 09 04:09:08 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2945ef13-c12c-426f-8228-40bbdf811f1a]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:08 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: None {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:09:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-2fe225bc-1e88-49a9-a5dd-4e049ff40940 req-34233afb-b6aa-4d82-90e4-7dffbccb30fe service nova] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Received event network-vif-plugged-8019be7d-ce14-4310-b86a-b9aea64fd032 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:09:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2fe225bc-1e88-49a9-a5dd-4e049ff40940 req-34233afb-b6aa-4d82-90e4-7dffbccb30fe service nova] Acquiring lock "90528ac4-b8d9-412c-a1de-d78faaa53353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:09:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2fe225bc-1e88-49a9-a5dd-4e049ff40940 req-34233afb-b6aa-4d82-90e4-7dffbccb30fe service nova] Lock "90528ac4-b8d9-412c-a1de-d78faaa53353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:09:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2fe225bc-1e88-49a9-a5dd-4e049ff40940 req-34233afb-b6aa-4d82-90e4-7dffbccb30fe service nova] Lock "90528ac4-b8d9-412c-a1de-d78faaa53353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:09:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-2fe225bc-1e88-49a9-a5dd-4e049ff40940 req-34233afb-b6aa-4d82-90e4-7dffbccb30fe service nova] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] No waiting events found dispatching network-vif-plugged-8019be7d-ce14-4310-b86a-b9aea64fd032 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:09:09 user nova-compute[75378]: WARNING nova.compute.manager [req-2fe225bc-1e88-49a9-a5dd-4e049ff40940 req-34233afb-b6aa-4d82-90e4-7dffbccb30fe service nova] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Received unexpected event network-vif-plugged-8019be7d-ce14-4310-b86a-b9aea64fd032 for instance with vm_state building and task_state spawning.
Nov 09 04:09:09 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:09:09 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNtTjzSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 04:09:09 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:09:09 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23934623639633635', 'path': '/dev/sdd'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:09:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934623639633635', 'path': '/dev/sdd'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 04:09:09 user nova-compute[75378]: DEBUG nova.objects.instance [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lazy-loading 'flavor' on Instance uuid 8182b18c-8741-46b8-a431-269289955be4 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:09:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 04:09:09 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:09:09 user nova-compute[75378]:   <source dev="/dev/sdd"/>
Nov 09 04:09:09 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 04:09:09 user nova-compute[75378]:   <serial>c3d8589e-b230-4dfe-8362-a3de7a07b78c</serial>
Nov 09 04:09:09 user nova-compute[75378]: </disk>
Nov 09 04:09:09 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 04:09:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:09:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:09:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] No VIF found with MAC fa:16:3e:83:19:2a, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:09:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3137bdfe-f5af-4946-923e-866c8339fb58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "8182b18c-8741-46b8-a431-269289955be4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.513s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:09:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "8182b18c-8741-46b8-a431-269289955be4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:09:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "8182b18c-8741-46b8-a431-269289955be4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:09:10 user nova-compute[75378]: INFO nova.compute.manager [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Detaching volume c3d8589e-b230-4dfe-8362-a3de7a07b78c
Nov 09 04:09:10 user nova-compute[75378]: INFO nova.virt.block_device [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Attempting to driver detach volume c3d8589e-b230-4dfe-8362-a3de7a07b78c from mountpoint /dev/vdb
Nov 09 04:09:10 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Attempting to detach device vdb from instance 8182b18c-8741-46b8-a431-269289955be4 from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 04:09:10 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 04:09:10 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:09:10 user nova-compute[75378]:   <source dev="/dev/sdd"/>
Nov 09 04:09:10 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 04:09:10 user nova-compute[75378]:   <serial>c3d8589e-b230-4dfe-8362-a3de7a07b78c</serial>
Nov 09 04:09:10 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 04:09:10 user nova-compute[75378]: </disk>
Nov 09 04:09:10 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 04:09:10 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Successfully detached device vdb from instance 8182b18c-8741-46b8-a431-269289955be4 from the persistent domain config.
Nov 09 04:09:10 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8182b18c-8741-46b8-a431-269289955be4 from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 04:09:10 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 04:09:10 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:09:10 user nova-compute[75378]:   <source dev="/dev/sdd"/>
Nov 09 04:09:10 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 04:09:10 user nova-compute[75378]:   <serial>c3d8589e-b230-4dfe-8362-a3de7a07b78c</serial>
Nov 09 04:09:10 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 04:09:10 user nova-compute[75378]: </disk>
Nov 09 04:09:10 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 04:09:11 user nova-compute[75378]: DEBUG nova.compute.manager [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 04:09:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 04:09:11 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Instance spawned successfully.
Nov 09 04:09:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 04:09:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8182b18c-8741-46b8-a431-269289955be4 {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 04:09:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:09:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:09:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:09:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:09:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:09:11 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:09:11 user nova-compute[75378]: DEBUG nova.compute.manager [req-d9726da3-863d-47d6-a1a2-3cf1a2f7d2f9 req-38320b48-6f94-41e7-90ff-559fdf0fe155 service nova] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Received event network-vif-plugged-8019be7d-ce14-4310-b86a-b9aea64fd032 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:09:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d9726da3-863d-47d6-a1a2-3cf1a2f7d2f9 req-38320b48-6f94-41e7-90ff-559fdf0fe155 service nova] Acquiring lock "90528ac4-b8d9-412c-a1de-d78faaa53353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:09:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d9726da3-863d-47d6-a1a2-3cf1a2f7d2f9 req-38320b48-6f94-41e7-90ff-559fdf0fe155 service nova] Lock "90528ac4-b8d9-412c-a1de-d78faaa53353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:09:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-d9726da3-863d-47d6-a1a2-3cf1a2f7d2f9 req-38320b48-6f94-41e7-90ff-559fdf0fe155 service nova] Lock "90528ac4-b8d9-412c-a1de-d78faaa53353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:09:11 user nova-compute[75378]: DEBUG nova.compute.manager [req-d9726da3-863d-47d6-a1a2-3cf1a2f7d2f9 req-38320b48-6f94-41e7-90ff-559fdf0fe155 service nova] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] No waiting events found dispatching network-vif-plugged-8019be7d-ce14-4310-b86a-b9aea64fd032 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:09:11 user nova-compute[75378]: WARNING nova.compute.manager [req-d9726da3-863d-47d6-a1a2-3cf1a2f7d2f9 req-38320b48-6f94-41e7-90ff-559fdf0fe155 service nova] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Received unexpected event network-vif-plugged-8019be7d-ce14-4310-b86a-b9aea64fd032 for instance with vm_state building and task_state spawning.
Nov 09 04:09:11 user nova-compute[75378]: INFO nova.compute.manager [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Took 5.54 seconds to spawn the instance on the hypervisor.
Nov 09 04:09:11 user nova-compute[75378]: DEBUG nova.compute.manager [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:09:11 user nova-compute[75378]: INFO nova.compute.manager [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Took 35.51 seconds to build instance.
Nov 09 04:09:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3d69ff4b-9483-4c23-9019-f42990625e33 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "90528ac4-b8d9-412c-a1de-d78faaa53353" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.624s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:09:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:15 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:09:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Acquiring lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:09:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:09:16 user nova-compute[75378]: INFO nova.compute.manager [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Detaching volume 10622957-d91e-48d3-b55d-9d4ecdc628ac
Nov 09 04:09:16 user nova-compute[75378]: INFO nova.virt.block_device [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Attempting to driver detach volume 10622957-d91e-48d3-b55d-9d4ecdc628ac from mountpoint /dev/vdb
Nov 09 04:09:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Attempting to detach device vdb from instance 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 04:09:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 04:09:16 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:09:16 user nova-compute[75378]:   <source dev="/dev/sdb"/>
Nov 09 04:09:16 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 04:09:16 user nova-compute[75378]:   <serial>10622957-d91e-48d3-b55d-9d4ecdc628ac</serial>
Nov 09 04:09:16 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 04:09:16 user nova-compute[75378]: </disk>
Nov 09 04:09:16 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 04:09:16 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Successfully detached device vdb from instance 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 from the persistent domain config.
Nov 09 04:09:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 04:09:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 04:09:16 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:09:16 user nova-compute[75378]:   <source dev="/dev/sdb"/>
Nov 09 04:09:16 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 04:09:16 user nova-compute[75378]:   <serial>10622957-d91e-48d3-b55d-9d4ecdc628ac</serial>
Nov 09 04:09:16 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 04:09:16 user nova-compute[75378]: </disk>
Nov 09 04:09:16 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 04:09:17 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 04:09:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:09:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:24 user nova-compute[75378]: DEBUG nova.compute.manager [req-855e73f8-0224-4dbd-ac53-2f035d968f98 req-35fca1e4-2c47-46f2-b2b0-29758e70419b service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Received event network-changed-9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:09:24 user nova-compute[75378]: DEBUG nova.compute.manager [req-855e73f8-0224-4dbd-ac53-2f035d968f98 req-35fca1e4-2c47-46f2-b2b0-29758e70419b service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Refreshing instance network info cache due to event network-changed-9581b2b1-98c1-465a-baaf-4c83ed1c0534. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:09:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-855e73f8-0224-4dbd-ac53-2f035d968f98 req-35fca1e4-2c47-46f2-b2b0-29758e70419b service nova] Acquiring lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:09:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-855e73f8-0224-4dbd-ac53-2f035d968f98 req-35fca1e4-2c47-46f2-b2b0-29758e70419b service nova] Acquired lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:09:24 user nova-compute[75378]: DEBUG nova.network.neutron [req-855e73f8-0224-4dbd-ac53-2f035d968f98 req-35fca1e4-2c47-46f2-b2b0-29758e70419b service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Refreshing network info cache for port 9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:09:25 user nova-compute[75378]: DEBUG nova.network.neutron [req-855e73f8-0224-4dbd-ac53-2f035d968f98 req-35fca1e4-2c47-46f2-b2b0-29758e70419b service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Updated VIF entry in instance network info cache for port 9581b2b1-98c1-465a-baaf-4c83ed1c0534. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:09:25 user nova-compute[75378]: DEBUG nova.network.neutron [req-855e73f8-0224-4dbd-ac53-2f035d968f98 req-35fca1e4-2c47-46f2-b2b0-29758e70419b service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Updating instance_info_cache with network_info: [{"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:09:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-855e73f8-0224-4dbd-ac53-2f035d968f98 req-35fca1e4-2c47-46f2-b2b0-29758e70419b service nova] Releasing lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:09:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:31 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8182b18c-8741-46b8-a431-269289955be4 is timed out.
Nov 09 04:09:31 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Successfully detached device vdb from instance 8182b18c-8741-46b8-a431-269289955be4 from the live domain config.
Nov 09 04:09:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNtTjzSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:09:31 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:09:31 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9536d26-638e-44a8-8bf8-9cbd03f419ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 04:09:31 user nova-compute[75378]: No targets found.
Nov 09 04:09:31 user nova-compute[75378]: iSNS:
Nov 09 04:09:31 user nova-compute[75378]: No targets found.
Nov 09 04:09:31 user nova-compute[75378]: STATIC:
Nov 09 04:09:31 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2
Nov 09 04:09:31 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:09:31 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:09:31 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac
Nov 09 04:09:31 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:09:31 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:09:31 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c
Nov 09 04:09:31 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:09:31 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:09:31 user nova-compute[75378]: FIRMWARE:
Nov 09 04:09:31 user nova-compute[75378]: No targets found.
Nov 09 04:09:31 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 04:09:31 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 04:09:31 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb24cc34-88fb-42f4-986e-dd06a59204b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9020bc-d673-4b09-9d7d-777fe06e2b8f]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac (non-flash)
Nov 09 04:09:31 user nova-compute[75378]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 (non-flash)
Nov 09 04:09:31 user nova-compute[75378]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c (non-flash)
Nov 09 04:09:31 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac (non-flash)
Nov 09 04:09:31 user nova-compute[75378]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 (non-flash)
Nov 09 04:09:31 user nova-compute[75378]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c (non-flash)
Nov 09 04:09:31 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3b05c4ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c'): ({'sdd'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Removing single pathed devices sdd {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a56493-8215-4a70-8289-6161aa501fad]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a51305-2575-4496-a438-05920f0fd020]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Flushing IO for device /dev/sdd {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce925bea-63c2-492b-ae8f-b3ccc376e826]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d322ea-8006-4acf-88f0-5fb103e1e80a]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] SCSI volumes sdd have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabf5cb9-3c6e-4834-9cf2-ccda09ae7c79]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d32f1df-e520-4896-9532-274c87e2325e]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c, portal: 172.16.0.220,3260]
Nov 09 04:09:31 user nova-compute[75378]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c, portal: 172.16.0.220,3260] successful.
Nov 09 04:09:31 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d8589e-b230-4dfe-8362-a3de7a07b78c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40d74f4-5269-43be-ae35-d722494bc6f2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] <== disconnect_volume: return (301ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:09:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 04:09:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:32 user nova-compute[75378]: DEBUG nova.objects.instance [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lazy-loading 'flavor' on Instance uuid 8182b18c-8741-46b8-a431-269289955be4 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:09:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-e291bb51-6c6e-4590-ad5a-147249dbbf58 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "8182b18c-8741-46b8-a431-269289955be4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.833s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:09:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:09:32 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:09:32 user nova-compute[75378]: INFO nova.compute.manager [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Shelving
Nov 09 04:09:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:33 user nova-compute[75378]: DEBUG nova.compute.manager [req-939b6bfd-534b-4fe4-b6dd-fd8abf28e424 req-e5c763cd-6c3d-4f7b-878e-c60e07ad8770 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Received event network-vif-unplugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:09:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-939b6bfd-534b-4fe4-b6dd-fd8abf28e424 req-e5c763cd-6c3d-4f7b-878e-c60e07ad8770 service nova] Acquiring lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:09:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-939b6bfd-534b-4fe4-b6dd-fd8abf28e424 req-e5c763cd-6c3d-4f7b-878e-c60e07ad8770 service nova] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:09:33 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-939b6bfd-534b-4fe4-b6dd-fd8abf28e424 req-e5c763cd-6c3d-4f7b-878e-c60e07ad8770 service nova] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:09:33 user nova-compute[75378]: DEBUG nova.compute.manager [req-939b6bfd-534b-4fe4-b6dd-fd8abf28e424 req-e5c763cd-6c3d-4f7b-878e-c60e07ad8770 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] No waiting events found dispatching network-vif-unplugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:09:33 user nova-compute[75378]: WARNING nova.compute.manager [req-939b6bfd-534b-4fe4-b6dd-fd8abf28e424 req-e5c763cd-6c3d-4f7b-878e-c60e07ad8770 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Received unexpected event network-vif-unplugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 for instance with vm_state active and task_state shelving.
Nov 09 04:09:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:33 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Instance destroyed successfully.
Nov 09 04:09:33 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Beginning cold snapshot process
Nov 09 04:09:33 user nova-compute[75378]: DEBUG nova.privsep.utils [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75378) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 04:09:33 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk /opt/stack/data/nova/instances/snapshots/tmpfd_0asgz/bd64267222214210a0b84ed0799b363d {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:34 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk /opt/stack/data/nova/instances/snapshots/tmpfd_0asgz/bd64267222214210a0b84ed0799b363d" returned: 0 in 0.693s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:34 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Snapshot extracted, beginning image upload
Nov 09 04:09:35 user nova-compute[75378]: DEBUG nova.compute.manager [req-0b6a3a63-cfa4-413b-b104-8a76fe2dc8bc req-e2b3448a-741a-48aa-b49d-1fbf3a2c73c4 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Received event network-vif-plugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:09:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0b6a3a63-cfa4-413b-b104-8a76fe2dc8bc req-e2b3448a-741a-48aa-b49d-1fbf3a2c73c4 service nova] Acquiring lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:09:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0b6a3a63-cfa4-413b-b104-8a76fe2dc8bc req-e2b3448a-741a-48aa-b49d-1fbf3a2c73c4 service nova] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:09:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0b6a3a63-cfa4-413b-b104-8a76fe2dc8bc req-e2b3448a-741a-48aa-b49d-1fbf3a2c73c4 service nova] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:09:35 user nova-compute[75378]: DEBUG nova.compute.manager [req-0b6a3a63-cfa4-413b-b104-8a76fe2dc8bc req-e2b3448a-741a-48aa-b49d-1fbf3a2c73c4 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] No waiting events found dispatching network-vif-plugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:09:35 user nova-compute[75378]: WARNING nova.compute.manager [req-0b6a3a63-cfa4-413b-b104-8a76fe2dc8bc req-e2b3448a-741a-48aa-b49d-1fbf3a2c73c4 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Received unexpected event network-vif-plugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 for instance with vm_state active and task_state shelving_image_uploading.
Nov 09 04:09:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:37 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 is timed out.
Nov 09 04:09:37 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Successfully detached device vdb from instance 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 from the live domain config.
Nov 09 04:09:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ubrBtSTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:09:37 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:09:37 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:37 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Snapshot image upload complete
Nov 09 04:09:37 user nova-compute[75378]: DEBUG nova.compute.manager [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a901f4e4-703c-4d99-86a6-649a32ff0b21]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 04:09:37 user nova-compute[75378]: No targets found.
Nov 09 04:09:37 user nova-compute[75378]: iSNS:
Nov 09 04:09:37 user nova-compute[75378]: No targets found.
Nov 09 04:09:37 user nova-compute[75378]: STATIC:
Nov 09 04:09:37 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2
Nov 09 04:09:37 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:09:37 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:09:37 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac
Nov 09 04:09:37 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:09:37 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:09:37 user nova-compute[75378]: FIRMWARE:
Nov 09 04:09:37 user nova-compute[75378]: No targets found.
Nov 09 04:09:37 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 04:09:37 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 04:09:37 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3454645-9e9b-47b6-ad95-89d84bea184b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10c4003-18b5-4d90-bf24-2bb8e7329cfa]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac (non-flash)
Nov 09 04:09:37 user nova-compute[75378]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 (non-flash)
Nov 09 04:09:37 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac (non-flash)
Nov 09 04:09:37 user nova-compute[75378]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 (non-flash)
Nov 09 04:09:37 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3b0477d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac'): ({'sdb'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Removing single pathed devices sdb {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:37 user nova-compute[75378]: INFO nova.compute.manager [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Shelve offloading
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5634fe-f00e-459d-af30-280e64185779]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:37 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Instance destroyed successfully.
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG nova.compute.manager [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquired lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG nova.network.neutron [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcb2ee1-b2b0-4e62-8122-923e747335e0]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Flushing IO for device /dev/sdb {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eda2bb3-62e8-4731-aaa4-278ec31df2af]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[abaa00a7-f6f3-4b90-b3c3-314affb4c600]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dfd171-a201-43c7-9ab6-48a76a95a445]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ad1101-ce7b-4284-a546-fca19cb6466f]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac, portal: 172.16.0.220,3260]
Nov 09 04:09:37 user nova-compute[75378]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac, portal: 172.16.0.220,3260] successful.
Nov 09 04:09:37 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10622957-d91e-48d3-b55d-9d4ecdc628ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0521d48-febc-43eb-9afc-e9c1bd1036e0]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] <== disconnect_volume: return (336ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG nova.network.neutron [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Updating instance_info_cache with network_info: [{"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Releasing lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:09:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:38 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Instance destroyed successfully.
Nov 09 04:09:38 user nova-compute[75378]: DEBUG nova.objects.instance [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lazy-loading 'resources' on Instance uuid a2b8cb57-54fb-4474-88dd-891c8e1638e9 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-626146740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-626146740',id=43,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNdNbsM06LFH67hTOYVSFjv3SWEewGCWPMCXdcIsGG2FPHFKsqe6q0hkrIVRviAneLUPy2vjl4HQ3MWP8we2RkWFKAO29DeoI3Ewk36iVZA1Ji+4rCe7AEDvZdXS7gOYQ==',key_name='tempest-keypair-1732741146',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3c5788a86f2c4fcab582d65b471fe27e',ramdisk_id='',reservation_id='r-e0hnehzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1244090539',owner_user_name='tempest-AttachVolumeShelveTestJSON-1244090539-project-member',shelved_at='2023-11-09T04:09:37.218911',shelved_host='user',shelved_image_id='d51e7d5f-b1df-48af-a517-a9f8c7a6270d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T04:09:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f996e26d3a04dd8ba5a64eaa218a9b3',uuid=a2b8cb57-54fb-4474-88dd-891c8e1638e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converting VIF {"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=9581b2b1-98c1-465a-baaf-4c83ed1c0534,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581b2b1-98') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG os_vif [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=9581b2b1-98c1-465a-baaf-4c83ed1c0534,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581b2b1-98') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9581b2b1-98, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG nova.compute.manager [req-97b37454-dfd3-4b84-9437-f8afbf7bc0a1 req-5aaa511c-1d6e-451d-8541-b20e0e09a6a0 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Received event network-changed-9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG nova.compute.manager [req-97b37454-dfd3-4b84-9437-f8afbf7bc0a1 req-5aaa511c-1d6e-451d-8541-b20e0e09a6a0 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Refreshing instance network info cache due to event network-changed-9581b2b1-98c1-465a-baaf-4c83ed1c0534. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-97b37454-dfd3-4b84-9437-f8afbf7bc0a1 req-5aaa511c-1d6e-451d-8541-b20e0e09a6a0 service nova] Acquiring lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-97b37454-dfd3-4b84-9437-f8afbf7bc0a1 req-5aaa511c-1d6e-451d-8541-b20e0e09a6a0 service nova] Acquired lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG nova.network.neutron [req-97b37454-dfd3-4b84-9437-f8afbf7bc0a1 req-5aaa511c-1d6e-451d-8541-b20e0e09a6a0 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Refreshing network info cache for port 9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d57a012-bd9b-456a-97fb-722710de1140) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:38 user nova-compute[75378]: INFO os_vif [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=9581b2b1-98c1-465a-baaf-4c83ed1c0534,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581b2b1-98')
Nov 09 04:09:38 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Deleting instance files /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9_del
Nov 09 04:09:38 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Deletion of /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9_del complete
Nov 09 04:09:38 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Deleted allocations for instance a2b8cb57-54fb-4474-88dd-891c8e1638e9
Nov 09 04:09:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG nova.objects.instance [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lazy-loading 'numa_topology' on Instance uuid a2b8cb57-54fb-4474-88dd-891c8e1638e9 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG nova.objects.base [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Object Instance<a2b8cb57-54fb-4474-88dd-891c8e1638e9> lazy-loaded attributes: resources,numa_topology {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG nova.objects.instance [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lazy-loading 'flavor' on Instance uuid 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG nova.network.neutron [req-97b37454-dfd3-4b84-9437-f8afbf7bc0a1 req-5aaa511c-1d6e-451d-8541-b20e0e09a6a0 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Updated VIF entry in instance network info cache for port 9581b2b1-98c1-465a-baaf-4c83ed1c0534. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG nova.network.neutron [req-97b37454-dfd3-4b84-9437-f8afbf7bc0a1 req-5aaa511c-1d6e-451d-8541-b20e0e09a6a0 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Updating instance_info_cache with network_info: [{"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9581b2b1-98", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-97b37454-dfd3-4b84-9437-f8afbf7bc0a1 req-5aaa511c-1d6e-451d-8541-b20e0e09a6a0 service nova] Releasing lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-729a7b86-faca-430a-ac72-24d320fb7861 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.167s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:09:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cf134f8e-6406-467d-a271-d4796da02c49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.965s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:09:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:47 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:09:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:09:48 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:09:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:09:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:09:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:09:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:09:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:49 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:09:49 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:09:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-8182b18c-8741-46b8-a431-269289955be4" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:09:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-8182b18c-8741-46b8-a431-269289955be4" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:09:49 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 8182b18c-8741-46b8-a431-269289955be4] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 04:09:49 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 8182b18c-8741-46b8-a431-269289955be4] Updating instance_info_cache with network_info: [{"id": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "address": "fa:16:3e:83:19:2a", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3e4c98-1f", "ovs_interfaceid": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:09:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-8182b18c-8741-46b8-a431-269289955be4" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:09:50 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 8182b18c-8741-46b8-a431-269289955be4] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 04:09:50 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:09:52 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:09:52 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:09:52 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:09:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:09:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:09:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:09:52 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:09:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:09:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:09:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:09:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:53 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:09:53 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:09:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8576MB free_disk=25.197471618652344GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:09:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:09:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:09:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:09:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 8182b18c-8741-46b8-a431-269289955be4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:09:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 90528ac4-b8d9-412c-a1de-d78faaa53353 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:09:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:09:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:09:53 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:09:53 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:09:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:09:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:09:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:09:59 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:09:59 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "8182b18c-8741-46b8-a431-269289955be4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "8182b18c-8741-46b8-a431-269289955be4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "8182b18c-8741-46b8-a431-269289955be4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "8182b18c-8741-46b8-a431-269289955be4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "8182b18c-8741-46b8-a431-269289955be4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:10:01 user nova-compute[75378]: INFO nova.compute.manager [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Terminating instance
Nov 09 04:10:01 user nova-compute[75378]: DEBUG nova.compute.manager [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG nova.compute.manager [req-a0c0be9f-52e6-4a91-b5ec-2c10ceceb4ec req-4af4c145-69e3-4610-9fc5-719653f1b3a3 service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] Received event network-vif-unplugged-bd3e4c98-1f54-4074-b993-a1ee9a124bf2 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a0c0be9f-52e6-4a91-b5ec-2c10ceceb4ec req-4af4c145-69e3-4610-9fc5-719653f1b3a3 service nova] Acquiring lock "8182b18c-8741-46b8-a431-269289955be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a0c0be9f-52e6-4a91-b5ec-2c10ceceb4ec req-4af4c145-69e3-4610-9fc5-719653f1b3a3 service nova] Lock "8182b18c-8741-46b8-a431-269289955be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a0c0be9f-52e6-4a91-b5ec-2c10ceceb4ec req-4af4c145-69e3-4610-9fc5-719653f1b3a3 service nova] Lock "8182b18c-8741-46b8-a431-269289955be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG nova.compute.manager [req-a0c0be9f-52e6-4a91-b5ec-2c10ceceb4ec req-4af4c145-69e3-4610-9fc5-719653f1b3a3 service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] No waiting events found dispatching network-vif-unplugged-bd3e4c98-1f54-4074-b993-a1ee9a124bf2 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG nova.compute.manager [req-a0c0be9f-52e6-4a91-b5ec-2c10ceceb4ec req-4af4c145-69e3-4610-9fc5-719653f1b3a3 service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] Received event network-vif-unplugged-bd3e4c98-1f54-4074-b993-a1ee9a124bf2 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:10:01 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 8182b18c-8741-46b8-a431-269289955be4] Instance destroyed successfully.
Nov 09 04:10:01 user nova-compute[75378]: DEBUG nova.objects.instance [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lazy-loading 'resources' on Instance uuid 8182b18c-8741-46b8-a431-269289955be4 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:06:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-776302532',display_name='tempest-AttachVolumeNegativeTest-server-776302532',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-776302532',id=42,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI73Q9R6unwMr8QUouMdi+QYHxHeooHiCqdf60WuaDVjq2G4UpsYcyK4hncxD7ABYgwkODi9ZTmVge+ijzX3SObnao3lFft+VChT7M1IUDRMnVb7Ovn9NJWf4zKJHQdRGQ==',key_name='tempest-keypair-757121100',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:06:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d990b7b4c19436d8cd8f43d8d0facb9',ramdisk_id='',reservation_id='r-0jm8wgab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-921155549',owner_user_name='tempest-AttachVolumeNegativeTest-921155549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T04:06:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2afcdb0627e34b6e893b7981ea4615e3',uuid=8182b18c-8741-46b8-a431-269289955be4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "address": "fa:16:3e:83:19:2a", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3e4c98-1f", "ovs_interfaceid": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converting VIF {"id": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "address": "fa:16:3e:83:19:2a", "network": {"id": "bf9b5a0d-886c-4f1b-9e73-a0551e263ae8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-203440475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d990b7b4c19436d8cd8f43d8d0facb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3e4c98-1f", "ovs_interfaceid": "bd3e4c98-1f54-4074-b993-a1ee9a124bf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:19:2a,bridge_name='br-int',has_traffic_filtering=True,id=bd3e4c98-1f54-4074-b993-a1ee9a124bf2,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd3e4c98-1f') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG os_vif [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:19:2a,bridge_name='br-int',has_traffic_filtering=True,id=bd3e4c98-1f54-4074-b993-a1ee9a124bf2,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd3e4c98-1f') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd3e4c98-1f, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b078d5ce-cf06-4569-a690-3afae49b3c99) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:01 user nova-compute[75378]: INFO os_vif [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:19:2a,bridge_name='br-int',has_traffic_filtering=True,id=bd3e4c98-1f54-4074-b993-a1ee9a124bf2,network=Network(bf9b5a0d-886c-4f1b-9e73-a0551e263ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd3e4c98-1f')
Nov 09 04:10:01 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Deleting instance files /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4_del
Nov 09 04:10:01 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Deletion of /opt/stack/data/nova/instances/8182b18c-8741-46b8-a431-269289955be4_del complete
Nov 09 04:10:02 user nova-compute[75378]: INFO nova.compute.manager [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] [instance: 8182b18c-8741-46b8-a431-269289955be4] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 09 04:10:02 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:10:02 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 8182b18c-8741-46b8-a431-269289955be4] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:10:02 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 8182b18c-8741-46b8-a431-269289955be4] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:10:03 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 8182b18c-8741-46b8-a431-269289955be4] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:10:03 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 8182b18c-8741-46b8-a431-269289955be4] Took 1.02 seconds to deallocate network for instance.
Nov 09 04:10:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:10:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:10:03 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:10:03 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:10:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:10:03 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Deleted allocations for instance 8182b18c-8741-46b8-a431-269289955be4
Nov 09 04:10:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-56a5b8e7-15c2-4182-9552-7ca44b6bd126 tempest-AttachVolumeNegativeTest-921155549 tempest-AttachVolumeNegativeTest-921155549-project-member] Lock "8182b18c-8741-46b8-a431-269289955be4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.179s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:10:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-46878160-992c-4140-89c6-8d557c4f6e00 req-7103fa83-d409-47d6-a8e8-23df8cad1116 service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] Received event network-vif-plugged-bd3e4c98-1f54-4074-b993-a1ee9a124bf2 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:10:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-46878160-992c-4140-89c6-8d557c4f6e00 req-7103fa83-d409-47d6-a8e8-23df8cad1116 service nova] Acquiring lock "8182b18c-8741-46b8-a431-269289955be4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:10:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-46878160-992c-4140-89c6-8d557c4f6e00 req-7103fa83-d409-47d6-a8e8-23df8cad1116 service nova] Lock "8182b18c-8741-46b8-a431-269289955be4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:10:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-46878160-992c-4140-89c6-8d557c4f6e00 req-7103fa83-d409-47d6-a8e8-23df8cad1116 service nova] Lock "8182b18c-8741-46b8-a431-269289955be4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:10:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-46878160-992c-4140-89c6-8d557c4f6e00 req-7103fa83-d409-47d6-a8e8-23df8cad1116 service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] No waiting events found dispatching network-vif-plugged-bd3e4c98-1f54-4074-b993-a1ee9a124bf2 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:10:03 user nova-compute[75378]: WARNING nova.compute.manager [req-46878160-992c-4140-89c6-8d557c4f6e00 req-7103fa83-d409-47d6-a8e8-23df8cad1116 service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] Received unexpected event network-vif-plugged-bd3e4c98-1f54-4074-b993-a1ee9a124bf2 for instance with vm_state deleted and task_state None.
Nov 09 04:10:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-46878160-992c-4140-89c6-8d557c4f6e00 req-7103fa83-d409-47d6-a8e8-23df8cad1116 service nova] [instance: 8182b18c-8741-46b8-a431-269289955be4] Received event network-vif-deleted-bd3e4c98-1f54-4074-b993-a1ee9a124bf2 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:10:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:10:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:10:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:10:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:10:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db8ea945-1e61-48cf-a684-e7469a149d34 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Acquiring lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:10:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db8ea945-1e61-48cf-a684-e7469a149d34 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:10:12 user nova-compute[75378]: DEBUG nova.objects.instance [None req-db8ea945-1e61-48cf-a684-e7469a149d34 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lazy-loading 'flavor' on Instance uuid 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:10:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db8ea945-1e61-48cf-a684-e7469a149d34 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db8ea945-1e61-48cf-a684-e7469a149d34 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Acquiring lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db8ea945-1e61-48cf-a684-e7469a149d34 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:10:13 user nova-compute[75378]: INFO nova.compute.manager [None req-db8ea945-1e61-48cf-a684-e7469a149d34 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Attaching volume 15cd27d4-02c2-4853-970d-5ec13e91a023 to /dev/vdb
Nov 09 04:10:13 user nova-compute[75378]: DEBUG os_brick.utils [None req-db8ea945-1e61-48cf-a684-e7469a149d34 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d30edd-c2b3-4be1-9571-13268bb48bee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[492208d5-7a8f-416d-823e-1e8320e811a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6675a0-1789-42d4-aaa7-b0420c8f676f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e104fea3-3741-4f81-99f8-44f62a9bbe4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-db8ea945-1e61-48cf-a684-e7469a149d34 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-db8ea945-1e61-48cf-a684-e7469a149d34 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db8ea945-1e61-48cf-a684-e7469a149d34 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:10:13 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 04:10:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e1ffc6-4366-4083-ba64-f918372d444b]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-db8ea945-1e61-48cf-a684-e7469a149d34 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-db8ea945-1e61-48cf-a684-e7469a149d34 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-db8ea945-1e61-48cf-a684-e7469a149d34 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG os_brick.utils [None req-db8ea945-1e61-48cf-a684-e7469a149d34 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:10:13 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-db8ea945-1e61-48cf-a684-e7469a149d34 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Updating existing volume attachment record: 9680cbe1-06ab-43f1-aa75-71fe935180a1 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 04:10:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:10:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "90528ac4-b8d9-412c-a1de-d78faaa53353" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:10:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "90528ac4-b8d9-412c-a1de-d78faaa53353" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:10:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "90528ac4-b8d9-412c-a1de-d78faaa53353-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:10:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "90528ac4-b8d9-412c-a1de-d78faaa53353-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:10:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "90528ac4-b8d9-412c-a1de-d78faaa53353-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:10:26 user nova-compute[75378]: INFO nova.compute.manager [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Terminating instance
Nov 09 04:10:27 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-02eddd14-1b56-40ea-a683-45e0a118088c req-55beddfc-916c-4ee6-a186-754ee8cec8da service nova] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Received event network-vif-unplugged-8019be7d-ce14-4310-b86a-b9aea64fd032 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-02eddd14-1b56-40ea-a683-45e0a118088c req-55beddfc-916c-4ee6-a186-754ee8cec8da service nova] Acquiring lock "90528ac4-b8d9-412c-a1de-d78faaa53353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-02eddd14-1b56-40ea-a683-45e0a118088c req-55beddfc-916c-4ee6-a186-754ee8cec8da service nova] Lock "90528ac4-b8d9-412c-a1de-d78faaa53353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-02eddd14-1b56-40ea-a683-45e0a118088c req-55beddfc-916c-4ee6-a186-754ee8cec8da service nova] Lock "90528ac4-b8d9-412c-a1de-d78faaa53353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-02eddd14-1b56-40ea-a683-45e0a118088c req-55beddfc-916c-4ee6-a186-754ee8cec8da service nova] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] No waiting events found dispatching network-vif-unplugged-8019be7d-ce14-4310-b86a-b9aea64fd032 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG nova.compute.manager [req-02eddd14-1b56-40ea-a683-45e0a118088c req-55beddfc-916c-4ee6-a186-754ee8cec8da service nova] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Received event network-vif-unplugged-8019be7d-ce14-4310-b86a-b9aea64fd032 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:10:27 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Instance destroyed successfully.
Nov 09 04:10:27 user nova-compute[75378]: DEBUG nova.objects.instance [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lazy-loading 'resources' on Instance uuid 90528ac4-b8d9-412c-a1de-d78faaa53353 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:08:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2096428556',display_name='tempest-TestVolumeBootPattern-server-2096428556',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2096428556',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:09:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed5a4bfe6ce546d2acfbf7be75334d1a',ramdisk_id='',reservation_id='r-njmq6hk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1436829014',owner_user_name='tempest-TestVolumeBootPattern-1436829014-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T04:09:12Z,user_data=None,user_id='23b841529aaf42c29a442ef9524422b2',uuid=90528ac4-b8d9-412c-a1de-d78faaa53353,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8019be7d-ce14-4310-b86a-b9aea64fd032", "address": "fa:16:3e:2e:6a:30", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8019be7d-ce", "ovs_interfaceid": "8019be7d-ce14-4310-b86a-b9aea64fd032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converting VIF {"id": "8019be7d-ce14-4310-b86a-b9aea64fd032", "address": "fa:16:3e:2e:6a:30", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8019be7d-ce", "ovs_interfaceid": "8019be7d-ce14-4310-b86a-b9aea64fd032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:6a:30,bridge_name='br-int',has_traffic_filtering=True,id=8019be7d-ce14-4310-b86a-b9aea64fd032,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8019be7d-ce') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG os_vif [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:6a:30,bridge_name='br-int',has_traffic_filtering=True,id=8019be7d-ce14-4310-b86a-b9aea64fd032,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8019be7d-ce') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8019be7d-ce, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4efb2455-50cb-453c-901b-0b019474fef4) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:10:27 user nova-compute[75378]: INFO os_vif [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:6a:30,bridge_name='br-int',has_traffic_filtering=True,id=8019be7d-ce14-4310-b86a-b9aea64fd032,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8019be7d-ce')
Nov 09 04:10:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puzAlQDM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:10:27 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:10:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b0017e-a81c-496f-be30-e21ef1f28c37]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 04:10:27 user nova-compute[75378]: No targets found.
Nov 09 04:10:27 user nova-compute[75378]: iSNS:
Nov 09 04:10:27 user nova-compute[75378]: No targets found.
Nov 09 04:10:27 user nova-compute[75378]: STATIC:
Nov 09 04:10:27 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2
Nov 09 04:10:27 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:10:27 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:10:27 user nova-compute[75378]: FIRMWARE:
Nov 09 04:10:27 user nova-compute[75378]: No targets found.
Nov 09 04:10:27 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 04:10:27 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 04:10:27 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8091b6b3-032f-42f6-b8a0-6742d5eb513b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3ba503-b14f-48f5-9848-55c51217e18d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 (non-flash)
Nov 09 04:10:27 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 (non-flash)
Nov 09 04:10:27 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3b053e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2'): ({'sdc'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Removing single pathed devices sdc {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a07556-1ad6-4490-961b-06e2974d8b0b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[db62562f-777a-46e6-ab48-0d6d03574f06]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Flushing IO for device /dev/sdc {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[584fc02e-45ea-476d-a75e-e62153c1224d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5592844-4498-43ce-8d37-b3bb3fe085ba]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] SCSI volumes sdc have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO94735e85-1a9d963b4f282475', '/dev/disk/by-id/scsi-23161396439363362', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_94735e85') {{(pid=87049) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[98619642-80b5-465f-bbc1-451ea8d84d41]: (4, None) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c5a79f-d7f6-4fca-8a3f-7fb90a8858a2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:10:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:10:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:10:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a7e830-bf6a-463e-b6b9-e9ecb077ab79]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:10:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2, portal: 172.16.0.220,3260]
Nov 09 04:10:28 user nova-compute[75378]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2, portal: 172.16.0.220,3260] successful.
Nov 09 04:10:28 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:10:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:10:28 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df2bdbf9-1ee6-4f74-854d-7790dd7336d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:10:28 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f6fa79-23d3-46fd-965d-7c17a230ac82]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:10:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:10:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:10:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] <== disconnect_volume: return (291ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:10:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 04:10:28 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Deleting instance files /opt/stack/data/nova/instances/90528ac4-b8d9-412c-a1de-d78faaa53353_del
Nov 09 04:10:28 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Deletion of /opt/stack/data/nova/instances/90528ac4-b8d9-412c-a1de-d78faaa53353_del complete
Nov 09 04:10:28 user nova-compute[75378]: INFO nova.compute.manager [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 09 04:10:28 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:10:28 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:10:28 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:10:28 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:10:28 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Took 0.53 seconds to deallocate network for instance.
Nov 09 04:10:28 user nova-compute[75378]: DEBUG nova.compute.manager [req-6411ac9b-5dd1-439c-9192-f75645ee76e9 req-6d294d07-f389-42dc-b79b-49314504d674 service nova] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Received event network-vif-deleted-8019be7d-ce14-4310-b86a-b9aea64fd032 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:10:29 user nova-compute[75378]: INFO nova.compute.manager [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Took 0.88 seconds to detach 1 volumes for instance.
Nov 09 04:10:29 user nova-compute[75378]: DEBUG nova.compute.manager [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Deleting volume: df2bdbf9-1ee6-4f74-854d-7790dd7336d2 {{(pid=75378) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 09 04:10:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-f01fcecf-aba2-4cf3-93ff-aeb989e28268 req-be8ee364-810c-4844-96c8-84498fcd89c3 service nova] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Received event network-vif-plugged-8019be7d-ce14-4310-b86a-b9aea64fd032 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:10:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f01fcecf-aba2-4cf3-93ff-aeb989e28268 req-be8ee364-810c-4844-96c8-84498fcd89c3 service nova] Acquiring lock "90528ac4-b8d9-412c-a1de-d78faaa53353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:10:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f01fcecf-aba2-4cf3-93ff-aeb989e28268 req-be8ee364-810c-4844-96c8-84498fcd89c3 service nova] Lock "90528ac4-b8d9-412c-a1de-d78faaa53353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:10:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f01fcecf-aba2-4cf3-93ff-aeb989e28268 req-be8ee364-810c-4844-96c8-84498fcd89c3 service nova] Lock "90528ac4-b8d9-412c-a1de-d78faaa53353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:10:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-f01fcecf-aba2-4cf3-93ff-aeb989e28268 req-be8ee364-810c-4844-96c8-84498fcd89c3 service nova] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] No waiting events found dispatching network-vif-plugged-8019be7d-ce14-4310-b86a-b9aea64fd032 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:10:29 user nova-compute[75378]: WARNING nova.compute.manager [req-f01fcecf-aba2-4cf3-93ff-aeb989e28268 req-be8ee364-810c-4844-96c8-84498fcd89c3 service nova] [instance: 90528ac4-b8d9-412c-a1de-d78faaa53353] Received unexpected event network-vif-plugged-8019be7d-ce14-4310-b86a-b9aea64fd032 for instance with vm_state active and task_state deleting.
Nov 09 04:10:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:10:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:10:29 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:10:29 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:10:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:10:29 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Deleted allocations for instance 90528ac4-b8d9-412c-a1de-d78faaa53353
Nov 09 04:10:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d3375b74-70e7-4c43-ba9f-47e233ac03e5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "90528ac4-b8d9-412c-a1de-d78faaa53353" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.009s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.volume.cinder [None req-db8ea945-1e61-48cf-a684-e7469a149d34 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Update attachment failed for attachment 9680cbe1-06ab-43f1-aa75-71fe935180a1. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-01f5d395-ebe0-497b-afd2-fbb79852cec5) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-01f5d395-ebe0-497b-afd2-fbb79852cec5)
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [None req-db8ea945-1e61-48cf-a684-e7469a149d34 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Failed to attach 15cd27d4-02c2-4853-970d-5ec13e91a023 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-01f5d395-ebe0-497b-afd2-fbb79852cec5)
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Traceback (most recent call last):
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]     ret_val = method(obj, context, *args, **kwargs)
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]     self._do_attach(context, instance, volume, volume_api,
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]     self._volume_attach(context, volume, connector, instance,
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]     connection_info = volume_api.attachment_update(
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]     res = method(self, ctx, *args, **kwargs)
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]     with excutils.save_and_reraise_exception():
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]     self.force_reraise()
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]     raise self.value
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]     context, '3.44', skip_version_check=True).attachments.update(
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]     return method.func(obj, *args, **kwargs)
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]     resp = self._update('/attachments/%s' % id, body)
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]     return self._cs_request(url, 'PUT', **kwargs)
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]     return self.request(url, method, **kwargs)
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8]     raise exceptions.from_response(resp, body)
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-01f5d395-ebe0-497b-afd2-fbb79852cec5)
Nov 09 04:10:30 user nova-compute[75378]: ERROR nova.compute.manager [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] 
Nov 09 04:10:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db8ea945-1e61-48cf-a684-e7469a149d34 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.176s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server [None req-db8ea945-1e61-48cf-a684-e7469a149d34 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-01f5d395-ebe0-497b-afd2-fbb79852cec5)
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-01f5d395-ebe0-497b-afd2-fbb79852cec5)
Nov 09 04:10:30 user nova-compute[75378]: ERROR oslo_messaging.rpc.server 
Nov 09 04:10:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:47 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:10:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:10:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:49 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:10:49 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:10:49 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 09 04:10:49 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Didn't find any instances for network info cache update. {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 04:10:49 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:10:50 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:10:52 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:10:52 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:10:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:10:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:10:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:10:52 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:10:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:10:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:10:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:10:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:10:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:53 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:10:53 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:10:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8789MB free_disk=25.22400665283203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:10:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:10:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:10:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:10:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:10:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:10:53 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:10:53 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:10:53 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:10:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:10:54 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:10:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:10:59 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:11:00 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:11:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:11:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:11:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:11:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:11:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:20 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:11:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:11:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:11:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:11:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:11:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:11:25 user nova-compute[75378]: INFO nova.compute.manager [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Unshelving
Nov 09 04:11:25 user nova-compute[75378]: INFO nova.virt.block_device [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Booting with volume 6b686005-1798-4789-9c2e-fb0871bb1c1c at /dev/vdc
Nov 09 04:11:25 user nova-compute[75378]: DEBUG os_brick.utils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25e8820-c52d-4b15-b09e-9d397939a0cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[317e5619-1deb-49ac-af4e-78d01b8b2101]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a56fc1e-5b77-4ffd-82a9-0ffea5fe1f5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5640ba-f5b7-4a54-a65c-600253e49f2c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:11:25 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 04:11:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[84de6e5d-31e6-495c-860a-e0354cede8b2]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG os_brick.utils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:11:25 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Updating existing volume attachment record: 9c639514-3f07-4f22-9566-388fa9928b5f {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 04:11:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:47 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:11:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:11:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:11:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:11:48 user nova-compute[75378]: DEBUG nova.objects.instance [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lazy-loading 'pci_requests' on Instance uuid a2b8cb57-54fb-4474-88dd-891c8e1638e9 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:11:48 user nova-compute[75378]: DEBUG nova.objects.instance [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lazy-loading 'numa_topology' on Instance uuid a2b8cb57-54fb-4474-88dd-891c8e1638e9 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:11:48 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 04:11:48 user nova-compute[75378]: INFO nova.compute.claims [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Claim successful on node user
Nov 09 04:11:48 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:11:48 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:11:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:11:49 user nova-compute[75378]: INFO nova.network.neutron [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Updating port 9581b2b1-98c1-465a-baaf-4c83ed1c0534 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 09 04:11:49 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:11:49 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:11:49 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Rebuilding the list of instances to heal {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 04:11:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:11:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:11:49 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 04:11:49 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lazy-loading 'info_cache' on Instance uuid 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:11:49 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Updating instance_info_cache with network_info: [{"id": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "address": "fa:16:3e:da:50:7a", "network": {"id": "9b84419f-fb2f-455e-8788-7c8635dc5695", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-535897341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b9133412a8747f2ab2c26619adff95a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8136caa1-a3", "ovs_interfaceid": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:11:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:11:49 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 04:11:49 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:11:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:11:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquired lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:11:49 user nova-compute[75378]: DEBUG nova.network.neutron [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:11:49 user nova-compute[75378]: DEBUG nova.compute.manager [req-c39e640b-fc84-448c-a423-d882bea2ccaa req-d7f32844-cf84-4764-b8b2-32a841734a59 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Received event network-changed-9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:11:49 user nova-compute[75378]: DEBUG nova.compute.manager [req-c39e640b-fc84-448c-a423-d882bea2ccaa req-d7f32844-cf84-4764-b8b2-32a841734a59 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Refreshing instance network info cache due to event network-changed-9581b2b1-98c1-465a-baaf-4c83ed1c0534. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:11:49 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c39e640b-fc84-448c-a423-d882bea2ccaa req-d7f32844-cf84-4764-b8b2-32a841734a59 service nova] Acquiring lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:11:50 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:11:50 user nova-compute[75378]: DEBUG nova.network.neutron [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Updating instance_info_cache with network_info: [{"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:11:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Releasing lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:11:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 04:11:50 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Creating image(s)
Nov 09 04:11:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:11:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "/opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:11:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "/opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:11:50 user nova-compute[75378]: DEBUG nova.objects.instance [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lazy-loading 'trusted_certs' on Instance uuid a2b8cb57-54fb-4474-88dd-891c8e1638e9 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:11:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c39e640b-fc84-448c-a423-d882bea2ccaa req-d7f32844-cf84-4764-b8b2-32a841734a59 service nova] Acquired lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:11:50 user nova-compute[75378]: DEBUG nova.network.neutron [req-c39e640b-fc84-448c-a423-d882bea2ccaa req-d7f32844-cf84-4764-b8b2-32a841734a59 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Refreshing network info cache for port 9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:11:50 user nova-compute[75378]: DEBUG nova.objects.base [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Object Instance<a2b8cb57-54fb-4474-88dd-891c8e1638e9> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 04:11:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "202f06225dfa01b9bd611f36bc920c24eaa2f230" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:11:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "202f06225dfa01b9bd611f36bc920c24eaa2f230" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:11:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/202f06225dfa01b9bd611f36bc920c24eaa2f230.part --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/202f06225dfa01b9bd611f36bc920c24eaa2f230.part --force-share --output=json" returned: 0 in 0.176s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:51 user nova-compute[75378]: DEBUG nova.virt.images [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] d51e7d5f-b1df-48af-a517-a9f8c7a6270d was qcow2, converting to raw {{(pid=75378) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 04:11:51 user nova-compute[75378]: DEBUG nova.privsep.utils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75378) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 04:11:51 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/202f06225dfa01b9bd611f36bc920c24eaa2f230.part /opt/stack/data/nova/instances/_base/202f06225dfa01b9bd611f36bc920c24eaa2f230.converted {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:51 user nova-compute[75378]: DEBUG nova.network.neutron [req-c39e640b-fc84-448c-a423-d882bea2ccaa req-d7f32844-cf84-4764-b8b2-32a841734a59 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Updated VIF entry in instance network info cache for port 9581b2b1-98c1-465a-baaf-4c83ed1c0534. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:11:51 user nova-compute[75378]: DEBUG nova.network.neutron [req-c39e640b-fc84-448c-a423-d882bea2ccaa req-d7f32844-cf84-4764-b8b2-32a841734a59 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Updating instance_info_cache with network_info: [{"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:11:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c39e640b-fc84-448c-a423-d882bea2ccaa req-d7f32844-cf84-4764-b8b2-32a841734a59 service nova] Releasing lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:11:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/202f06225dfa01b9bd611f36bc920c24eaa2f230.part /opt/stack/data/nova/instances/_base/202f06225dfa01b9bd611f36bc920c24eaa2f230.converted" returned: 0 in 0.620s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/202f06225dfa01b9bd611f36bc920c24eaa2f230.converted --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/202f06225dfa01b9bd611f36bc920c24eaa2f230.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "202f06225dfa01b9bd611f36bc920c24eaa2f230" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.085s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:11:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/202f06225dfa01b9bd611f36bc920c24eaa2f230 --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/202f06225dfa01b9bd611f36bc920c24eaa2f230 --force-share --output=json" returned: 0 in 0.177s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "202f06225dfa01b9bd611f36bc920c24eaa2f230" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:11:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "202f06225dfa01b9bd611f36bc920c24eaa2f230" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:11:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/202f06225dfa01b9bd611f36bc920c24eaa2f230 --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/202f06225dfa01b9bd611f36bc920c24eaa2f230 --force-share --output=json" returned: 0 in 0.193s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/202f06225dfa01b9bd611f36bc920c24eaa2f230,backing_fmt=raw /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/202f06225dfa01b9bd611f36bc920c24eaa2f230,backing_fmt=raw /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk 1073741824" returned: 0 in 0.052s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "202f06225dfa01b9bd611f36bc920c24eaa2f230" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:11:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/202f06225dfa01b9bd611f36bc920c24eaa2f230 --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:52 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/202f06225dfa01b9bd611f36bc920c24eaa2f230 --force-share --output=json" returned: 0 in 0.177s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:52 user nova-compute[75378]: DEBUG nova.objects.instance [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lazy-loading 'migration_context' on Instance uuid a2b8cb57-54fb-4474-88dd-891c8e1638e9 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:11:53 user nova-compute[75378]: DEBUG nova.objects.base [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Object Instance<a2b8cb57-54fb-4474-88dd-891c8e1638e9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 04:11:53 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Rebasing disk image.
Nov 09 04:11:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:53 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:11:53 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:11:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a -F raw /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:54 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:11:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:11:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:11:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:11:54 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:11:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:55 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:11:55 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=25.091609954833984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (47051f37-c496-4978-8e02-d2f1a5bbf8b8): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a -F raw /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk" returned: 0 in 2.460s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Ensure instance console log exists: /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Start _get_guest_xml network_info=[{"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='3a9a25392eff630fedd3818383adc509',container_format='bare',created_at=2023-11-09T04:09:33Z,direct_url=<?>,disk_format='qcow2',id=d51e7d5f-b1df-48af-a517-a9f8c7a6270d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-626146740-shelved',owner='3c5788a86f2c4fcab582d65b471fe27e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-09T04:09:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NILKZojs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'a2b8cb57-54fb-4474-88dd-891c8e1638e9', 'attached_at': '', 'detached_at': '', 'volume_id': '6b686005-1798-4789-9c2e-fb0871bb1c1c', 'serial': '6b686005-1798-4789-9c2e-fb0871bb1c1c'}, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'boot_index': None, 'guest_format': None, 'attachment_id': '9c639514-3f07-4f22-9566-388fa9928b5f', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 04:11:55 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:11:55 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3a9a25392eff630fedd3818383adc509',container_format='bare',created_at=2023-11-09T04:09:33Z,direct_url=<?>,disk_format='qcow2',id=d51e7d5f-b1df-48af-a517-a9f8c7a6270d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-626146740-shelved',owner='3c5788a86f2c4fcab582d65b471fe27e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-09T04:09:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.objects.instance [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lazy-loading 'vcpu_model' on Instance uuid a2b8cb57-54fb-4474-88dd-891c8e1638e9 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.objects.base [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Object Instance<a2b8cb57-54fb-4474-88dd-891c8e1638e9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NILKZojs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:11:55 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:11:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:11:55 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:11:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:11:55 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c382c475-f36b-4b76-818b-ef3f4bca839b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 04:11:55 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0074517d-be95-4549-9c44-7c9e988a63d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c] added
Nov 09 04:11:55 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2b4eaf-c57c-4f96-b8fb-dc894d268ad0]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[170118da-10ca-4f48-a6bd-fa36c236097c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NILKZojs {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NILKZojs" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2d9646-569c-4ecc-942a-73fee9593e65]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NILKZojs'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bae784-bd11-4597-bea8-1bdda52dd0ce]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dce17b8-6cab-4728-ad43-d69733215b49]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 04:11:55 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 04:11:55 user nova-compute[75378]:  {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:11:55 user nova-compute[75378]: WARNING os_brick.initiator.connectors.iscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 04:11:55 user nova-compute[75378]: 
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[49239b6a-23fb-4b02-9211-704f4126e31a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c, portal: 172.16.0.220,3260]
Nov 09 04:11:55 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c, portal: 172.16.0.220,3260] successful.
Nov 09 04:11:55 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2464635-1d3c-41f9-84a7-ea3fc063e479]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaa1868-756c-406a-ae3f-328e35a89102]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c (non-flash)
Nov 09 04:11:55 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c (non-flash)
Nov 09 04:11:55 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 04:11:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:11:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:11:56 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[83be8d8f-9fcc-40a7-bf72-c7b6d40288c6]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:11:56 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NILKZojs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23765643665393137', 'path': '/dev/sdb'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765643665393137', 'path': '/dev/sdb'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T04:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-626146740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-626146740',id=43,image_ref='d51e7d5f-b1df-48af-a517-a9f8c7a6270d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1732741146',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3c5788a86f2c4fcab582d65b471fe27e',ramdisk_id='',reservation_id='r-e0hnehzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1244090539',owner_user_name='tempest-AttachVolumeShelveTestJSON-1244090539-project-member',shelved_at='2023-11-09T04:09:37.218911',shelved_host='user',shelved_image_id='d51e7d5f-b1df-48af-a517-a9f8c7a6270d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:11:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f996e26d3a04dd8ba5a64eaa218a9b3',uuid=a2b8cb57-54fb-4474-88dd-891c8e1638e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converting VIF {"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=9581b2b1-98c1-465a-baaf-4c83ed1c0534,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581b2b1-98') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG nova.objects.instance [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lazy-loading 'pci_devices' on Instance uuid a2b8cb57-54fb-4474-88dd-891c8e1638e9 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG nova.objects.base [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Object Instance<a2b8cb57-54fb-4474-88dd-891c8e1638e9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] End _get_guest_xml xml=<domain type="kvm">
Nov 09 04:11:57 user nova-compute[75378]:   <uuid>a2b8cb57-54fb-4474-88dd-891c8e1638e9</uuid>
Nov 09 04:11:57 user nova-compute[75378]:   <name>instance-0000002b</name>
Nov 09 04:11:57 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 04:11:57 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 04:11:57 user nova-compute[75378]:   <metadata>
Nov 09 04:11:57 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 04:11:57 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 04:11:57 user nova-compute[75378]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-626146740</nova:name>
Nov 09 04:11:57 user nova-compute[75378]:       <nova:creationTime>2023-11-09 04:11:55</nova:creationTime>
Nov 09 04:11:57 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 04:11:57 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 04:11:57 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 04:11:57 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 04:11:57 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 04:11:57 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 04:11:57 user nova-compute[75378]:       </nova:flavor>
Nov 09 04:11:57 user nova-compute[75378]:       <nova:owner>
Nov 09 04:11:57 user nova-compute[75378]:         <nova:user uuid="5f996e26d3a04dd8ba5a64eaa218a9b3">tempest-AttachVolumeShelveTestJSON-1244090539-project-member</nova:user>
Nov 09 04:11:57 user nova-compute[75378]:         <nova:project uuid="3c5788a86f2c4fcab582d65b471fe27e">tempest-AttachVolumeShelveTestJSON-1244090539</nova:project>
Nov 09 04:11:57 user nova-compute[75378]:       </nova:owner>
Nov 09 04:11:57 user nova-compute[75378]:       <nova:root type="image" uuid="d51e7d5f-b1df-48af-a517-a9f8c7a6270d"/>
Nov 09 04:11:57 user nova-compute[75378]:       <nova:ports>
Nov 09 04:11:57 user nova-compute[75378]:         <nova:port uuid="9581b2b1-98c1-465a-baaf-4c83ed1c0534">
Nov 09 04:11:57 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 09 04:11:57 user nova-compute[75378]:         </nova:port>
Nov 09 04:11:57 user nova-compute[75378]:       </nova:ports>
Nov 09 04:11:57 user nova-compute[75378]:     </nova:instance>
Nov 09 04:11:57 user nova-compute[75378]:   </metadata>
Nov 09 04:11:57 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 04:11:57 user nova-compute[75378]:     <system>
Nov 09 04:11:57 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 04:11:57 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 04:11:57 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 04:11:57 user nova-compute[75378]:       <entry name="serial">a2b8cb57-54fb-4474-88dd-891c8e1638e9</entry>
Nov 09 04:11:57 user nova-compute[75378]:       <entry name="uuid">a2b8cb57-54fb-4474-88dd-891c8e1638e9</entry>
Nov 09 04:11:57 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 04:11:57 user nova-compute[75378]:     </system>
Nov 09 04:11:57 user nova-compute[75378]:   </sysinfo>
Nov 09 04:11:57 user nova-compute[75378]:   <os>
Nov 09 04:11:57 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 04:11:57 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 04:11:57 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 04:11:57 user nova-compute[75378]:   </os>
Nov 09 04:11:57 user nova-compute[75378]:   <features>
Nov 09 04:11:57 user nova-compute[75378]:     <acpi/>
Nov 09 04:11:57 user nova-compute[75378]:     <apic/>
Nov 09 04:11:57 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 04:11:57 user nova-compute[75378]:   </features>
Nov 09 04:11:57 user nova-compute[75378]:   <clock offset="utc">
Nov 09 04:11:57 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 04:11:57 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 04:11:57 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 04:11:57 user nova-compute[75378]:   </clock>
Nov 09 04:11:57 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 04:11:57 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 04:11:57 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 04:11:57 user nova-compute[75378]:   </cpu>
Nov 09 04:11:57 user nova-compute[75378]:   <devices>
Nov 09 04:11:57 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 04:11:57 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 04:11:57 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk"/>
Nov 09 04:11:57 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 04:11:57 user nova-compute[75378]:     </disk>
Nov 09 04:11:57 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 04:11:57 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:11:57 user nova-compute[75378]:       <source dev="/dev/sdb"/>
Nov 09 04:11:57 user nova-compute[75378]:       <target dev="vdc" bus="virtio"/>
Nov 09 04:11:57 user nova-compute[75378]:       <serial>6b686005-1798-4789-9c2e-fb0871bb1c1c</serial>
Nov 09 04:11:57 user nova-compute[75378]:     </disk>
Nov 09 04:11:57 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 04:11:57 user nova-compute[75378]:       <mac address="fa:16:3e:08:cb:4e"/>
Nov 09 04:11:57 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:11:57 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 04:11:57 user nova-compute[75378]:       <target dev="tap9581b2b1-98"/>
Nov 09 04:11:57 user nova-compute[75378]:     </interface>
Nov 09 04:11:57 user nova-compute[75378]:     <serial type="pty">
Nov 09 04:11:57 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/console.log" append="off"/>
Nov 09 04:11:57 user nova-compute[75378]:     </serial>
Nov 09 04:11:57 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 04:11:57 user nova-compute[75378]:     <video>
Nov 09 04:11:57 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:11:57 user nova-compute[75378]:     </video>
Nov 09 04:11:57 user nova-compute[75378]:     <rng model="virtio">
Nov 09 04:11:57 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 04:11:57 user nova-compute[75378]:     </rng>
Nov 09 04:11:57 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 04:11:57 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 04:11:57 user nova-compute[75378]:       <stats period="10"/>
Nov 09 04:11:57 user nova-compute[75378]:     </memballoon>
Nov 09 04:11:57 user nova-compute[75378]:   </devices>
Nov 09 04:11:57 user nova-compute[75378]: </domain>
Nov 09 04:11:57 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T04:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-626146740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-626146740',id=43,image_ref='d51e7d5f-b1df-48af-a517-a9f8c7a6270d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1732741146',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3c5788a86f2c4fcab582d65b471fe27e',ramdisk_id='',reservation_id='r-e0hnehzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1244090539',owner_user_name='tempest-AttachVolumeShelveTestJSON-1244090539-project-member',shelved_at='2023-11-09T04:09:37.218911',shelved_host='user',shelved_image_id='d51e7d5f-b1df-48af-a517-a9f8c7a6270d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:11:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f996e26d3a04dd8ba5a64eaa218a9b3',uuid=a2b8cb57-54fb-4474-88dd-891c8e1638e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converting VIF {"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=9581b2b1-98c1-465a-baaf-4c83ed1c0534,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581b2b1-98') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG os_vif [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=9581b2b1-98c1-465a-baaf-4c83ed1c0534,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581b2b1-98') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2482b2b-86ae-5efb-90b5-6770fa7e54e7', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9581b2b1-98, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9581b2b1-98, col_values=(('qos', UUID('8c6f2d7a-ba2b-468f-afd9-2b9e5dd3a90a')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9581b2b1-98, col_values=(('external_ids', {'iface-id': '9581b2b1-98c1-465a-baaf-4c83ed1c0534', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:cb:4e', 'vm-uuid': 'a2b8cb57-54fb-4474-88dd-891c8e1638e9'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:57 user nova-compute[75378]: INFO os_vif [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=9581b2b1-98c1-465a-baaf-4c83ed1c0534,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581b2b1-98')
Nov 09 04:11:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:11:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] No VIF found with MAC fa:16:3e:08:cb:4e, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:11:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-78f51d0e-0211-4a2e-8e40-c2c73ee28853 req-6a19c81e-1de8-477a-b6d8-3532adec03fb service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Received event network-vif-plugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:11:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-78f51d0e-0211-4a2e-8e40-c2c73ee28853 req-6a19c81e-1de8-477a-b6d8-3532adec03fb service nova] Acquiring lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:11:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-78f51d0e-0211-4a2e-8e40-c2c73ee28853 req-6a19c81e-1de8-477a-b6d8-3532adec03fb service nova] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:11:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-78f51d0e-0211-4a2e-8e40-c2c73ee28853 req-6a19c81e-1de8-477a-b6d8-3532adec03fb service nova] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:11:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-78f51d0e-0211-4a2e-8e40-c2c73ee28853 req-6a19c81e-1de8-477a-b6d8-3532adec03fb service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] No waiting events found dispatching network-vif-plugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:11:59 user nova-compute[75378]: WARNING nova.compute.manager [req-78f51d0e-0211-4a2e-8e40-c2c73ee28853 req-6a19c81e-1de8-477a-b6d8-3532adec03fb service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Received unexpected event network-vif-plugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 09 04:11:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:11:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:00 user nova-compute[75378]: DEBUG nova.compute.manager [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 04:12:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 04:12:00 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Instance spawned successfully.
Nov 09 04:12:01 user nova-compute[75378]: DEBUG nova.compute.manager [req-7aa8ab5e-1839-474e-8699-43bb5bba2d5b req-e8dc9c99-2fcf-4ac2-a2de-2fba252eab47 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Received event network-vif-plugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:12:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7aa8ab5e-1839-474e-8699-43bb5bba2d5b req-e8dc9c99-2fcf-4ac2-a2de-2fba252eab47 service nova] Acquiring lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:12:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7aa8ab5e-1839-474e-8699-43bb5bba2d5b req-e8dc9c99-2fcf-4ac2-a2de-2fba252eab47 service nova] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:12:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-7aa8ab5e-1839-474e-8699-43bb5bba2d5b req-e8dc9c99-2fcf-4ac2-a2de-2fba252eab47 service nova] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:12:01 user nova-compute[75378]: DEBUG nova.compute.manager [req-7aa8ab5e-1839-474e-8699-43bb5bba2d5b req-e8dc9c99-2fcf-4ac2-a2de-2fba252eab47 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] No waiting events found dispatching network-vif-plugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:12:01 user nova-compute[75378]: WARNING nova.compute.manager [req-7aa8ab5e-1839-474e-8699-43bb5bba2d5b req-e8dc9c99-2fcf-4ac2-a2de-2fba252eab47 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Received unexpected event network-vif-plugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 09 04:12:01 user nova-compute[75378]: DEBUG nova.compute.manager [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:12:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "094fa4b5-9622-4971-99e1-e505da91612d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:12:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "094fa4b5-9622-4971-99e1-e505da91612d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:12:01 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:12:01 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:12:01 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 04:12:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:12:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:12:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-62e2fed5-8476-413e-b602-c2ae2c4a74e4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 36.371s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:12:01 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 04:12:01 user nova-compute[75378]: INFO nova.compute.claims [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Claim successful on node user
Nov 09 04:12:01 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:12:01 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:12:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.272s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:12:01 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 04:12:01 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 04:12:01 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 04:12:01 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 04:12:01 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 04:12:01 user nova-compute[75378]: INFO nova.virt.block_device [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Booting with volume 1541c7f1-31d0-4192-80f0-8d1201ad330e at /dev/vda
Nov 09 04:12:01 user nova-compute[75378]: DEBUG nova.policy [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23b841529aaf42c29a442ef9524422b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5a4bfe6ce546d2acfbf7be75334d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 04:12:01 user nova-compute[75378]: DEBUG os_brick.utils [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:12:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15c93d2-4741-4b3c-925e-4a9e8c91dddb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ae330a-5cdd-4e25-bc61-c7742c85118a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d0448c-5b4c-471a-9be2-771af3def64e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e391c76-2e04-4cda-a904-fac1fe58fef6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:12:02 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 04:12:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acc90b0-08ba-4a43-87ce-8f7e389d8d9b]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG os_brick.utils [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Updating existing volume attachment record: b570840e-3068-4101-8448-cb85818b7136 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:02 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Successfully created port: e44a956f-1034-4390-abc6-534499259134 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 04:12:03 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Successfully updated port: e44a956f-1034-4390-abc6-534499259134 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 04:12:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "refresh_cache-094fa4b5-9622-4971-99e1-e505da91612d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:12:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquired lock "refresh_cache-094fa4b5-9622-4971-99e1-e505da91612d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:12:03 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:12:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-6e01d88b-aec4-43c1-a567-dae6b9f10090 req-f0407e7e-a499-4b9f-a6fd-cfea9b0222a3 service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Received event network-changed-e44a956f-1034-4390-abc6-534499259134 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:12:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-6e01d88b-aec4-43c1-a567-dae6b9f10090 req-f0407e7e-a499-4b9f-a6fd-cfea9b0222a3 service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Refreshing instance network info cache due to event network-changed-e44a956f-1034-4390-abc6-534499259134. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:12:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6e01d88b-aec4-43c1-a567-dae6b9f10090 req-f0407e7e-a499-4b9f-a6fd-cfea9b0222a3 service nova] Acquiring lock "refresh_cache-094fa4b5-9622-4971-99e1-e505da91612d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:12:03 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 04:12:03 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Updating instance_info_cache with network_info: [{"id": "e44a956f-1034-4390-abc6-534499259134", "address": "fa:16:3e:3b:10:5b", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44a956f-10", "ovs_interfaceid": "e44a956f-1034-4390-abc6-534499259134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:12:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Releasing lock "refresh_cache-094fa4b5-9622-4971-99e1-e505da91612d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:12:03 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Instance network_info: |[{"id": "e44a956f-1034-4390-abc6-534499259134", "address": "fa:16:3e:3b:10:5b", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44a956f-10", "ovs_interfaceid": "e44a956f-1034-4390-abc6-534499259134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 04:12:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6e01d88b-aec4-43c1-a567-dae6b9f10090 req-f0407e7e-a499-4b9f-a6fd-cfea9b0222a3 service nova] Acquired lock "refresh_cache-094fa4b5-9622-4971-99e1-e505da91612d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:12:03 user nova-compute[75378]: DEBUG nova.network.neutron [req-6e01d88b-aec4-43c1-a567-dae6b9f10090 req-f0407e7e-a499-4b9f-a6fd-cfea9b0222a3 service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Refreshing network info cache for port e44a956f-1034-4390-abc6-534499259134 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:12:04 user nova-compute[75378]: DEBUG nova.network.neutron [req-6e01d88b-aec4-43c1-a567-dae6b9f10090 req-f0407e7e-a499-4b9f-a6fd-cfea9b0222a3 service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Updated VIF entry in instance network info cache for port e44a956f-1034-4390-abc6-534499259134. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:12:04 user nova-compute[75378]: DEBUG nova.network.neutron [req-6e01d88b-aec4-43c1-a567-dae6b9f10090 req-f0407e7e-a499-4b9f-a6fd-cfea9b0222a3 service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Updating instance_info_cache with network_info: [{"id": "e44a956f-1034-4390-abc6-534499259134", "address": "fa:16:3e:3b:10:5b", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44a956f-10", "ovs_interfaceid": "e44a956f-1034-4390-abc6-534499259134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:12:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6e01d88b-aec4-43c1-a567-dae6b9f10090 req-f0407e7e-a499-4b9f-a6fd-cfea9b0222a3 service nova] Releasing lock "refresh_cache-094fa4b5-9622-4971-99e1-e505da91612d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:12:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:12:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:12:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:12:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:12:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:12:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Verify base images {{(pid=75378) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75378) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Image id c162665b-54ae-441d-9cd1-28ea81cc5de8 yields fingerprint 2ef19bea51ac5815dc9f558430b64f7f4894d52a {{(pid=75378) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 09 04:12:14 user nova-compute[75378]: INFO nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] image c162665b-54ae-441d-9cd1-28ea81cc5de8 at (/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a): checking
Nov 09 04:12:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] image c162665b-54ae-441d-9cd1-28ea81cc5de8 at (/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a): image is in use {{(pid=75378) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] a2b8cb57-54fb-4474-88dd-891c8e1638e9 is a valid instance name {{(pid=75378) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] a2b8cb57-54fb-4474-88dd-891c8e1638e9 has a disk file {{(pid=75378) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance a2b8cb57-54fb-4474-88dd-891c8e1638e9 is backed by 2ef19bea51ac5815dc9f558430b64f7f4894d52a {{(pid=75378) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 is a valid instance name {{(pid=75378) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 has a disk file {{(pid=75378) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 is backed by 2ef19bea51ac5815dc9f558430b64f7f4894d52a {{(pid=75378) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 09 04:12:14 user nova-compute[75378]: WARNING nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Unknown base file: /opt/stack/data/nova/instances/_base/202f06225dfa01b9bd611f36bc920c24eaa2f230
Nov 09 04:12:14 user nova-compute[75378]: WARNING nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Unknown base file: /opt/stack/data/nova/instances/_base/ff07ce4742735dccee0af3bf163290ff8521ad3f
Nov 09 04:12:14 user nova-compute[75378]: WARNING nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Unknown base file: /opt/stack/data/nova/instances/_base/0704b21fa53749ea6370e6b8523fc27c4e3153c0
Nov 09 04:12:14 user nova-compute[75378]: WARNING nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Unknown base file: /opt/stack/data/nova/instances/_base/d4b423fcc307a74fcfc2182462d01c379a5095c1
Nov 09 04:12:14 user nova-compute[75378]: WARNING nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Unknown base file: /opt/stack/data/nova/instances/_base/d0b653d45eba3f0f4806dcb3e3c2dde64056dcfc
Nov 09 04:12:14 user nova-compute[75378]: WARNING nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Unknown base file: /opt/stack/data/nova/instances/_base/95d1604518a003fe86603e461a25fba6eadd5aed
Nov 09 04:12:14 user nova-compute[75378]: WARNING nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Unknown base file: /opt/stack/data/nova/instances/_base/2ca5561e008f7db90329a4f8d5b789cabb812bf7
Nov 09 04:12:14 user nova-compute[75378]: INFO nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Active base files: /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a
Nov 09 04:12:14 user nova-compute[75378]: INFO nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Removable base files: /opt/stack/data/nova/instances/_base/202f06225dfa01b9bd611f36bc920c24eaa2f230 /opt/stack/data/nova/instances/_base/ff07ce4742735dccee0af3bf163290ff8521ad3f /opt/stack/data/nova/instances/_base/0704b21fa53749ea6370e6b8523fc27c4e3153c0 /opt/stack/data/nova/instances/_base/d4b423fcc307a74fcfc2182462d01c379a5095c1 /opt/stack/data/nova/instances/_base/d0b653d45eba3f0f4806dcb3e3c2dde64056dcfc /opt/stack/data/nova/instances/_base/95d1604518a003fe86603e461a25fba6eadd5aed /opt/stack/data/nova/instances/_base/2ca5561e008f7db90329a4f8d5b789cabb812bf7
Nov 09 04:12:14 user nova-compute[75378]: INFO nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/202f06225dfa01b9bd611f36bc920c24eaa2f230
Nov 09 04:12:14 user nova-compute[75378]: INFO nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ff07ce4742735dccee0af3bf163290ff8521ad3f
Nov 09 04:12:14 user nova-compute[75378]: INFO nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0704b21fa53749ea6370e6b8523fc27c4e3153c0
Nov 09 04:12:14 user nova-compute[75378]: INFO nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d4b423fcc307a74fcfc2182462d01c379a5095c1
Nov 09 04:12:14 user nova-compute[75378]: INFO nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d0b653d45eba3f0f4806dcb3e3c2dde64056dcfc
Nov 09 04:12:14 user nova-compute[75378]: INFO nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/95d1604518a003fe86603e461a25fba6eadd5aed
Nov 09 04:12:14 user nova-compute[75378]: INFO nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2ca5561e008f7db90329a4f8d5b789cabb812bf7
Nov 09 04:12:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Verification complete {{(pid=75378) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Verify swap images {{(pid=75378) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 09 04:12:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.imagecache [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Verify ephemeral images {{(pid=75378) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 09 04:12:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:12:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:12:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:12:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:12:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 04:12:25 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Creating image(s)
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Did not create local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Ensure instance console log exists: /opt/stack/data/nova/instances/094fa4b5-9622-4971-99e1-e505da91612d/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Start _get_guest_xml network_info=[{"id": "e44a956f-1034-4390-abc6-534499259134", "address": "fa:16:3e:3b:10:5b", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44a956f-10", "ovs_interfaceid": "e44a956f-1034-4390-abc6-534499259134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdiyUEma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '094fa4b5-9622-4971-99e1-e505da91612d', 'attached_at': '', 'detached_at': '', 'volume_id': '1541c7f1-31d0-4192-80f0-8d1201ad330e', 'serial': '1541c7f1-31d0-4192-80f0-8d1201ad330e'}, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'b570840e-3068-4101-8448-cb85818b7136', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 04:12:25 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:12:25 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdiyUEma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:12:25 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:12:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:12:25 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:12:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:12:25 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d68ffb5-0e66-4204-a34c-e7907aaa5204]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 04:12:25 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b2d8d2-2680-4917-820a-91db2aa588f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e] added
Nov 09 04:12:25 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4202df2e-d289-403b-ba1e-5ec38fdd0eec]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e170f7-77b5-4981-bb91-b9cbe8f9737a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdiyUEma {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdiyUEma" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef77b435-f352-4465-9704-ef74e70c2ff6]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VdiyUEma'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[40424e39-3dca-4270-bd9b-0ea875138c5b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3a7db5-176f-458e-93f6-41b851955d2c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c (non-flash)
Nov 09 04:12:25 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c (non-flash)
Nov 09 04:12:25 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:25 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:12:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0c9319-9ced-431c-bc9e-6fc768a19de0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:12:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e, portal: 172.16.0.220,3260]
Nov 09 04:12:26 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e, portal: 172.16.0.220,3260] successful.
Nov 09 04:12:26 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:12:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:12:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[722cd897-379d-4582-9f59-a4f1f5532046]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:12:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:12:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:12:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5530e3-9c7e-4bb1-9eea-4165952247e4]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:12:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c (non-flash)
Nov 09 04:12:26 user nova-compute[75378]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)
Nov 09 04:12:26 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:12:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c (non-flash)
Nov 09 04:12:26 user nova-compute[75378]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)
Nov 09 04:12:26 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:12:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:12:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 04:12:26 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 04:12:26 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 04:12:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:12:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b567e286-a9f3-45b9-b20e-93e333c6c8f8]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:12:26 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:12:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdiyUEma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23837343061396162', 'path': '/dev/sdc'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837343061396162', 'path': '/dev/sdc'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:12:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-687411826',display_name='tempest-TestVolumeBootPattern-volume-backed-server-687411826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-687411826',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz++QGmz4c35ArnzRRLJGoYgaQNUqL5bnNCPxYEZuVxbqdkm7Bu3ybnWcuW3bXUNOh5bfJ60/9UhkdIQK4h2dQ9c+vr+M7YxEy1Yayd5Zqf9UqqOw1YKGKLU96jjVA+aA==',key_name='tempest-keypair-2083989440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed5a4bfe6ce546d2acfbf7be75334d1a',ramdisk_id='',reservation_id='r-gamxy5y4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1436829014',owner_user_name='tempest-TestVolumeBootPattern-1436829014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:12:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23b841529aaf42c29a442ef9524422b2',uuid=094fa4b5-9622-4971-99e1-e505da91612d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e44a956f-1034-4390-abc6-534499259134", "address": "fa:16:3e:3b:10:5b", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44a956f-10", "ovs_interfaceid": "e44a956f-1034-4390-abc6-534499259134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converting VIF {"id": "e44a956f-1034-4390-abc6-534499259134", "address": "fa:16:3e:3b:10:5b", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44a956f-10", "ovs_interfaceid": "e44a956f-1034-4390-abc6-534499259134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:10:5b,bridge_name='br-int',has_traffic_filtering=True,id=e44a956f-1034-4390-abc6-534499259134,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44a956f-10') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG nova.objects.instance [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lazy-loading 'pci_devices' on Instance uuid 094fa4b5-9622-4971-99e1-e505da91612d {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] End _get_guest_xml xml=<domain type="kvm">
Nov 09 04:12:27 user nova-compute[75378]:   <uuid>094fa4b5-9622-4971-99e1-e505da91612d</uuid>
Nov 09 04:12:27 user nova-compute[75378]:   <name>instance-0000002d</name>
Nov 09 04:12:27 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 04:12:27 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 04:12:27 user nova-compute[75378]:   <metadata>
Nov 09 04:12:27 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 04:12:27 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 04:12:27 user nova-compute[75378]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-687411826</nova:name>
Nov 09 04:12:27 user nova-compute[75378]:       <nova:creationTime>2023-11-09 04:12:25</nova:creationTime>
Nov 09 04:12:27 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 04:12:27 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 04:12:27 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 04:12:27 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 04:12:27 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 04:12:27 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 04:12:27 user nova-compute[75378]:       </nova:flavor>
Nov 09 04:12:27 user nova-compute[75378]:       <nova:owner>
Nov 09 04:12:27 user nova-compute[75378]:         <nova:user uuid="23b841529aaf42c29a442ef9524422b2">tempest-TestVolumeBootPattern-1436829014-project-member</nova:user>
Nov 09 04:12:27 user nova-compute[75378]:         <nova:project uuid="ed5a4bfe6ce546d2acfbf7be75334d1a">tempest-TestVolumeBootPattern-1436829014</nova:project>
Nov 09 04:12:27 user nova-compute[75378]:       </nova:owner>
Nov 09 04:12:27 user nova-compute[75378]:       <nova:ports>
Nov 09 04:12:27 user nova-compute[75378]:         <nova:port uuid="e44a956f-1034-4390-abc6-534499259134">
Nov 09 04:12:27 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 04:12:27 user nova-compute[75378]:         </nova:port>
Nov 09 04:12:27 user nova-compute[75378]:       </nova:ports>
Nov 09 04:12:27 user nova-compute[75378]:     </nova:instance>
Nov 09 04:12:27 user nova-compute[75378]:   </metadata>
Nov 09 04:12:27 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 04:12:27 user nova-compute[75378]:     <system>
Nov 09 04:12:27 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 04:12:27 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 04:12:27 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 04:12:27 user nova-compute[75378]:       <entry name="serial">094fa4b5-9622-4971-99e1-e505da91612d</entry>
Nov 09 04:12:27 user nova-compute[75378]:       <entry name="uuid">094fa4b5-9622-4971-99e1-e505da91612d</entry>
Nov 09 04:12:27 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 04:12:27 user nova-compute[75378]:     </system>
Nov 09 04:12:27 user nova-compute[75378]:   </sysinfo>
Nov 09 04:12:27 user nova-compute[75378]:   <os>
Nov 09 04:12:27 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 04:12:27 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 04:12:27 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 04:12:27 user nova-compute[75378]:   </os>
Nov 09 04:12:27 user nova-compute[75378]:   <features>
Nov 09 04:12:27 user nova-compute[75378]:     <acpi/>
Nov 09 04:12:27 user nova-compute[75378]:     <apic/>
Nov 09 04:12:27 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 04:12:27 user nova-compute[75378]:   </features>
Nov 09 04:12:27 user nova-compute[75378]:   <clock offset="utc">
Nov 09 04:12:27 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 04:12:27 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 04:12:27 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 04:12:27 user nova-compute[75378]:   </clock>
Nov 09 04:12:27 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 04:12:27 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 04:12:27 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 04:12:27 user nova-compute[75378]:   </cpu>
Nov 09 04:12:27 user nova-compute[75378]:   <devices>
Nov 09 04:12:27 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 04:12:27 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:12:27 user nova-compute[75378]:       <source dev="/dev/sdc"/>
Nov 09 04:12:27 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 04:12:27 user nova-compute[75378]:       <serial>1541c7f1-31d0-4192-80f0-8d1201ad330e</serial>
Nov 09 04:12:27 user nova-compute[75378]:     </disk>
Nov 09 04:12:27 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 04:12:27 user nova-compute[75378]:       <mac address="fa:16:3e:3b:10:5b"/>
Nov 09 04:12:27 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:12:27 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 04:12:27 user nova-compute[75378]:       <target dev="tape44a956f-10"/>
Nov 09 04:12:27 user nova-compute[75378]:     </interface>
Nov 09 04:12:27 user nova-compute[75378]:     <serial type="pty">
Nov 09 04:12:27 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/094fa4b5-9622-4971-99e1-e505da91612d/console.log" append="off"/>
Nov 09 04:12:27 user nova-compute[75378]:     </serial>
Nov 09 04:12:27 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 04:12:27 user nova-compute[75378]:     <video>
Nov 09 04:12:27 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:12:27 user nova-compute[75378]:     </video>
Nov 09 04:12:27 user nova-compute[75378]:     <rng model="virtio">
Nov 09 04:12:27 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 04:12:27 user nova-compute[75378]:     </rng>
Nov 09 04:12:27 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 04:12:27 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 04:12:27 user nova-compute[75378]:       <stats period="10"/>
Nov 09 04:12:27 user nova-compute[75378]:     </memballoon>
Nov 09 04:12:27 user nova-compute[75378]:   </devices>
Nov 09 04:12:27 user nova-compute[75378]: </domain>
Nov 09 04:12:27 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:12:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-687411826',display_name='tempest-TestVolumeBootPattern-volume-backed-server-687411826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-687411826',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz++QGmz4c35ArnzRRLJGoYgaQNUqL5bnNCPxYEZuVxbqdkm7Bu3ybnWcuW3bXUNOh5bfJ60/9UhkdIQK4h2dQ9c+vr+M7YxEy1Yayd5Zqf9UqqOw1YKGKLU96jjVA+aA==',key_name='tempest-keypair-2083989440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed5a4bfe6ce546d2acfbf7be75334d1a',ramdisk_id='',reservation_id='r-gamxy5y4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1436829014',owner_user_name='tempest-TestVolumeBootPattern-1436829014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:12:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23b841529aaf42c29a442ef9524422b2',uuid=094fa4b5-9622-4971-99e1-e505da91612d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e44a956f-1034-4390-abc6-534499259134", "address": "fa:16:3e:3b:10:5b", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44a956f-10", "ovs_interfaceid": "e44a956f-1034-4390-abc6-534499259134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converting VIF {"id": "e44a956f-1034-4390-abc6-534499259134", "address": "fa:16:3e:3b:10:5b", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44a956f-10", "ovs_interfaceid": "e44a956f-1034-4390-abc6-534499259134", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:10:5b,bridge_name='br-int',has_traffic_filtering=True,id=e44a956f-1034-4390-abc6-534499259134,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44a956f-10') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG os_vif [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:10:5b,bridge_name='br-int',has_traffic_filtering=True,id=e44a956f-1034-4390-abc6-534499259134,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44a956f-10') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6cc6c9c8-6cba-5268-b842-27a05dcd5f1a', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape44a956f-10, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape44a956f-10, col_values=(('qos', UUID('34012af3-198c-406f-a5ca-69c9b5c6c881')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape44a956f-10, col_values=(('external_ids', {'iface-id': 'e44a956f-1034-4390-abc6-534499259134', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:10:5b', 'vm-uuid': '094fa4b5-9622-4971-99e1-e505da91612d'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:27 user nova-compute[75378]: INFO os_vif [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:10:5b,bridge_name='br-int',has_traffic_filtering=True,id=e44a956f-1034-4390-abc6-534499259134,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44a956f-10')
Nov 09 04:12:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:12:27 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] No VIF found with MAC fa:16:3e:3b:10:5b, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:12:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:28 user nova-compute[75378]: DEBUG nova.compute.manager [req-48b7ed83-8feb-4847-925e-96eefd0b6aaa req-18ed502a-7de8-478d-a81c-5faf61364a59 service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Received event network-vif-plugged-e44a956f-1034-4390-abc6-534499259134 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:12:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-48b7ed83-8feb-4847-925e-96eefd0b6aaa req-18ed502a-7de8-478d-a81c-5faf61364a59 service nova] Acquiring lock "094fa4b5-9622-4971-99e1-e505da91612d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:12:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-48b7ed83-8feb-4847-925e-96eefd0b6aaa req-18ed502a-7de8-478d-a81c-5faf61364a59 service nova] Lock "094fa4b5-9622-4971-99e1-e505da91612d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:12:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-48b7ed83-8feb-4847-925e-96eefd0b6aaa req-18ed502a-7de8-478d-a81c-5faf61364a59 service nova] Lock "094fa4b5-9622-4971-99e1-e505da91612d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:12:28 user nova-compute[75378]: DEBUG nova.compute.manager [req-48b7ed83-8feb-4847-925e-96eefd0b6aaa req-18ed502a-7de8-478d-a81c-5faf61364a59 service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] No waiting events found dispatching network-vif-plugged-e44a956f-1034-4390-abc6-534499259134 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:12:28 user nova-compute[75378]: WARNING nova.compute.manager [req-48b7ed83-8feb-4847-925e-96eefd0b6aaa req-18ed502a-7de8-478d-a81c-5faf61364a59 service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Received unexpected event network-vif-plugged-e44a956f-1034-4390-abc6-534499259134 for instance with vm_state building and task_state spawning.
Nov 09 04:12:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:30 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 04:12:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 04:12:30 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Instance spawned successfully.
Nov 09 04:12:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 04:12:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:12:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:12:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:12:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:12:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:12:30 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:12:30 user nova-compute[75378]: INFO nova.compute.manager [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 09 04:12:30 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:12:30 user nova-compute[75378]: DEBUG nova.compute.manager [req-f1975ae8-541d-46cf-b056-285a0a487f79 req-9ae74f65-85b5-4aa1-b516-5a3af3ca3448 service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Received event network-vif-plugged-e44a956f-1034-4390-abc6-534499259134 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:12:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f1975ae8-541d-46cf-b056-285a0a487f79 req-9ae74f65-85b5-4aa1-b516-5a3af3ca3448 service nova] Acquiring lock "094fa4b5-9622-4971-99e1-e505da91612d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:12:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f1975ae8-541d-46cf-b056-285a0a487f79 req-9ae74f65-85b5-4aa1-b516-5a3af3ca3448 service nova] Lock "094fa4b5-9622-4971-99e1-e505da91612d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:12:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f1975ae8-541d-46cf-b056-285a0a487f79 req-9ae74f65-85b5-4aa1-b516-5a3af3ca3448 service nova] Lock "094fa4b5-9622-4971-99e1-e505da91612d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:12:30 user nova-compute[75378]: DEBUG nova.compute.manager [req-f1975ae8-541d-46cf-b056-285a0a487f79 req-9ae74f65-85b5-4aa1-b516-5a3af3ca3448 service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] No waiting events found dispatching network-vif-plugged-e44a956f-1034-4390-abc6-534499259134 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:12:30 user nova-compute[75378]: WARNING nova.compute.manager [req-f1975ae8-541d-46cf-b056-285a0a487f79 req-9ae74f65-85b5-4aa1-b516-5a3af3ca3448 service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Received unexpected event network-vif-plugged-e44a956f-1034-4390-abc6-534499259134 for instance with vm_state building and task_state spawning.
Nov 09 04:12:30 user nova-compute[75378]: INFO nova.compute.manager [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Took 29.38 seconds to build instance.
Nov 09 04:12:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9e614dfd-6515-4578-935d-b234f5dce4b5 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "094fa4b5-9622-4971-99e1-e505da91612d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.518s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:12:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:12:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:12:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:12:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:12:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:47 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:12:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:12:50 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:12:50 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:12:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:12:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:12:50 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 04:12:50 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Updating instance_info_cache with network_info: [{"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:12:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-a2b8cb57-54fb-4474-88dd-891c8e1638e9" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:12:51 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 04:12:51 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:12:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:52 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:12:54 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:12:55 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:12:55 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:12:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:12:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:12:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:12:55 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:12:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:12:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:12:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:12:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:12:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:12:56 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:12:56 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:12:56 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:12:56 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:12:56 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8552MB free_disk=25.184810638427734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:12:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:12:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:12:56 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:12:56 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance a2b8cb57-54fb-4474-88dd-891c8e1638e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:12:56 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 094fa4b5-9622-4971-99e1-e505da91612d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:12:56 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:12:56 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:12:56 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing inventories for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 04:12:56 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Updating ProviderTree inventory for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 04:12:56 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Updating inventory in ProviderTree for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 04:12:57 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing aggregate associations for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8, aggregates: None {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 04:12:57 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing trait associations for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8, traits: HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 04:12:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:12:57 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:12:57 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:12:57 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:12:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.637s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:12:57 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:13:00 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:13:00 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:13:00 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Cleaning up deleted instances {{(pid=75378) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 04:13:00 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] There are 0 instances to clean {{(pid=75378) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 04:13:01 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:13:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:13:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:13:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:13:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:13:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:13:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:13:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:13:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:13:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:13:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:13:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:13:15 user nova-compute[75378]: INFO nova.compute.manager [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Detaching volume 6b686005-1798-4789-9c2e-fb0871bb1c1c
Nov 09 04:13:15 user nova-compute[75378]: INFO nova.virt.block_device [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Attempting to driver detach volume 6b686005-1798-4789-9c2e-fb0871bb1c1c from mountpoint /dev/vdc
Nov 09 04:13:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Attempting to detach device vdc from instance a2b8cb57-54fb-4474-88dd-891c8e1638e9 from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 04:13:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 04:13:15 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:13:15 user nova-compute[75378]:   <source dev="/dev/sdb"/>
Nov 09 04:13:15 user nova-compute[75378]:   <target dev="vdc" bus="virtio"/>
Nov 09 04:13:15 user nova-compute[75378]:   <serial>6b686005-1798-4789-9c2e-fb0871bb1c1c</serial>
Nov 09 04:13:15 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 04:13:15 user nova-compute[75378]: </disk>
Nov 09 04:13:15 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 04:13:15 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Successfully detached device vdc from instance a2b8cb57-54fb-4474-88dd-891c8e1638e9 from the persistent domain config.
Nov 09 04:13:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a2b8cb57-54fb-4474-88dd-891c8e1638e9 from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 04:13:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 04:13:15 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:13:15 user nova-compute[75378]:   <source dev="/dev/sdb"/>
Nov 09 04:13:15 user nova-compute[75378]:   <target dev="vdc" bus="virtio"/>
Nov 09 04:13:15 user nova-compute[75378]:   <serial>6b686005-1798-4789-9c2e-fb0871bb1c1c</serial>
Nov 09 04:13:15 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 04:13:15 user nova-compute[75378]: </disk>
Nov 09 04:13:15 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 04:13:16 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a2b8cb57-54fb-4474-88dd-891c8e1638e9 {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 04:13:16 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:13:16 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 04:13:16 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 094fa4b5-9622-4971-99e1-e505da91612d {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 04:13:16 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid a2b8cb57-54fb-4474-88dd-891c8e1638e9 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 04:13:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:13:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:13:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "094fa4b5-9622-4971-99e1-e505da91612d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:13:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "094fa4b5-9622-4971-99e1-e505da91612d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:13:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:13:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "094fa4b5-9622-4971-99e1-e505da91612d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:13:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:13:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:13:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:13:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:13:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:13:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:13:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:13:21 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:13:21 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:13:21 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75378) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 04:13:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:13:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:13:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:13:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:13:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:13:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:13:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:13:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:13:36 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a2b8cb57-54fb-4474-88dd-891c8e1638e9 is timed out.
Nov 09 04:13:36 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Successfully detached device vdc from instance a2b8cb57-54fb-4474-88dd-891c8e1638e9 from the live domain config.
Nov 09 04:13:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NILKZojs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:13:36 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:13:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[86eec5d8-e1c7-4851-ae8d-9eda62a7e42f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 04:13:36 user nova-compute[75378]: No targets found.
Nov 09 04:13:36 user nova-compute[75378]: iSNS:
Nov 09 04:13:36 user nova-compute[75378]: No targets found.
Nov 09 04:13:36 user nova-compute[75378]: STATIC:
Nov 09 04:13:36 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c
Nov 09 04:13:36 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:13:36 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:13:36 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e
Nov 09 04:13:36 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:13:36 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:13:36 user nova-compute[75378]: FIRMWARE:
Nov 09 04:13:36 user nova-compute[75378]: No targets found.
Nov 09 04:13:36 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 04:13:36 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 04:13:36 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b207e74a-0555-47f3-9391-1c34be338285]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4898dad7-8fd8-4358-94b6-2f83c2488834]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c (non-flash)
Nov 09 04:13:36 user nova-compute[75378]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)
Nov 09 04:13:36 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c (non-flash)
Nov 09 04:13:36 user nova-compute[75378]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)
Nov 09 04:13:36 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c57bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c'): ({'sdb'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Removing single pathed devices sdb {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bda22e0-92dd-4460-b42a-91f8218884a5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21412cb-89d0-439e-a197-1e4f29898853]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Flushing IO for device /dev/sdb {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec308d77-4674-467c-ad8b-d8382552d6c0]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1db2c7-205b-4749-b126-224726f94cdf]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[233596f5-dacc-42e7-9540-954084036405]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edfc252-3732-4c7a-bdef-a970738a0218]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c, portal: 172.16.0.220,3260]
Nov 09 04:13:36 user nova-compute[75378]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c, portal: 172.16.0.220,3260] successful.
Nov 09 04:13:36 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b686005-1798-4789-9c2e-fb0871bb1c1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2cff6c-ecd0-46ba-8fc3-12b1a449a89d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] <== disconnect_volume: return (334ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:13:36 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 04:13:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:13:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:13:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:13:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:13:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:13:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:13:37 user nova-compute[75378]: DEBUG nova.objects.instance [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lazy-loading 'flavor' on Instance uuid a2b8cb57-54fb-4474-88dd-891c8e1638e9 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:13:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-be044281-2ed6-438d-b33a-1b1816b77eb4 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.935s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:13:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 21.203s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:13:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:13:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:13:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:13:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:13:49 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:13:49 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:13:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:13:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:13:52 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:13:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:13:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Rebuilding the list of instances to heal {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 04:13:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:13:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:13:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:13:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:13:52 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 04:13:52 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lazy-loading 'info_cache' on Instance uuid 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:13:53 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Updating instance_info_cache with network_info: [{"id": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "address": "fa:16:3e:da:50:7a", "network": {"id": "9b84419f-fb2f-455e-8788-7c8635dc5695", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-535897341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b9133412a8747f2ab2c26619adff95a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8136caa1-a3", "ovs_interfaceid": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:13:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:13:53 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 04:13:53 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:13:53 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:13:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-406ba590-5634-4755-a67b-84eed396218c req-da938dfd-9af7-4ab9-ab40-a472c47bf509 service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Received event network-changed-e44a956f-1034-4390-abc6-534499259134 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:13:53 user nova-compute[75378]: DEBUG nova.compute.manager [req-406ba590-5634-4755-a67b-84eed396218c req-da938dfd-9af7-4ab9-ab40-a472c47bf509 service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Refreshing instance network info cache due to event network-changed-e44a956f-1034-4390-abc6-534499259134. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:13:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-406ba590-5634-4755-a67b-84eed396218c req-da938dfd-9af7-4ab9-ab40-a472c47bf509 service nova] Acquiring lock "refresh_cache-094fa4b5-9622-4971-99e1-e505da91612d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:13:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-406ba590-5634-4755-a67b-84eed396218c req-da938dfd-9af7-4ab9-ab40-a472c47bf509 service nova] Acquired lock "refresh_cache-094fa4b5-9622-4971-99e1-e505da91612d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:13:53 user nova-compute[75378]: DEBUG nova.network.neutron [req-406ba590-5634-4755-a67b-84eed396218c req-da938dfd-9af7-4ab9-ab40-a472c47bf509 service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Refreshing network info cache for port e44a956f-1034-4390-abc6-534499259134 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:13:54 user nova-compute[75378]: DEBUG nova.network.neutron [req-406ba590-5634-4755-a67b-84eed396218c req-da938dfd-9af7-4ab9-ab40-a472c47bf509 service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Updated VIF entry in instance network info cache for port e44a956f-1034-4390-abc6-534499259134. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:13:54 user nova-compute[75378]: DEBUG nova.network.neutron [req-406ba590-5634-4755-a67b-84eed396218c req-da938dfd-9af7-4ab9-ab40-a472c47bf509 service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Updating instance_info_cache with network_info: [{"id": "e44a956f-1034-4390-abc6-534499259134", "address": "fa:16:3e:3b:10:5b", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44a956f-10", "ovs_interfaceid": "e44a956f-1034-4390-abc6-534499259134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:13:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-406ba590-5634-4755-a67b-84eed396218c req-da938dfd-9af7-4ab9-ab40-a472c47bf509 service nova] Releasing lock "refresh_cache-094fa4b5-9622-4971-99e1-e505da91612d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:13:54 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:13:55 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:13:55 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:13:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:13:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:13:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:13:55 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:13:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:13:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:13:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:13:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:13:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:13:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:13:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:13:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:13:56 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:13:56 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:13:56 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:13:56 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:13:56 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8638MB free_disk=25.18240737915039GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:13:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:13:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:13:56 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:13:56 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance a2b8cb57-54fb-4474-88dd-891c8e1638e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:13:56 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 094fa4b5-9622-4971-99e1-e505da91612d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:13:56 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:13:56 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:13:56 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:13:56 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:13:56 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:13:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:13:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:13:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:13:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:02 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:14:02 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:14:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "42e015a5-b160-4b15-829b-3cab96075d6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "42e015a5-b160-4b15-829b-3cab96075d6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:03 user nova-compute[75378]: DEBUG nova.compute.manager [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 04:14:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:03 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 04:14:03 user nova-compute[75378]: INFO nova.compute.claims [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Claim successful on node user
Nov 09 04:14:03 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:14:03 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:14:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:03 user nova-compute[75378]: DEBUG nova.compute.manager [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 04:14:03 user nova-compute[75378]: DEBUG nova.compute.manager [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 04:14:03 user nova-compute[75378]: DEBUG nova.network.neutron [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 04:14:03 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 04:14:03 user nova-compute[75378]: DEBUG nova.compute.manager [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 04:14:03 user nova-compute[75378]: DEBUG nova.policy [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81d9391c05f24db4874155808fac2b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987017c936a547f09de17b5a724d6694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 04:14:03 user nova-compute[75378]: DEBUG nova.compute.manager [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 04:14:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 04:14:03 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Creating image(s)
Nov 09 04:14:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "/opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "/opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "/opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.182s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:14:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:03 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.174s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:14:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk 1073741824" returned: 0 in 0.053s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:14:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:04 user nova-compute[75378]: DEBUG nova.network.neutron [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Successfully created port: 00629a2d-5f73-4c4a-b23b-95032fdbeb09 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 04:14:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.189s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:14:04 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 04:14:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:14:04 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Cannot resize image /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 04:14:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 04:14:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Ensure instance console log exists: /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 04:14:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.network.neutron [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Successfully updated port: 00629a2d-5f73-4c4a-b23b-95032fdbeb09 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "refresh_cache-42e015a5-b160-4b15-829b-3cab96075d6f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquired lock "refresh_cache-42e015a5-b160-4b15-829b-3cab96075d6f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.network.neutron [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.network.neutron [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.compute.manager [req-db5445e3-ca58-4bd5-9804-48edd77d15ef req-aba39399-8e71-4ed1-b518-18dc080526d2 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Received event network-changed-00629a2d-5f73-4c4a-b23b-95032fdbeb09 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.compute.manager [req-db5445e3-ca58-4bd5-9804-48edd77d15ef req-aba39399-8e71-4ed1-b518-18dc080526d2 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Refreshing instance network info cache due to event network-changed-00629a2d-5f73-4c4a-b23b-95032fdbeb09. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-db5445e3-ca58-4bd5-9804-48edd77d15ef req-aba39399-8e71-4ed1-b518-18dc080526d2 service nova] Acquiring lock "refresh_cache-42e015a5-b160-4b15-829b-3cab96075d6f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.network.neutron [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Updating instance_info_cache with network_info: [{"id": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "address": "fa:16:3e:f7:b5:ff", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00629a2d-5f", "ovs_interfaceid": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Releasing lock "refresh_cache-42e015a5-b160-4b15-829b-3cab96075d6f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.compute.manager [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Instance network_info: |[{"id": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "address": "fa:16:3e:f7:b5:ff", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00629a2d-5f", "ovs_interfaceid": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-db5445e3-ca58-4bd5-9804-48edd77d15ef req-aba39399-8e71-4ed1-b518-18dc080526d2 service nova] Acquired lock "refresh_cache-42e015a5-b160-4b15-829b-3cab96075d6f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.network.neutron [req-db5445e3-ca58-4bd5-9804-48edd77d15ef req-aba39399-8e71-4ed1-b518-18dc080526d2 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Refreshing network info cache for port 00629a2d-5f73-4c4a-b23b-95032fdbeb09 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Start _get_guest_xml network_info=[{"id": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "address": "fa:16:3e:f7:b5:ff", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00629a2d-5f", "ovs_interfaceid": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 04:14:05 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:14:05 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:14:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-336831372',display_name='tempest-TestStampPattern-server-336831372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-336831372',id=46,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdSgjDyj3H0LIu1u2r//kjG1Z/kJV/2D9kHnyqGf+23Yh1IXJheit8b0DpysYeACB7JwG5OcFZYK6MPjM1Qc7O4TA+G/vX1U0avmELYZy8D9iV/yA0LiISJ8RtiQ14fQg==',key_name='tempest-TestStampPattern-1317567266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='987017c936a547f09de17b5a724d6694',ramdisk_id='',reservation_id='r-ebtvw7cm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1195876613',owner_user_name='tempest-TestStampPattern-1195876613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:14:04Z,user_data=None,user_id='81d9391c05f24db4874155808fac2b67',uuid=42e015a5-b160-4b15-829b-3cab96075d6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "address": "fa:16:3e:f7:b5:ff", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00629a2d-5f", "ovs_interfaceid": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Converting VIF {"id": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "address": "fa:16:3e:f7:b5:ff", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00629a2d-5f", "ovs_interfaceid": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b5:ff,bridge_name='br-int',has_traffic_filtering=True,id=00629a2d-5f73-4c4a-b23b-95032fdbeb09,network=Network(10df6958-101d-4086-b128-51b210209887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00629a2d-5f') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.objects.instance [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lazy-loading 'pci_devices' on Instance uuid 42e015a5-b160-4b15-829b-3cab96075d6f {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] End _get_guest_xml xml=<domain type="kvm">
Nov 09 04:14:05 user nova-compute[75378]:   <uuid>42e015a5-b160-4b15-829b-3cab96075d6f</uuid>
Nov 09 04:14:05 user nova-compute[75378]:   <name>instance-0000002e</name>
Nov 09 04:14:05 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 04:14:05 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 04:14:05 user nova-compute[75378]:   <metadata>
Nov 09 04:14:05 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 04:14:05 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 04:14:05 user nova-compute[75378]:       <nova:name>tempest-TestStampPattern-server-336831372</nova:name>
Nov 09 04:14:05 user nova-compute[75378]:       <nova:creationTime>2023-11-09 04:14:05</nova:creationTime>
Nov 09 04:14:05 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 04:14:05 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 04:14:05 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 04:14:05 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 04:14:05 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 04:14:05 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 04:14:05 user nova-compute[75378]:       </nova:flavor>
Nov 09 04:14:05 user nova-compute[75378]:       <nova:owner>
Nov 09 04:14:05 user nova-compute[75378]:         <nova:user uuid="81d9391c05f24db4874155808fac2b67">tempest-TestStampPattern-1195876613-project-member</nova:user>
Nov 09 04:14:05 user nova-compute[75378]:         <nova:project uuid="987017c936a547f09de17b5a724d6694">tempest-TestStampPattern-1195876613</nova:project>
Nov 09 04:14:05 user nova-compute[75378]:       </nova:owner>
Nov 09 04:14:05 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 04:14:05 user nova-compute[75378]:       <nova:ports>
Nov 09 04:14:05 user nova-compute[75378]:         <nova:port uuid="00629a2d-5f73-4c4a-b23b-95032fdbeb09">
Nov 09 04:14:05 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 09 04:14:05 user nova-compute[75378]:         </nova:port>
Nov 09 04:14:05 user nova-compute[75378]:       </nova:ports>
Nov 09 04:14:05 user nova-compute[75378]:     </nova:instance>
Nov 09 04:14:05 user nova-compute[75378]:   </metadata>
Nov 09 04:14:05 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 04:14:05 user nova-compute[75378]:     <system>
Nov 09 04:14:05 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 04:14:05 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 04:14:05 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 04:14:05 user nova-compute[75378]:       <entry name="serial">42e015a5-b160-4b15-829b-3cab96075d6f</entry>
Nov 09 04:14:05 user nova-compute[75378]:       <entry name="uuid">42e015a5-b160-4b15-829b-3cab96075d6f</entry>
Nov 09 04:14:05 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 04:14:05 user nova-compute[75378]:     </system>
Nov 09 04:14:05 user nova-compute[75378]:   </sysinfo>
Nov 09 04:14:05 user nova-compute[75378]:   <os>
Nov 09 04:14:05 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 04:14:05 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 04:14:05 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 04:14:05 user nova-compute[75378]:   </os>
Nov 09 04:14:05 user nova-compute[75378]:   <features>
Nov 09 04:14:05 user nova-compute[75378]:     <acpi/>
Nov 09 04:14:05 user nova-compute[75378]:     <apic/>
Nov 09 04:14:05 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 04:14:05 user nova-compute[75378]:   </features>
Nov 09 04:14:05 user nova-compute[75378]:   <clock offset="utc">
Nov 09 04:14:05 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 04:14:05 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 04:14:05 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 04:14:05 user nova-compute[75378]:   </clock>
Nov 09 04:14:05 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 04:14:05 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 04:14:05 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 04:14:05 user nova-compute[75378]:   </cpu>
Nov 09 04:14:05 user nova-compute[75378]:   <devices>
Nov 09 04:14:05 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 04:14:05 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 04:14:05 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk"/>
Nov 09 04:14:05 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 04:14:05 user nova-compute[75378]:     </disk>
Nov 09 04:14:05 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 04:14:05 user nova-compute[75378]:       <mac address="fa:16:3e:f7:b5:ff"/>
Nov 09 04:14:05 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:14:05 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 04:14:05 user nova-compute[75378]:       <target dev="tap00629a2d-5f"/>
Nov 09 04:14:05 user nova-compute[75378]:     </interface>
Nov 09 04:14:05 user nova-compute[75378]:     <serial type="pty">
Nov 09 04:14:05 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/console.log" append="off"/>
Nov 09 04:14:05 user nova-compute[75378]:     </serial>
Nov 09 04:14:05 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 04:14:05 user nova-compute[75378]:     <video>
Nov 09 04:14:05 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:14:05 user nova-compute[75378]:     </video>
Nov 09 04:14:05 user nova-compute[75378]:     <rng model="virtio">
Nov 09 04:14:05 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 04:14:05 user nova-compute[75378]:     </rng>
Nov 09 04:14:05 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 04:14:05 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 04:14:05 user nova-compute[75378]:       <stats period="10"/>
Nov 09 04:14:05 user nova-compute[75378]:     </memballoon>
Nov 09 04:14:05 user nova-compute[75378]:   </devices>
Nov 09 04:14:05 user nova-compute[75378]: </domain>
Nov 09 04:14:05 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:14:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-336831372',display_name='tempest-TestStampPattern-server-336831372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-336831372',id=46,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdSgjDyj3H0LIu1u2r//kjG1Z/kJV/2D9kHnyqGf+23Yh1IXJheit8b0DpysYeACB7JwG5OcFZYK6MPjM1Qc7O4TA+G/vX1U0avmELYZy8D9iV/yA0LiISJ8RtiQ14fQg==',key_name='tempest-TestStampPattern-1317567266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='987017c936a547f09de17b5a724d6694',ramdisk_id='',reservation_id='r-ebtvw7cm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1195876613',owner_user_name='tempest-TestStampPattern-1195876613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:14:04Z,user_data=None,user_id='81d9391c05f24db4874155808fac2b67',uuid=42e015a5-b160-4b15-829b-3cab96075d6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "address": "fa:16:3e:f7:b5:ff", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00629a2d-5f", "ovs_interfaceid": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Converting VIF {"id": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "address": "fa:16:3e:f7:b5:ff", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00629a2d-5f", "ovs_interfaceid": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b5:ff,bridge_name='br-int',has_traffic_filtering=True,id=00629a2d-5f73-4c4a-b23b-95032fdbeb09,network=Network(10df6958-101d-4086-b128-51b210209887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00629a2d-5f') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG os_vif [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b5:ff,bridge_name='br-int',has_traffic_filtering=True,id=00629a2d-5f73-4c4a-b23b-95032fdbeb09,network=Network(10df6958-101d-4086-b128-51b210209887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00629a2d-5f') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3770a84-7a8b-5990-8cd4-86ee157acbf6', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00629a2d-5f, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00629a2d-5f, col_values=(('qos', UUID('90cb033a-9650-43e0-8327-e3dd5657f22e')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00629a2d-5f, col_values=(('external_ids', {'iface-id': '00629a2d-5f73-4c4a-b23b-95032fdbeb09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:b5:ff', 'vm-uuid': '42e015a5-b160-4b15-829b-3cab96075d6f'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:05 user nova-compute[75378]: INFO os_vif [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b5:ff,bridge_name='br-int',has_traffic_filtering=True,id=00629a2d-5f73-4c4a-b23b-95032fdbeb09,network=Network(10df6958-101d-4086-b128-51b210209887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00629a2d-5f')
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] No VIF found with MAC fa:16:3e:f7:b5:ff, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:05 user nova-compute[75378]: INFO nova.compute.manager [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Terminating instance
Nov 09 04:14:05 user nova-compute[75378]: DEBUG nova.compute.manager [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:14:06 user nova-compute[75378]: DEBUG nova.network.neutron [req-db5445e3-ca58-4bd5-9804-48edd77d15ef req-aba39399-8e71-4ed1-b518-18dc080526d2 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Updated VIF entry in instance network info cache for port 00629a2d-5f73-4c4a-b23b-95032fdbeb09. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:14:06 user nova-compute[75378]: DEBUG nova.network.neutron [req-db5445e3-ca58-4bd5-9804-48edd77d15ef req-aba39399-8e71-4ed1-b518-18dc080526d2 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Updating instance_info_cache with network_info: [{"id": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "address": "fa:16:3e:f7:b5:ff", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00629a2d-5f", "ovs_interfaceid": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:14:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-db5445e3-ca58-4bd5-9804-48edd77d15ef req-aba39399-8e71-4ed1-b518-18dc080526d2 service nova] Releasing lock "refresh_cache-42e015a5-b160-4b15-829b-3cab96075d6f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:14:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-2e93b1ff-c466-4eac-bd58-f48f587c3b0f req-57e75a6d-37a3-4583-851d-35ddd448ddf9 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Received event network-vif-unplugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:14:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2e93b1ff-c466-4eac-bd58-f48f587c3b0f req-57e75a6d-37a3-4583-851d-35ddd448ddf9 service nova] Acquiring lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2e93b1ff-c466-4eac-bd58-f48f587c3b0f req-57e75a6d-37a3-4583-851d-35ddd448ddf9 service nova] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-2e93b1ff-c466-4eac-bd58-f48f587c3b0f req-57e75a6d-37a3-4583-851d-35ddd448ddf9 service nova] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-2e93b1ff-c466-4eac-bd58-f48f587c3b0f req-57e75a6d-37a3-4583-851d-35ddd448ddf9 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] No waiting events found dispatching network-vif-unplugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:14:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-2e93b1ff-c466-4eac-bd58-f48f587c3b0f req-57e75a6d-37a3-4583-851d-35ddd448ddf9 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Received event network-vif-unplugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:14:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:07 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Instance destroyed successfully.
Nov 09 04:14:07 user nova-compute[75378]: DEBUG nova.objects.instance [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lazy-loading 'resources' on Instance uuid a2b8cb57-54fb-4474-88dd-891c8e1638e9 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:14:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:07 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T04:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-626146740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-626146740',id=43,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNdNbsM06LFH67hTOYVSFjv3SWEewGCWPMCXdcIsGG2FPHFKsqe6q0hkrIVRviAneLUPy2vjl4HQ3MWP8we2RkWFKAO29DeoI3Ewk36iVZA1Ji+4rCe7AEDvZdXS7gOYQ==',key_name='tempest-keypair-1732741146',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:12:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c5788a86f2c4fcab582d65b471fe27e',ramdisk_id='',reservation_id='r-e0hnehzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1244090539',owner_user_name='tempest-AttachVolumeShelveTestJSON-1244090539-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T04:12:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f996e26d3a04dd8ba5a64eaa218a9b3',uuid=a2b8cb57-54fb-4474-88dd-891c8e1638e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:14:07 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converting VIF {"id": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "address": "fa:16:3e:08:cb:4e", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581b2b1-98", "ovs_interfaceid": "9581b2b1-98c1-465a-baaf-4c83ed1c0534", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:14:07 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=9581b2b1-98c1-465a-baaf-4c83ed1c0534,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581b2b1-98') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:14:07 user nova-compute[75378]: DEBUG os_vif [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=9581b2b1-98c1-465a-baaf-4c83ed1c0534,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581b2b1-98') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:14:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9581b2b1-98, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:14:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c6f2d7a-ba2b-468f-afd9-2b9e5dd3a90a) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:14:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:07 user nova-compute[75378]: INFO os_vif [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:cb:4e,bridge_name='br-int',has_traffic_filtering=True,id=9581b2b1-98c1-465a-baaf-4c83ed1c0534,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581b2b1-98')
Nov 09 04:14:07 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Deleting instance files /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9_del
Nov 09 04:14:07 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Deletion of /opt/stack/data/nova/instances/a2b8cb57-54fb-4474-88dd-891c8e1638e9_del complete
Nov 09 04:14:07 user nova-compute[75378]: INFO nova.compute.manager [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Took 1.70 seconds to destroy the instance on the hypervisor.
Nov 09 04:14:07 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:14:07 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:14:07 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:14:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:08 user nova-compute[75378]: DEBUG nova.compute.manager [req-23561062-66ad-4422-be0e-0d6678876c99 req-dda47a14-0b2a-4f02-ba15-a0d276370e16 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Received event network-vif-plugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:14:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-23561062-66ad-4422-be0e-0d6678876c99 req-dda47a14-0b2a-4f02-ba15-a0d276370e16 service nova] Acquiring lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-23561062-66ad-4422-be0e-0d6678876c99 req-dda47a14-0b2a-4f02-ba15-a0d276370e16 service nova] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-23561062-66ad-4422-be0e-0d6678876c99 req-dda47a14-0b2a-4f02-ba15-a0d276370e16 service nova] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:08 user nova-compute[75378]: DEBUG nova.compute.manager [req-23561062-66ad-4422-be0e-0d6678876c99 req-dda47a14-0b2a-4f02-ba15-a0d276370e16 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] No waiting events found dispatching network-vif-plugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:14:08 user nova-compute[75378]: WARNING nova.compute.manager [req-23561062-66ad-4422-be0e-0d6678876c99 req-dda47a14-0b2a-4f02-ba15-a0d276370e16 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Received unexpected event network-vif-plugged-9581b2b1-98c1-465a-baaf-4c83ed1c0534 for instance with vm_state active and task_state deleting.
Nov 09 04:14:08 user nova-compute[75378]: DEBUG nova.compute.manager [req-23561062-66ad-4422-be0e-0d6678876c99 req-dda47a14-0b2a-4f02-ba15-a0d276370e16 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Received event network-vif-plugged-00629a2d-5f73-4c4a-b23b-95032fdbeb09 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:14:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-23561062-66ad-4422-be0e-0d6678876c99 req-dda47a14-0b2a-4f02-ba15-a0d276370e16 service nova] Acquiring lock "42e015a5-b160-4b15-829b-3cab96075d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-23561062-66ad-4422-be0e-0d6678876c99 req-dda47a14-0b2a-4f02-ba15-a0d276370e16 service nova] Lock "42e015a5-b160-4b15-829b-3cab96075d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-23561062-66ad-4422-be0e-0d6678876c99 req-dda47a14-0b2a-4f02-ba15-a0d276370e16 service nova] Lock "42e015a5-b160-4b15-829b-3cab96075d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:08 user nova-compute[75378]: DEBUG nova.compute.manager [req-23561062-66ad-4422-be0e-0d6678876c99 req-dda47a14-0b2a-4f02-ba15-a0d276370e16 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] No waiting events found dispatching network-vif-plugged-00629a2d-5f73-4c4a-b23b-95032fdbeb09 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:14:08 user nova-compute[75378]: WARNING nova.compute.manager [req-23561062-66ad-4422-be0e-0d6678876c99 req-dda47a14-0b2a-4f02-ba15-a0d276370e16 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Received unexpected event network-vif-plugged-00629a2d-5f73-4c4a-b23b-95032fdbeb09 for instance with vm_state building and task_state spawning.
Nov 09 04:14:08 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:14:08 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Took 0.95 seconds to deallocate network for instance.
Nov 09 04:14:08 user nova-compute[75378]: DEBUG nova.compute.manager [req-b70b3c14-243a-4799-877a-52f5dd77b581 req-45eabd7e-6432-4856-a7fa-2a65c1948338 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Received event network-vif-deleted-9581b2b1-98c1-465a-baaf-4c83ed1c0534 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:14:08 user nova-compute[75378]: INFO nova.compute.manager [req-b70b3c14-243a-4799-877a-52f5dd77b581 req-45eabd7e-6432-4856-a7fa-2a65c1948338 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Neutron deleted interface 9581b2b1-98c1-465a-baaf-4c83ed1c0534; detaching it from the instance and deleting it from the info cache
Nov 09 04:14:08 user nova-compute[75378]: DEBUG nova.network.neutron [req-b70b3c14-243a-4799-877a-52f5dd77b581 req-45eabd7e-6432-4856-a7fa-2a65c1948338 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:14:08 user nova-compute[75378]: DEBUG nova.compute.manager [req-b70b3c14-243a-4799-877a-52f5dd77b581 req-45eabd7e-6432-4856-a7fa-2a65c1948338 service nova] [instance: a2b8cb57-54fb-4474-88dd-891c8e1638e9] Detach interface failed, port_id=9581b2b1-98c1-465a-baaf-4c83ed1c0534, reason: Instance a2b8cb57-54fb-4474-88dd-891c8e1638e9 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 04:14:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:08 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:14:08 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:14:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:08 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Deleted allocations for instance a2b8cb57-54fb-4474-88dd-891c8e1638e9
Nov 09 04:14:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3e210d73-4f3e-4cf9-8e67-58020eb70be6 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "a2b8cb57-54fb-4474-88dd-891c8e1638e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.033s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:09 user nova-compute[75378]: DEBUG nova.compute.manager [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 04:14:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 04:14:09 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Instance spawned successfully.
Nov 09 04:14:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 04:14:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:14:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:14:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:14:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:14:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:14:09 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:14:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "69c482e5-9f19-4f67-a64c-ec35677d9dff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "69c482e5-9f19-4f67-a64c-ec35677d9dff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:09 user nova-compute[75378]: DEBUG nova.compute.manager [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 04:14:10 user nova-compute[75378]: INFO nova.compute.manager [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Took 6.25 seconds to spawn the instance on the hypervisor.
Nov 09 04:14:10 user nova-compute[75378]: DEBUG nova.compute.manager [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:14:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:10 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 04:14:10 user nova-compute[75378]: INFO nova.compute.claims [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Claim successful on node user
Nov 09 04:14:10 user nova-compute[75378]: INFO nova.compute.manager [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Took 6.90 seconds to build instance.
Nov 09 04:14:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-dcd02432-781b-467e-b9d7-6847ab8ac951 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "42e015a5-b160-4b15-829b-3cab96075d6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:10 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:14:10 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:14:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:10 user nova-compute[75378]: DEBUG nova.compute.manager [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 04:14:10 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 04:14:10 user nova-compute[75378]: DEBUG nova.compute.manager [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 04:14:10 user nova-compute[75378]: DEBUG nova.network.neutron [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 04:14:10 user nova-compute[75378]: DEBUG nova.compute.manager [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 04:14:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-21c5db79-c234-4126-82c1-7e2ba250ccfa req-881f1807-b756-4a2f-8a2a-482df394cd17 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Received event network-vif-plugged-00629a2d-5f73-4c4a-b23b-95032fdbeb09 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:14:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-21c5db79-c234-4126-82c1-7e2ba250ccfa req-881f1807-b756-4a2f-8a2a-482df394cd17 service nova] Acquiring lock "42e015a5-b160-4b15-829b-3cab96075d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-21c5db79-c234-4126-82c1-7e2ba250ccfa req-881f1807-b756-4a2f-8a2a-482df394cd17 service nova] Lock "42e015a5-b160-4b15-829b-3cab96075d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-21c5db79-c234-4126-82c1-7e2ba250ccfa req-881f1807-b756-4a2f-8a2a-482df394cd17 service nova] Lock "42e015a5-b160-4b15-829b-3cab96075d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-21c5db79-c234-4126-82c1-7e2ba250ccfa req-881f1807-b756-4a2f-8a2a-482df394cd17 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] No waiting events found dispatching network-vif-plugged-00629a2d-5f73-4c4a-b23b-95032fdbeb09 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:14:10 user nova-compute[75378]: WARNING nova.compute.manager [req-21c5db79-c234-4126-82c1-7e2ba250ccfa req-881f1807-b756-4a2f-8a2a-482df394cd17 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Received unexpected event network-vif-plugged-00629a2d-5f73-4c4a-b23b-95032fdbeb09 for instance with vm_state active and task_state None.
Nov 09 04:14:10 user nova-compute[75378]: DEBUG nova.policy [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23b841529aaf42c29a442ef9524422b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5a4bfe6ce546d2acfbf7be75334d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 04:14:10 user nova-compute[75378]: INFO nova.virt.block_device [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Booting with volume snapshot 35f49ae8-c2c8-4c4a-b714-650af1d24424 at /dev/vda
Nov 09 04:14:11 user nova-compute[75378]: DEBUG nova.network.neutron [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Successfully created port: 9c5d21b2-50f1-4627-9216-9e3d1a7a18d3 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 04:14:11 user nova-compute[75378]: DEBUG nova.network.neutron [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Successfully updated port: 9c5d21b2-50f1-4627-9216-9e3d1a7a18d3 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 04:14:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "refresh_cache-69c482e5-9f19-4f67-a64c-ec35677d9dff" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:14:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquired lock "refresh_cache-69c482e5-9f19-4f67-a64c-ec35677d9dff" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:14:11 user nova-compute[75378]: DEBUG nova.network.neutron [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:14:11 user nova-compute[75378]: DEBUG nova.compute.manager [req-647e35ea-bdc8-458d-8579-19a7385ab641 req-bf1a0c97-8ce6-4cdb-b234-9ab4875e4425 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Received event network-changed-9c5d21b2-50f1-4627-9216-9e3d1a7a18d3 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:14:11 user nova-compute[75378]: DEBUG nova.compute.manager [req-647e35ea-bdc8-458d-8579-19a7385ab641 req-bf1a0c97-8ce6-4cdb-b234-9ab4875e4425 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Refreshing instance network info cache due to event network-changed-9c5d21b2-50f1-4627-9216-9e3d1a7a18d3. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:14:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-647e35ea-bdc8-458d-8579-19a7385ab641 req-bf1a0c97-8ce6-4cdb-b234-9ab4875e4425 service nova] Acquiring lock "refresh_cache-69c482e5-9f19-4f67-a64c-ec35677d9dff" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:14:11 user nova-compute[75378]: DEBUG nova.network.neutron [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 04:14:12 user nova-compute[75378]: DEBUG nova.network.neutron [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Updating instance_info_cache with network_info: [{"id": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "address": "fa:16:3e:87:5d:52", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5d21b2-50", "ovs_interfaceid": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:14:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Releasing lock "refresh_cache-69c482e5-9f19-4f67-a64c-ec35677d9dff" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:14:12 user nova-compute[75378]: DEBUG nova.compute.manager [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Instance network_info: |[{"id": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "address": "fa:16:3e:87:5d:52", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5d21b2-50", "ovs_interfaceid": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 04:14:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-647e35ea-bdc8-458d-8579-19a7385ab641 req-bf1a0c97-8ce6-4cdb-b234-9ab4875e4425 service nova] Acquired lock "refresh_cache-69c482e5-9f19-4f67-a64c-ec35677d9dff" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:14:12 user nova-compute[75378]: DEBUG nova.network.neutron [req-647e35ea-bdc8-458d-8579-19a7385ab641 req-bf1a0c97-8ce6-4cdb-b234-9ab4875e4425 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Refreshing network info cache for port 9c5d21b2-50f1-4627-9216-9e3d1a7a18d3 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:14:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:12 user nova-compute[75378]: DEBUG nova.network.neutron [req-647e35ea-bdc8-458d-8579-19a7385ab641 req-bf1a0c97-8ce6-4cdb-b234-9ab4875e4425 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Updated VIF entry in instance network info cache for port 9c5d21b2-50f1-4627-9216-9e3d1a7a18d3. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:14:12 user nova-compute[75378]: DEBUG nova.network.neutron [req-647e35ea-bdc8-458d-8579-19a7385ab641 req-bf1a0c97-8ce6-4cdb-b234-9ab4875e4425 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Updating instance_info_cache with network_info: [{"id": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "address": "fa:16:3e:87:5d:52", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5d21b2-50", "ovs_interfaceid": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:14:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-647e35ea-bdc8-458d-8579-19a7385ab641 req-bf1a0c97-8ce6-4cdb-b234-9ab4875e4425 service nova] Releasing lock "refresh_cache-69c482e5-9f19-4f67-a64c-ec35677d9dff" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:14:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:21 user nova-compute[75378]: DEBUG os_brick.utils [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:14:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:14:21 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e186b397-4a29-450a-a48b-76cd350710c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:14:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:14:21 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e7713a-87d9-4958-bab9-595a2a25ed3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:14:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:14:21 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e2dc71-97d5-4a77-ba75-1ad3e95ad88b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:14:21 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0db1d7-1643-44bc-9366-996148c6ba33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:14:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:14:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 04:14:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:21 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:14:21 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 04:14:21 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1085bcc6-ca6a-465b-9adc-431b6a147a86]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:14:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 04:14:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 04:14:21 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 04:14:21 user nova-compute[75378]: DEBUG os_brick.utils [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:14:21 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Updating existing volume attachment record: 14c56421-6451-48b3-8805-a8bb08f7a7bc {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 04:14:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Acquiring lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Acquiring lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:28 user nova-compute[75378]: INFO nova.compute.manager [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Terminating instance
Nov 09 04:14:28 user nova-compute[75378]: DEBUG nova.compute.manager [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:14:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:28 user nova-compute[75378]: DEBUG nova.compute.manager [req-b7ded66e-7313-4d20-b41b-7f11eb49bdb0 req-f5d11487-30ae-431d-9aa4-5246f8b6a046 service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Received event network-vif-unplugged-8136caa1-a38d-4c19-9c63-64f3e2be3794 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:14:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b7ded66e-7313-4d20-b41b-7f11eb49bdb0 req-f5d11487-30ae-431d-9aa4-5246f8b6a046 service nova] Acquiring lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b7ded66e-7313-4d20-b41b-7f11eb49bdb0 req-f5d11487-30ae-431d-9aa4-5246f8b6a046 service nova] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:28 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b7ded66e-7313-4d20-b41b-7f11eb49bdb0 req-f5d11487-30ae-431d-9aa4-5246f8b6a046 service nova] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:28 user nova-compute[75378]: DEBUG nova.compute.manager [req-b7ded66e-7313-4d20-b41b-7f11eb49bdb0 req-f5d11487-30ae-431d-9aa4-5246f8b6a046 service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] No waiting events found dispatching network-vif-unplugged-8136caa1-a38d-4c19-9c63-64f3e2be3794 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:14:28 user nova-compute[75378]: DEBUG nova.compute.manager [req-b7ded66e-7313-4d20-b41b-7f11eb49bdb0 req-f5d11487-30ae-431d-9aa4-5246f8b6a046 service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Received event network-vif-unplugged-8136caa1-a38d-4c19-9c63-64f3e2be3794 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:14:29 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Instance destroyed successfully.
Nov 09 04:14:29 user nova-compute[75378]: DEBUG nova.objects.instance [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lazy-loading 'resources' on Instance uuid 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:14:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-708236328',display_name='tempest-SnapshotDataIntegrityTests-server-708236328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-708236328',id=41,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwiwjl5m88KX2C/xKxpTWv5pEOI4IlSj0vY53fLaYLUwKOVVR7mzKN0z7e+GOht18J7uLrXrQNY++ztWUOq5cQWZu5C/aeCwjYowggHuhfXe2JPk4eh1yi1Qzrp5JRrLQ==',key_name='tempest-keypair-6955039',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:06:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b9133412a8747f2ab2c26619adff95a',ramdisk_id='',reservation_id='r-0dr50asb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1930868936',owner_user_name='tempest-SnapshotDataIntegrityTests-1930868936-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T04:06:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5925b6900e6549c58b414a3438041195',uuid=1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "address": "fa:16:3e:da:50:7a", "network": {"id": "9b84419f-fb2f-455e-8788-7c8635dc5695", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-535897341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b9133412a8747f2ab2c26619adff95a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8136caa1-a3", "ovs_interfaceid": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:14:29 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Converting VIF {"id": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "address": "fa:16:3e:da:50:7a", "network": {"id": "9b84419f-fb2f-455e-8788-7c8635dc5695", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-535897341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b9133412a8747f2ab2c26619adff95a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8136caa1-a3", "ovs_interfaceid": "8136caa1-a38d-4c19-9c63-64f3e2be3794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:14:29 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:50:7a,bridge_name='br-int',has_traffic_filtering=True,id=8136caa1-a38d-4c19-9c63-64f3e2be3794,network=Network(9b84419f-fb2f-455e-8788-7c8635dc5695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8136caa1-a3') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:14:29 user nova-compute[75378]: DEBUG os_vif [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:50:7a,bridge_name='br-int',has_traffic_filtering=True,id=8136caa1-a38d-4c19-9c63-64f3e2be3794,network=Network(9b84419f-fb2f-455e-8788-7c8635dc5695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8136caa1-a3') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:14:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8136caa1-a3, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:14:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:14:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff8ae8f4-0daa-4971-b606-f3a4a861ffc4) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:14:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:29 user nova-compute[75378]: INFO os_vif [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:50:7a,bridge_name='br-int',has_traffic_filtering=True,id=8136caa1-a38d-4c19-9c63-64f3e2be3794,network=Network(9b84419f-fb2f-455e-8788-7c8635dc5695),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8136caa1-a3')
Nov 09 04:14:29 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Deleting instance files /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8_del
Nov 09 04:14:29 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Deletion of /opt/stack/data/nova/instances/1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8_del complete
Nov 09 04:14:29 user nova-compute[75378]: INFO nova.compute.manager [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 09 04:14:29 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:14:29 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:14:29 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:14:29 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:14:29 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Took 0.72 seconds to deallocate network for instance.
Nov 09 04:14:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:30 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:14:30 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:14:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:30 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Deleted allocations for instance 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8
Nov 09 04:14:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-57f864d4-2862-4348-abc6-3711925b4c29 tempest-SnapshotDataIntegrityTests-1930868936 tempest-SnapshotDataIntegrityTests-1930868936-project-member] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.964s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:30 user nova-compute[75378]: DEBUG nova.compute.manager [req-b67df9dd-c5bf-4730-b237-3c92992068d9 req-0fafd106-bff4-4aba-9002-b0d7a4a73b3f service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Received event network-vif-plugged-8136caa1-a38d-4c19-9c63-64f3e2be3794 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:14:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b67df9dd-c5bf-4730-b237-3c92992068d9 req-0fafd106-bff4-4aba-9002-b0d7a4a73b3f service nova] Acquiring lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b67df9dd-c5bf-4730-b237-3c92992068d9 req-0fafd106-bff4-4aba-9002-b0d7a4a73b3f service nova] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:30 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b67df9dd-c5bf-4730-b237-3c92992068d9 req-0fafd106-bff4-4aba-9002-b0d7a4a73b3f service nova] Lock "1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:30 user nova-compute[75378]: DEBUG nova.compute.manager [req-b67df9dd-c5bf-4730-b237-3c92992068d9 req-0fafd106-bff4-4aba-9002-b0d7a4a73b3f service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] No waiting events found dispatching network-vif-plugged-8136caa1-a38d-4c19-9c63-64f3e2be3794 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:14:30 user nova-compute[75378]: WARNING nova.compute.manager [req-b67df9dd-c5bf-4730-b237-3c92992068d9 req-0fafd106-bff4-4aba-9002-b0d7a4a73b3f service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Received unexpected event network-vif-plugged-8136caa1-a38d-4c19-9c63-64f3e2be3794 for instance with vm_state deleted and task_state None.
Nov 09 04:14:30 user nova-compute[75378]: DEBUG nova.compute.manager [req-b67df9dd-c5bf-4730-b237-3c92992068d9 req-0fafd106-bff4-4aba-9002-b0d7a4a73b3f service nova] [instance: 1ed29d8f-2dc5-48c1-bfd2-c5164f4b52a8] Received event network-vif-deleted-8136caa1-a38d-4c19-9c63-64f3e2be3794 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:14:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG nova.compute.manager [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 04:14:43 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Creating image(s)
Nov 09 04:14:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Did not create local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Ensure instance console log exists: /opt/stack/data/nova/instances/69c482e5-9f19-4f67-a64c-ec35677d9dff/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Start _get_guest_xml network_info=[{"id": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "address": "fa:16:3e:87:5d:52", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5d21b2-50", "ovs_interfaceid": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-09T04:13:55Z,direct_url=<?>,disk_format='qcow2',id=e2b51431-c1bb-4347-905d-18247649bf7b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1790652604',owner='ed5a4bfe6ce546d2acfbf7be75334d1a',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-09T04:13:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lyYCEhDM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '69c482e5-9f19-4f67-a64c-ec35677d9dff', 'attached_at': '', 'detached_at': '', 'volume_id': 'b69ff060-c04c-4332-84fd-0c9109a36c13', 'serial': 'b69ff060-c04c-4332-84fd-0c9109a36c13'}, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': '14c56421-6451-48b3-8805-a8bb08f7a7bc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 04:14:43 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:14:43 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:14:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-09T04:13:55Z,direct_url=<?>,disk_format='qcow2',id=e2b51431-c1bb-4347-905d-18247649bf7b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1790652604',owner='ed5a4bfe6ce546d2acfbf7be75334d1a',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-09T04:13:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 04:14:43 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lyYCEhDM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:14:44 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:14:44 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:14:44 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ed1e1f-59fe-4b82-95de-aa8953335199]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 04:14:44 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25d957a-ffc4-4c56-abe8-f3bcb9b20df7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13] added
Nov 09 04:14:44 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[055107da-80e3-4b94-aaaa-8cfba89d967b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8dfffd-eec0-4da6-a1a7-c73bd61eb9c7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lyYCEhDM {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lyYCEhDM" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47cd867-5cae-4e60-9332-4b3e66f23acf]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lyYCEhDM'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6767f69a-5a7f-4412-8001-a56d5bdffead]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[924875f4-e720-400e-9d6e-ef84fb5f4772]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)
Nov 09 04:14:44 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)
Nov 09 04:14:44 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c00933-0248-4837-9c38-e4614fe0c728]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13, portal: 172.16.0.220,3260]
Nov 09 04:14:44 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13, portal: 172.16.0.220,3260] successful.
Nov 09 04:14:44 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[224cc9d3-3c23-4a0f-bac5-efbfb74ed156]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4e0696-d813-49c5-b137-00f23937228c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)
Nov 09 04:14:44 user nova-compute[75378]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 (non-flash)
Nov 09 04:14:44 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)
Nov 09 04:14:44 user nova-compute[75378]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 (non-flash)
Nov 09 04:14:44 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[169e254f-5443-4268-8e05-6f8aef855f43]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:14:44 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lyYCEhDM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23265613637326134', 'path': '/dev/sdb'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265613637326134', 'path': '/dev/sdb'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-378218053',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-378218053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-378218053',id=47,image_ref='e2b51431-c1bb-4347-905d-18247649bf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGj//Z9q0hr1l9f2++pzC4ocSTSFCsUCrMg+R95wafayM5dXvlaetsxBUKXvztPM4lAC+UjNrklrHWevRtT5cIDorMkxpxYi8/uGH11cE1bi+NekkmIWHwLdDMGegedh/w==',key_name='tempest-keypair-637103972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed5a4bfe6ce546d2acfbf7be75334d1a',ramdisk_id='',reservation_id='r-kl3bvgnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1436829014',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1436829014-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1436829014',owner_user_name='tempest-TestVolumeBootPattern-1436829014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:14:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23b841529aaf42c29a442ef9524422b2',uuid=69c482e5-9f19-4f67-a64c-ec35677d9dff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "address": "fa:16:3e:87:5d:52", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5d21b2-50", "ovs_interfaceid": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converting VIF {"id": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "address": "fa:16:3e:87:5d:52", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5d21b2-50", "ovs_interfaceid": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:5d:52,bridge_name='br-int',has_traffic_filtering=True,id=9c5d21b2-50f1-4627-9216-9e3d1a7a18d3,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5d21b2-50') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG nova.objects.instance [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lazy-loading 'pci_devices' on Instance uuid 69c482e5-9f19-4f67-a64c-ec35677d9dff {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] End _get_guest_xml xml=<domain type="kvm">
Nov 09 04:14:45 user nova-compute[75378]:   <uuid>69c482e5-9f19-4f67-a64c-ec35677d9dff</uuid>
Nov 09 04:14:45 user nova-compute[75378]:   <name>instance-0000002f</name>
Nov 09 04:14:45 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 04:14:45 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 04:14:45 user nova-compute[75378]:   <metadata>
Nov 09 04:14:45 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 04:14:45 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 04:14:45 user nova-compute[75378]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-378218053</nova:name>
Nov 09 04:14:45 user nova-compute[75378]:       <nova:creationTime>2023-11-09 04:14:43</nova:creationTime>
Nov 09 04:14:45 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 04:14:45 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 04:14:45 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 04:14:45 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 04:14:45 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 04:14:45 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 04:14:45 user nova-compute[75378]:       </nova:flavor>
Nov 09 04:14:45 user nova-compute[75378]:       <nova:owner>
Nov 09 04:14:45 user nova-compute[75378]:         <nova:user uuid="23b841529aaf42c29a442ef9524422b2">tempest-TestVolumeBootPattern-1436829014-project-member</nova:user>
Nov 09 04:14:45 user nova-compute[75378]:         <nova:project uuid="ed5a4bfe6ce546d2acfbf7be75334d1a">tempest-TestVolumeBootPattern-1436829014</nova:project>
Nov 09 04:14:45 user nova-compute[75378]:       </nova:owner>
Nov 09 04:14:45 user nova-compute[75378]:       <nova:root type="image" uuid="e2b51431-c1bb-4347-905d-18247649bf7b"/>
Nov 09 04:14:45 user nova-compute[75378]:       <nova:ports>
Nov 09 04:14:45 user nova-compute[75378]:         <nova:port uuid="9c5d21b2-50f1-4627-9216-9e3d1a7a18d3">
Nov 09 04:14:45 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 04:14:45 user nova-compute[75378]:         </nova:port>
Nov 09 04:14:45 user nova-compute[75378]:       </nova:ports>
Nov 09 04:14:45 user nova-compute[75378]:     </nova:instance>
Nov 09 04:14:45 user nova-compute[75378]:   </metadata>
Nov 09 04:14:45 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 04:14:45 user nova-compute[75378]:     <system>
Nov 09 04:14:45 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 04:14:45 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 04:14:45 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 04:14:45 user nova-compute[75378]:       <entry name="serial">69c482e5-9f19-4f67-a64c-ec35677d9dff</entry>
Nov 09 04:14:45 user nova-compute[75378]:       <entry name="uuid">69c482e5-9f19-4f67-a64c-ec35677d9dff</entry>
Nov 09 04:14:45 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 04:14:45 user nova-compute[75378]:     </system>
Nov 09 04:14:45 user nova-compute[75378]:   </sysinfo>
Nov 09 04:14:45 user nova-compute[75378]:   <os>
Nov 09 04:14:45 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 04:14:45 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 04:14:45 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 04:14:45 user nova-compute[75378]:   </os>
Nov 09 04:14:45 user nova-compute[75378]:   <features>
Nov 09 04:14:45 user nova-compute[75378]:     <acpi/>
Nov 09 04:14:45 user nova-compute[75378]:     <apic/>
Nov 09 04:14:45 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 04:14:45 user nova-compute[75378]:   </features>
Nov 09 04:14:45 user nova-compute[75378]:   <clock offset="utc">
Nov 09 04:14:45 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 04:14:45 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 04:14:45 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 04:14:45 user nova-compute[75378]:   </clock>
Nov 09 04:14:45 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 04:14:45 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 04:14:45 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 04:14:45 user nova-compute[75378]:   </cpu>
Nov 09 04:14:45 user nova-compute[75378]:   <devices>
Nov 09 04:14:45 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 04:14:45 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:14:45 user nova-compute[75378]:       <source dev="/dev/sdb"/>
Nov 09 04:14:45 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 04:14:45 user nova-compute[75378]:       <serial>b69ff060-c04c-4332-84fd-0c9109a36c13</serial>
Nov 09 04:14:45 user nova-compute[75378]:     </disk>
Nov 09 04:14:45 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 04:14:45 user nova-compute[75378]:       <mac address="fa:16:3e:87:5d:52"/>
Nov 09 04:14:45 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:14:45 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 04:14:45 user nova-compute[75378]:       <target dev="tap9c5d21b2-50"/>
Nov 09 04:14:45 user nova-compute[75378]:     </interface>
Nov 09 04:14:45 user nova-compute[75378]:     <serial type="pty">
Nov 09 04:14:45 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/69c482e5-9f19-4f67-a64c-ec35677d9dff/console.log" append="off"/>
Nov 09 04:14:45 user nova-compute[75378]:     </serial>
Nov 09 04:14:45 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 04:14:45 user nova-compute[75378]:     <video>
Nov 09 04:14:45 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:14:45 user nova-compute[75378]:     </video>
Nov 09 04:14:45 user nova-compute[75378]:     <rng model="virtio">
Nov 09 04:14:45 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 04:14:45 user nova-compute[75378]:     </rng>
Nov 09 04:14:45 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 04:14:45 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 04:14:45 user nova-compute[75378]:       <stats period="10"/>
Nov 09 04:14:45 user nova-compute[75378]:     </memballoon>
Nov 09 04:14:45 user nova-compute[75378]:   </devices>
Nov 09 04:14:45 user nova-compute[75378]: </domain>
Nov 09 04:14:45 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-378218053',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-378218053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-378218053',id=47,image_ref='e2b51431-c1bb-4347-905d-18247649bf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGj//Z9q0hr1l9f2++pzC4ocSTSFCsUCrMg+R95wafayM5dXvlaetsxBUKXvztPM4lAC+UjNrklrHWevRtT5cIDorMkxpxYi8/uGH11cE1bi+NekkmIWHwLdDMGegedh/w==',key_name='tempest-keypair-637103972',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed5a4bfe6ce546d2acfbf7be75334d1a',ramdisk_id='',reservation_id='r-kl3bvgnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1436829014',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1436829014-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1436829014',owner_user_name='tempest-TestVolumeBootPattern-1436829014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:14:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23b841529aaf42c29a442ef9524422b2',uuid=69c482e5-9f19-4f67-a64c-ec35677d9dff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "address": "fa:16:3e:87:5d:52", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5d21b2-50", "ovs_interfaceid": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converting VIF {"id": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "address": "fa:16:3e:87:5d:52", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5d21b2-50", "ovs_interfaceid": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:5d:52,bridge_name='br-int',has_traffic_filtering=True,id=9c5d21b2-50f1-4627-9216-9e3d1a7a18d3,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5d21b2-50') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG os_vif [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:5d:52,bridge_name='br-int',has_traffic_filtering=True,id=9c5d21b2-50f1-4627-9216-9e3d1a7a18d3,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5d21b2-50') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '541267db-8e35-59c2-acde-311f5bd061a7', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c5d21b2-50, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c5d21b2-50, col_values=(('qos', UUID('aeda7424-1b71-4be8-a936-629dece4df77')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c5d21b2-50, col_values=(('external_ids', {'iface-id': '9c5d21b2-50f1-4627-9216-9e3d1a7a18d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:5d:52', 'vm-uuid': '69c482e5-9f19-4f67-a64c-ec35677d9dff'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:45 user nova-compute[75378]: INFO os_vif [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:5d:52,bridge_name='br-int',has_traffic_filtering=True,id=9c5d21b2-50f1-4627-9216-9e3d1a7a18d3,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5d21b2-50')
Nov 09 04:14:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:14:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] No VIF found with MAC fa:16:3e:87:5d:52, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:14:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-63b62462-891c-4e72-948b-092b1222a3e4 req-17785a13-278b-43da-a8c8-5d94f83436d2 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Received event network-vif-plugged-9c5d21b2-50f1-4627-9216-9e3d1a7a18d3 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:14:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-63b62462-891c-4e72-948b-092b1222a3e4 req-17785a13-278b-43da-a8c8-5d94f83436d2 service nova] Acquiring lock "69c482e5-9f19-4f67-a64c-ec35677d9dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-63b62462-891c-4e72-948b-092b1222a3e4 req-17785a13-278b-43da-a8c8-5d94f83436d2 service nova] Lock "69c482e5-9f19-4f67-a64c-ec35677d9dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-63b62462-891c-4e72-948b-092b1222a3e4 req-17785a13-278b-43da-a8c8-5d94f83436d2 service nova] Lock "69c482e5-9f19-4f67-a64c-ec35677d9dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:46 user nova-compute[75378]: DEBUG nova.compute.manager [req-63b62462-891c-4e72-948b-092b1222a3e4 req-17785a13-278b-43da-a8c8-5d94f83436d2 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] No waiting events found dispatching network-vif-plugged-9c5d21b2-50f1-4627-9216-9e3d1a7a18d3 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:14:46 user nova-compute[75378]: WARNING nova.compute.manager [req-63b62462-891c-4e72-948b-092b1222a3e4 req-17785a13-278b-43da-a8c8-5d94f83436d2 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Received unexpected event network-vif-plugged-9c5d21b2-50f1-4627-9216-9e3d1a7a18d3 for instance with vm_state building and task_state spawning.
Nov 09 04:14:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 04:14:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 04:14:48 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Instance spawned successfully.
Nov 09 04:14:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 04:14:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:14:48 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:14:48 user nova-compute[75378]: INFO nova.compute.manager [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Took 4.86 seconds to spawn the instance on the hypervisor.
Nov 09 04:14:48 user nova-compute[75378]: DEBUG nova.compute.manager [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:14:48 user nova-compute[75378]: DEBUG nova.compute.manager [req-ebcf31b3-b691-4a42-a4f1-d609c7737d78 req-8a067f65-5190-4134-9cc4-dd18937cac1f service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Received event network-vif-plugged-9c5d21b2-50f1-4627-9216-9e3d1a7a18d3 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:14:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ebcf31b3-b691-4a42-a4f1-d609c7737d78 req-8a067f65-5190-4134-9cc4-dd18937cac1f service nova] Acquiring lock "69c482e5-9f19-4f67-a64c-ec35677d9dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ebcf31b3-b691-4a42-a4f1-d609c7737d78 req-8a067f65-5190-4134-9cc4-dd18937cac1f service nova] Lock "69c482e5-9f19-4f67-a64c-ec35677d9dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ebcf31b3-b691-4a42-a4f1-d609c7737d78 req-8a067f65-5190-4134-9cc4-dd18937cac1f service nova] Lock "69c482e5-9f19-4f67-a64c-ec35677d9dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:48 user nova-compute[75378]: DEBUG nova.compute.manager [req-ebcf31b3-b691-4a42-a4f1-d609c7737d78 req-8a067f65-5190-4134-9cc4-dd18937cac1f service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] No waiting events found dispatching network-vif-plugged-9c5d21b2-50f1-4627-9216-9e3d1a7a18d3 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:14:48 user nova-compute[75378]: WARNING nova.compute.manager [req-ebcf31b3-b691-4a42-a4f1-d609c7737d78 req-8a067f65-5190-4134-9cc4-dd18937cac1f service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Received unexpected event network-vif-plugged-9c5d21b2-50f1-4627-9216-9e3d1a7a18d3 for instance with vm_state building and task_state spawning.
Nov 09 04:14:48 user nova-compute[75378]: INFO nova.compute.manager [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Took 38.88 seconds to build instance.
Nov 09 04:14:48 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1eea6aeb-b8aa-4480-bbeb-597af8a059b6 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "69c482e5-9f19-4f67-a64c-ec35677d9dff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.972s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:14:51 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:14:51 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:14:52 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:14:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:14:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-094fa4b5-9622-4971-99e1-e505da91612d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:14:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-094fa4b5-9622-4971-99e1-e505da91612d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:14:52 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 04:14:52 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Updating instance_info_cache with network_info: [{"id": "e44a956f-1034-4390-abc6-534499259134", "address": "fa:16:3e:3b:10:5b", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44a956f-10", "ovs_interfaceid": "e44a956f-1034-4390-abc6-534499259134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:14:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-094fa4b5-9622-4971-99e1-e505da91612d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:14:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 04:14:54 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:14:54 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:14:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:14:56 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:14:57 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:14:57 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:14:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:57 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:14:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:14:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:14:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:14:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:14:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:14:58 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:14:58 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:14:58 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8540MB free_disk=25.198970794677734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:14:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:58 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 094fa4b5-9622-4971-99e1-e505da91612d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:14:58 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 42e015a5-b160-4b15-829b-3cab96075d6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:14:58 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 69c482e5-9f19-4f67-a64c-ec35677d9dff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:14:58 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:14:58 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:14:58 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:14:58 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:14:58 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:14:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.311s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:14:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "9c3afa94-f203-4c45-a755-02446b204d12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "9c3afa94-f203-4c45-a755-02446b204d12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 04:14:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:14:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:14:59 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 04:14:59 user nova-compute[75378]: INFO nova.compute.claims [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Claim successful on node user
Nov 09 04:15:00 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:15:00 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:15:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:15:00 user nova-compute[75378]: DEBUG nova.compute.manager [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 04:15:00 user nova-compute[75378]: DEBUG nova.compute.manager [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 04:15:00 user nova-compute[75378]: DEBUG nova.network.neutron [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 04:15:00 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 04:15:00 user nova-compute[75378]: DEBUG nova.compute.manager [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 04:15:00 user nova-compute[75378]: DEBUG nova.policy [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f996e26d3a04dd8ba5a64eaa218a9b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5788a86f2c4fcab582d65b471fe27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 04:15:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:15:00 user nova-compute[75378]: DEBUG nova.compute.manager [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 04:15:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 04:15:00 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Creating image(s)
Nov 09 04:15:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:15:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "/opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:15:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "/opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:15:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:15:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.181s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:15:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:15:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:15:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:15:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.175s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:15:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:15:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk 1073741824" returned: 0 in 0.052s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:15:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "2ef19bea51ac5815dc9f558430b64f7f4894d52a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:15:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:15:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.170s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:15:01 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk. size=1073741824 {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 04:15:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:15:01 user nova-compute[75378]: DEBUG nova.network.neutron [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Successfully created port: 460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 04:15:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:15:01 user nova-compute[75378]: DEBUG nova.virt.disk.api [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Cannot resize image /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk to a smaller size. {{(pid=75378) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 04:15:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 04:15:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Ensure instance console log exists: /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 04:15:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:15:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:15:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:15:01 user nova-compute[75378]: DEBUG nova.network.neutron [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Successfully updated port: 460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 04:15:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:15:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquired lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:15:01 user nova-compute[75378]: DEBUG nova.network.neutron [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:15:01 user nova-compute[75378]: DEBUG nova.compute.manager [req-0836177e-cec3-40e1-b0f7-80458e332742 req-d1e599cc-34db-45d0-8b50-61228609ba22 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Received event network-changed-460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:15:01 user nova-compute[75378]: DEBUG nova.compute.manager [req-0836177e-cec3-40e1-b0f7-80458e332742 req-d1e599cc-34db-45d0-8b50-61228609ba22 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Refreshing instance network info cache due to event network-changed-460e9a5d-f97c-41cd-9b47-f89ba0adc605. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:15:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0836177e-cec3-40e1-b0f7-80458e332742 req-d1e599cc-34db-45d0-8b50-61228609ba22 service nova] Acquiring lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:15:01 user nova-compute[75378]: DEBUG nova.network.neutron [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.network.neutron [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Updating instance_info_cache with network_info: [{"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Releasing lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.compute.manager [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Instance network_info: |[{"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0836177e-cec3-40e1-b0f7-80458e332742 req-d1e599cc-34db-45d0-8b50-61228609ba22 service nova] Acquired lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.network.neutron [req-0836177e-cec3-40e1-b0f7-80458e332742 req-d1e599cc-34db-45d0-8b50-61228609ba22 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Refreshing network info cache for port 460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Start _get_guest_xml network_info=[{"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 04:15:02 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:15:02 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T03:32:43Z,direct_url=<?>,disk_format='qcow2',id=c162665b-54ae-441d-9cd1-28ea81cc5de8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='03f5a524b2184dac84ddb8b7c3710417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T03:32:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:14:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1522830695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1522830695',id=48,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAmgkujsPpH7HS3IfPd/IJr2Mwu+TD3ob2qBckpyvhkAbUU6mRoar3gGTBn3TPuRspVvUQ+rdPDSBl9uy14S7ZgIiIOi9OtsnMceYEsI4if1aziXJzhOl3Kw1wSzP97bA==',key_name='tempest-keypair-1381306586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c5788a86f2c4fcab582d65b471fe27e',ramdisk_id='',reservation_id='r-j3uvi7ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1244090539',owner_user_name='tempest-AttachVolumeShelveTestJSON-1244090539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:15:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f996e26d3a04dd8ba5a64eaa218a9b3',uuid=9c3afa94-f203-4c45-a755-02446b204d12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converting VIF {"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:9e:dd,bridge_name='br-int',has_traffic_filtering=True,id=460e9a5d-f97c-41cd-9b47-f89ba0adc605,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460e9a5d-f9') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.objects.instance [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c3afa94-f203-4c45-a755-02446b204d12 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] End _get_guest_xml xml=<domain type="kvm">
Nov 09 04:15:02 user nova-compute[75378]:   <uuid>9c3afa94-f203-4c45-a755-02446b204d12</uuid>
Nov 09 04:15:02 user nova-compute[75378]:   <name>instance-00000030</name>
Nov 09 04:15:02 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 04:15:02 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 04:15:02 user nova-compute[75378]:   <metadata>
Nov 09 04:15:02 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 04:15:02 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 04:15:02 user nova-compute[75378]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1522830695</nova:name>
Nov 09 04:15:02 user nova-compute[75378]:       <nova:creationTime>2023-11-09 04:15:02</nova:creationTime>
Nov 09 04:15:02 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 04:15:02 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 04:15:02 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 04:15:02 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 04:15:02 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 04:15:02 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 04:15:02 user nova-compute[75378]:       </nova:flavor>
Nov 09 04:15:02 user nova-compute[75378]:       <nova:owner>
Nov 09 04:15:02 user nova-compute[75378]:         <nova:user uuid="5f996e26d3a04dd8ba5a64eaa218a9b3">tempest-AttachVolumeShelveTestJSON-1244090539-project-member</nova:user>
Nov 09 04:15:02 user nova-compute[75378]:         <nova:project uuid="3c5788a86f2c4fcab582d65b471fe27e">tempest-AttachVolumeShelveTestJSON-1244090539</nova:project>
Nov 09 04:15:02 user nova-compute[75378]:       </nova:owner>
Nov 09 04:15:02 user nova-compute[75378]:       <nova:root type="image" uuid="c162665b-54ae-441d-9cd1-28ea81cc5de8"/>
Nov 09 04:15:02 user nova-compute[75378]:       <nova:ports>
Nov 09 04:15:02 user nova-compute[75378]:         <nova:port uuid="460e9a5d-f97c-41cd-9b47-f89ba0adc605">
Nov 09 04:15:02 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 09 04:15:02 user nova-compute[75378]:         </nova:port>
Nov 09 04:15:02 user nova-compute[75378]:       </nova:ports>
Nov 09 04:15:02 user nova-compute[75378]:     </nova:instance>
Nov 09 04:15:02 user nova-compute[75378]:   </metadata>
Nov 09 04:15:02 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 04:15:02 user nova-compute[75378]:     <system>
Nov 09 04:15:02 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 04:15:02 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 04:15:02 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 04:15:02 user nova-compute[75378]:       <entry name="serial">9c3afa94-f203-4c45-a755-02446b204d12</entry>
Nov 09 04:15:02 user nova-compute[75378]:       <entry name="uuid">9c3afa94-f203-4c45-a755-02446b204d12</entry>
Nov 09 04:15:02 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 04:15:02 user nova-compute[75378]:     </system>
Nov 09 04:15:02 user nova-compute[75378]:   </sysinfo>
Nov 09 04:15:02 user nova-compute[75378]:   <os>
Nov 09 04:15:02 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 04:15:02 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 04:15:02 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 04:15:02 user nova-compute[75378]:   </os>
Nov 09 04:15:02 user nova-compute[75378]:   <features>
Nov 09 04:15:02 user nova-compute[75378]:     <acpi/>
Nov 09 04:15:02 user nova-compute[75378]:     <apic/>
Nov 09 04:15:02 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 04:15:02 user nova-compute[75378]:   </features>
Nov 09 04:15:02 user nova-compute[75378]:   <clock offset="utc">
Nov 09 04:15:02 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 04:15:02 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 04:15:02 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 04:15:02 user nova-compute[75378]:   </clock>
Nov 09 04:15:02 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 04:15:02 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 04:15:02 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 04:15:02 user nova-compute[75378]:   </cpu>
Nov 09 04:15:02 user nova-compute[75378]:   <devices>
Nov 09 04:15:02 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 04:15:02 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 04:15:02 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk"/>
Nov 09 04:15:02 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 04:15:02 user nova-compute[75378]:     </disk>
Nov 09 04:15:02 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 04:15:02 user nova-compute[75378]:       <mac address="fa:16:3e:6c:9e:dd"/>
Nov 09 04:15:02 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:15:02 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 04:15:02 user nova-compute[75378]:       <target dev="tap460e9a5d-f9"/>
Nov 09 04:15:02 user nova-compute[75378]:     </interface>
Nov 09 04:15:02 user nova-compute[75378]:     <serial type="pty">
Nov 09 04:15:02 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/console.log" append="off"/>
Nov 09 04:15:02 user nova-compute[75378]:     </serial>
Nov 09 04:15:02 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 04:15:02 user nova-compute[75378]:     <video>
Nov 09 04:15:02 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:15:02 user nova-compute[75378]:     </video>
Nov 09 04:15:02 user nova-compute[75378]:     <rng model="virtio">
Nov 09 04:15:02 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 04:15:02 user nova-compute[75378]:     </rng>
Nov 09 04:15:02 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 04:15:02 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 04:15:02 user nova-compute[75378]:       <stats period="10"/>
Nov 09 04:15:02 user nova-compute[75378]:     </memballoon>
Nov 09 04:15:02 user nova-compute[75378]:   </devices>
Nov 09 04:15:02 user nova-compute[75378]: </domain>
Nov 09 04:15:02 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:14:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1522830695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1522830695',id=48,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAmgkujsPpH7HS3IfPd/IJr2Mwu+TD3ob2qBckpyvhkAbUU6mRoar3gGTBn3TPuRspVvUQ+rdPDSBl9uy14S7ZgIiIOi9OtsnMceYEsI4if1aziXJzhOl3Kw1wSzP97bA==',key_name='tempest-keypair-1381306586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c5788a86f2c4fcab582d65b471fe27e',ramdisk_id='',reservation_id='r-j3uvi7ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1244090539',owner_user_name='tempest-AttachVolumeShelveTestJSON-1244090539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:15:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f996e26d3a04dd8ba5a64eaa218a9b3',uuid=9c3afa94-f203-4c45-a755-02446b204d12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converting VIF {"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:9e:dd,bridge_name='br-int',has_traffic_filtering=True,id=460e9a5d-f97c-41cd-9b47-f89ba0adc605,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460e9a5d-f9') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG os_vif [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:9e:dd,bridge_name='br-int',has_traffic_filtering=True,id=460e9a5d-f97c-41cd-9b47-f89ba0adc605,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460e9a5d-f9') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2054e33a-0997-509b-a551-5f0437cb3389', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap460e9a5d-f9, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap460e9a5d-f9, col_values=(('qos', UUID('dc1db159-a287-4b38-8fb9-ac44dec1ba7d')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap460e9a5d-f9, col_values=(('external_ids', {'iface-id': '460e9a5d-f97c-41cd-9b47-f89ba0adc605', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:9e:dd', 'vm-uuid': '9c3afa94-f203-4c45-a755-02446b204d12'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:02 user nova-compute[75378]: INFO os_vif [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:9e:dd,bridge_name='br-int',has_traffic_filtering=True,id=460e9a5d-f97c-41cd-9b47-f89ba0adc605,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460e9a5d-f9')
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] No VIF found with MAC fa:16:3e:6c:9e:dd, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.network.neutron [req-0836177e-cec3-40e1-b0f7-80458e332742 req-d1e599cc-34db-45d0-8b50-61228609ba22 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Updated VIF entry in instance network info cache for port 460e9a5d-f97c-41cd-9b47-f89ba0adc605. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG nova.network.neutron [req-0836177e-cec3-40e1-b0f7-80458e332742 req-d1e599cc-34db-45d0-8b50-61228609ba22 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Updating instance_info_cache with network_info: [{"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:15:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0836177e-cec3-40e1-b0f7-80458e332742 req-d1e599cc-34db-45d0-8b50-61228609ba22 service nova] Releasing lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:15:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-a6fc240d-cc4b-45a5-a3a7-8ee30506c519 req-e1314d6d-5db7-465c-a0e1-e46a4ab8f3ff service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Received event network-vif-plugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:15:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a6fc240d-cc4b-45a5-a3a7-8ee30506c519 req-e1314d6d-5db7-465c-a0e1-e46a4ab8f3ff service nova] Acquiring lock "9c3afa94-f203-4c45-a755-02446b204d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:15:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a6fc240d-cc4b-45a5-a3a7-8ee30506c519 req-e1314d6d-5db7-465c-a0e1-e46a4ab8f3ff service nova] Lock "9c3afa94-f203-4c45-a755-02446b204d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:15:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a6fc240d-cc4b-45a5-a3a7-8ee30506c519 req-e1314d6d-5db7-465c-a0e1-e46a4ab8f3ff service nova] Lock "9c3afa94-f203-4c45-a755-02446b204d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:15:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-a6fc240d-cc4b-45a5-a3a7-8ee30506c519 req-e1314d6d-5db7-465c-a0e1-e46a4ab8f3ff service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] No waiting events found dispatching network-vif-plugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:15:03 user nova-compute[75378]: WARNING nova.compute.manager [req-a6fc240d-cc4b-45a5-a3a7-8ee30506c519 req-e1314d6d-5db7-465c-a0e1-e46a4ab8f3ff service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Received unexpected event network-vif-plugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 for instance with vm_state building and task_state spawning.
Nov 09 04:15:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:04 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:15:04 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:15:05 user nova-compute[75378]: DEBUG nova.compute.manager [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 04:15:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 04:15:05 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Instance spawned successfully.
Nov 09 04:15:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 04:15:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:15:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:15:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:15:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:15:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:15:05 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:15:05 user nova-compute[75378]: INFO nova.compute.manager [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 09 04:15:05 user nova-compute[75378]: DEBUG nova.compute.manager [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:15:05 user nova-compute[75378]: DEBUG nova.compute.manager [req-12d9c449-a8ce-43d9-af9b-3a123887fa0c req-524fc6c7-1c7c-4585-abd4-df1551c184c7 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Received event network-vif-plugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:15:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-12d9c449-a8ce-43d9-af9b-3a123887fa0c req-524fc6c7-1c7c-4585-abd4-df1551c184c7 service nova] Acquiring lock "9c3afa94-f203-4c45-a755-02446b204d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:15:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-12d9c449-a8ce-43d9-af9b-3a123887fa0c req-524fc6c7-1c7c-4585-abd4-df1551c184c7 service nova] Lock "9c3afa94-f203-4c45-a755-02446b204d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:15:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-12d9c449-a8ce-43d9-af9b-3a123887fa0c req-524fc6c7-1c7c-4585-abd4-df1551c184c7 service nova] Lock "9c3afa94-f203-4c45-a755-02446b204d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:15:05 user nova-compute[75378]: DEBUG nova.compute.manager [req-12d9c449-a8ce-43d9-af9b-3a123887fa0c req-524fc6c7-1c7c-4585-abd4-df1551c184c7 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] No waiting events found dispatching network-vif-plugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:15:05 user nova-compute[75378]: WARNING nova.compute.manager [req-12d9c449-a8ce-43d9-af9b-3a123887fa0c req-524fc6c7-1c7c-4585-abd4-df1551c184c7 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Received unexpected event network-vif-plugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 for instance with vm_state building and task_state spawning.
Nov 09 04:15:05 user nova-compute[75378]: INFO nova.compute.manager [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Took 6.09 seconds to build instance.
Nov 09 04:15:05 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-db2a84d4-42db-491b-9fbb-553eda728006 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "9c3afa94-f203-4c45-a755-02446b204d12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.212s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:15:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:26 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:15:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:15:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:15:52 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:15:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:15:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Didn't find any instances for network info cache update. {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 04:15:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:15:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:15:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:15:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:15:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:53 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:15:53 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:15:54 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-a974a5f7-4cbc-49ca-85af-aa7481a81632 req-c1bc5c35-1d55-49ed-be93-71b73d85f5a2 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Received event network-changed-00629a2d-5f73-4c4a-b23b-95032fdbeb09 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-a974a5f7-4cbc-49ca-85af-aa7481a81632 req-c1bc5c35-1d55-49ed-be93-71b73d85f5a2 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Refreshing instance network info cache due to event network-changed-00629a2d-5f73-4c4a-b23b-95032fdbeb09. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a974a5f7-4cbc-49ca-85af-aa7481a81632 req-c1bc5c35-1d55-49ed-be93-71b73d85f5a2 service nova] Acquiring lock "refresh_cache-42e015a5-b160-4b15-829b-3cab96075d6f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a974a5f7-4cbc-49ca-85af-aa7481a81632 req-c1bc5c35-1d55-49ed-be93-71b73d85f5a2 service nova] Acquired lock "refresh_cache-42e015a5-b160-4b15-829b-3cab96075d6f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG nova.network.neutron [req-a974a5f7-4cbc-49ca-85af-aa7481a81632 req-c1bc5c35-1d55-49ed-be93-71b73d85f5a2 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Refreshing network info cache for port 00629a2d-5f73-4c4a-b23b-95032fdbeb09 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG nova.network.neutron [req-a974a5f7-4cbc-49ca-85af-aa7481a81632 req-c1bc5c35-1d55-49ed-be93-71b73d85f5a2 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Updated VIF entry in instance network info cache for port 00629a2d-5f73-4c4a-b23b-95032fdbeb09. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG nova.network.neutron [req-a974a5f7-4cbc-49ca-85af-aa7481a81632 req-c1bc5c35-1d55-49ed-be93-71b73d85f5a2 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Updating instance_info_cache with network_info: [{"id": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "address": "fa:16:3e:f7:b5:ff", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00629a2d-5f", "ovs_interfaceid": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a974a5f7-4cbc-49ca-85af-aa7481a81632 req-c1bc5c35-1d55-49ed-be93-71b73d85f5a2 service nova] Releasing lock "refresh_cache-42e015a5-b160-4b15-829b-3cab96075d6f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "42e015a5-b160-4b15-829b-3cab96075d6f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "42e015a5-b160-4b15-829b-3cab96075d6f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG nova.objects.instance [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lazy-loading 'flavor' on Instance uuid 42e015a5-b160-4b15-829b-3cab96075d6f {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "42e015a5-b160-4b15-829b-3cab96075d6f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "42e015a5-b160-4b15-829b-3cab96075d6f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "42e015a5-b160-4b15-829b-3cab96075d6f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:15:55 user nova-compute[75378]: INFO nova.compute.manager [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Attaching volume 9d25b237-38c7-48a7-ab25-9c9bad3a4680 to /dev/vdb
Nov 09 04:15:55 user nova-compute[75378]: DEBUG os_brick.utils [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dcfdd6-466f-4d0a-9112-506674a5f70f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5872f32f-45f2-4244-af52-1e45673c4145]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9a89f3-7f19-4bbd-9e6f-01051ad903fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4869d93d-1f39-4387-9e77-21ed94391272]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:15:55 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 04:15:55 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cebf1dd-3d44-4d35-a10f-c4f89b06032d]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG os_brick.utils [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:15:55 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Updating existing volume attachment record: be2b7f76-d126-42ef-8cee-b72cc28b5bc9 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 04:15:56 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:15:57 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:15:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:15:58 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:15:58 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:15:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:15:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:15:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:15:58 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:15:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:15:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:15:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:15:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:15:58 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:15:58 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:15:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:15:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:15:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:15:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:15:59 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:15:59 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:15:59 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8543MB free_disk=25.16671371459961GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:15:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:15:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:15:59 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 094fa4b5-9622-4971-99e1-e505da91612d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:15:59 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 42e015a5-b160-4b15-829b-3cab96075d6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:15:59 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 69c482e5-9f19-4f67-a64c-ec35677d9dff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:15:59 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9c3afa94-f203-4c45-a755-02446b204d12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:15:59 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:15:59 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:15:59 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:15:59 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:15:59 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:15:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:16:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-0529538d-df9c-47e3-a49f-fb79ec3c1006 req-10b5a666-7d05-46fa-bfcb-cf8345e15061 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Received event network-changed-9c5d21b2-50f1-4627-9216-9e3d1a7a18d3 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:16:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-0529538d-df9c-47e3-a49f-fb79ec3c1006 req-10b5a666-7d05-46fa-bfcb-cf8345e15061 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Refreshing instance network info cache due to event network-changed-9c5d21b2-50f1-4627-9216-9e3d1a7a18d3. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:16:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0529538d-df9c-47e3-a49f-fb79ec3c1006 req-10b5a666-7d05-46fa-bfcb-cf8345e15061 service nova] Acquiring lock "refresh_cache-69c482e5-9f19-4f67-a64c-ec35677d9dff" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:16:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0529538d-df9c-47e3-a49f-fb79ec3c1006 req-10b5a666-7d05-46fa-bfcb-cf8345e15061 service nova] Acquired lock "refresh_cache-69c482e5-9f19-4f67-a64c-ec35677d9dff" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:16:00 user nova-compute[75378]: DEBUG nova.network.neutron [req-0529538d-df9c-47e3-a49f-fb79ec3c1006 req-10b5a666-7d05-46fa-bfcb-cf8345e15061 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Refreshing network info cache for port 9c5d21b2-50f1-4627-9216-9e3d1a7a18d3 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:16:01 user nova-compute[75378]: DEBUG nova.network.neutron [req-0529538d-df9c-47e3-a49f-fb79ec3c1006 req-10b5a666-7d05-46fa-bfcb-cf8345e15061 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Updated VIF entry in instance network info cache for port 9c5d21b2-50f1-4627-9216-9e3d1a7a18d3. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:16:01 user nova-compute[75378]: DEBUG nova.network.neutron [req-0529538d-df9c-47e3-a49f-fb79ec3c1006 req-10b5a666-7d05-46fa-bfcb-cf8345e15061 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Updating instance_info_cache with network_info: [{"id": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "address": "fa:16:3e:87:5d:52", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5d21b2-50", "ovs_interfaceid": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:16:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0529538d-df9c-47e3-a49f-fb79ec3c1006 req-10b5a666-7d05-46fa-bfcb-cf8345e15061 service nova] Releasing lock "refresh_cache-69c482e5-9f19-4f67-a64c-ec35677d9dff" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:16:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "69c482e5-9f19-4f67-a64c-ec35677d9dff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:16:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "69c482e5-9f19-4f67-a64c-ec35677d9dff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:16:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "69c482e5-9f19-4f67-a64c-ec35677d9dff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:16:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "69c482e5-9f19-4f67-a64c-ec35677d9dff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:16:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "69c482e5-9f19-4f67-a64c-ec35677d9dff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:16:01 user nova-compute[75378]: INFO nova.compute.manager [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Terminating instance
Nov 09 04:16:01 user nova-compute[75378]: DEBUG nova.compute.manager [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:16:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:02 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Instance destroyed successfully.
Nov 09 04:16:02 user nova-compute[75378]: DEBUG nova.objects.instance [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lazy-loading 'resources' on Instance uuid 69c482e5-9f19-4f67-a64c-ec35677d9dff {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-378218053',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-378218053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-378218053',id=47,image_ref='e2b51431-c1bb-4347-905d-18247649bf7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGj//Z9q0hr1l9f2++pzC4ocSTSFCsUCrMg+R95wafayM5dXvlaetsxBUKXvztPM4lAC+UjNrklrHWevRtT5cIDorMkxpxYi8/uGH11cE1bi+NekkmIWHwLdDMGegedh/w==',key_name='tempest-keypair-637103972',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:14:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed5a4bfe6ce546d2acfbf7be75334d1a',ramdisk_id='',reservation_id='r-kl3bvgnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1436829014',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1436829014-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1436829014',owner_user_name='tempest-TestVolumeBootPattern-1436829014-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T04:14:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23b841529aaf42c29a442ef9524422b2',uuid=69c482e5-9f19-4f67-a64c-ec35677d9dff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "address": "fa:16:3e:87:5d:52", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5d21b2-50", "ovs_interfaceid": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converting VIF {"id": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "address": "fa:16:3e:87:5d:52", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c5d21b2-50", "ovs_interfaceid": "9c5d21b2-50f1-4627-9216-9e3d1a7a18d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:5d:52,bridge_name='br-int',has_traffic_filtering=True,id=9c5d21b2-50f1-4627-9216-9e3d1a7a18d3,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5d21b2-50') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_vif [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:5d:52,bridge_name='br-int',has_traffic_filtering=True,id=9c5d21b2-50f1-4627-9216-9e3d1a7a18d3,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5d21b2-50') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c5d21b2-50, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aeda7424-1b71-4be8-a936-629dece4df77) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:16:02 user nova-compute[75378]: INFO os_vif [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:5d:52,bridge_name='br-int',has_traffic_filtering=True,id=9c5d21b2-50f1-4627-9216-9e3d1a7a18d3,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c5d21b2-50')
Nov 09 04:16:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lyYCEhDM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:16:02 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6741953c-786b-4470-979a-2cdc4f9c6e54]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 04:16:02 user nova-compute[75378]: No targets found.
Nov 09 04:16:02 user nova-compute[75378]: iSNS:
Nov 09 04:16:02 user nova-compute[75378]: No targets found.
Nov 09 04:16:02 user nova-compute[75378]: STATIC:
Nov 09 04:16:02 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e
Nov 09 04:16:02 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:16:02 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:16:02 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13
Nov 09 04:16:02 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:16:02 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:16:02 user nova-compute[75378]: FIRMWARE:
Nov 09 04:16:02 user nova-compute[75378]: No targets found.
Nov 09 04:16:02 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 04:16:02 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 04:16:02 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[917eed4b-e064-4cd0-96bf-3936250e141d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[526491ea-e182-4bf3-917a-363e22564ff0]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)
Nov 09 04:16:02 user nova-compute[75378]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 (non-flash)
Nov 09 04:16:02 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)
Nov 09 04:16:02 user nova-compute[75378]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 (non-flash)
Nov 09 04:16:02 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff3b04d93f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13'): ({'sdb'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Removing single pathed devices sdb {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[48021fdf-639a-4d99-b487-697bfbe90e32]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[606bd21f-c451-49c5-9e7b-adfd6229a0e4]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Flushing IO for device /dev/sdb {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efb22d0-9823-47fe-8799-249d556ec568]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.088s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a35fcb-76ed-492b-b587-b1f8c7ce01b5]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_58a0ee66',) {{(pid=87049) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed40f4b-77a2-4e36-8c83-97f93e650647]: (4, None) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc23bf5-d5c8-4f2e-88d6-dd41eaef11d5]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[36356ef6-d71a-4606-bb4f-f0e8197c9ad8]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13, portal: 172.16.0.220,3260]
Nov 09 04:16:02 user nova-compute[75378]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13, portal: 172.16.0.220,3260] successful.
Nov 09 04:16:02 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69ff060-c04c-4332-84fd-0c9109a36c13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[97168fe5-d6c5-4769-b9fe-cb15ecd4dfb4]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] <== disconnect_volume: return (349ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 04:16:02 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Deleting instance files /opt/stack/data/nova/instances/69c482e5-9f19-4f67-a64c-ec35677d9dff_del
Nov 09 04:16:02 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Deletion of /opt/stack/data/nova/instances/69c482e5-9f19-4f67-a64c-ec35677d9dff_del complete
Nov 09 04:16:02 user nova-compute[75378]: INFO nova.compute.manager [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG nova.compute.manager [req-68138bca-8837-4a6a-a508-e0c9a713167c req-3fd6e819-73cc-4c16-9747-18029233b514 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Received event network-vif-unplugged-9c5d21b2-50f1-4627-9216-9e3d1a7a18d3 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-68138bca-8837-4a6a-a508-e0c9a713167c req-3fd6e819-73cc-4c16-9747-18029233b514 service nova] Acquiring lock "69c482e5-9f19-4f67-a64c-ec35677d9dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-68138bca-8837-4a6a-a508-e0c9a713167c req-3fd6e819-73cc-4c16-9747-18029233b514 service nova] Lock "69c482e5-9f19-4f67-a64c-ec35677d9dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-68138bca-8837-4a6a-a508-e0c9a713167c req-3fd6e819-73cc-4c16-9747-18029233b514 service nova] Lock "69c482e5-9f19-4f67-a64c-ec35677d9dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG nova.compute.manager [req-68138bca-8837-4a6a-a508-e0c9a713167c req-3fd6e819-73cc-4c16-9747-18029233b514 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] No waiting events found dispatching network-vif-unplugged-9c5d21b2-50f1-4627-9216-9e3d1a7a18d3 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG nova.compute.manager [req-68138bca-8837-4a6a-a508-e0c9a713167c req-3fd6e819-73cc-4c16-9747-18029233b514 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Received event network-vif-unplugged-9c5d21b2-50f1-4627-9216-9e3d1a7a18d3 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG nova.compute.manager [req-68138bca-8837-4a6a-a508-e0c9a713167c req-3fd6e819-73cc-4c16-9747-18029233b514 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Received event network-vif-plugged-9c5d21b2-50f1-4627-9216-9e3d1a7a18d3 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-68138bca-8837-4a6a-a508-e0c9a713167c req-3fd6e819-73cc-4c16-9747-18029233b514 service nova] Acquiring lock "69c482e5-9f19-4f67-a64c-ec35677d9dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-68138bca-8837-4a6a-a508-e0c9a713167c req-3fd6e819-73cc-4c16-9747-18029233b514 service nova] Lock "69c482e5-9f19-4f67-a64c-ec35677d9dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-68138bca-8837-4a6a-a508-e0c9a713167c req-3fd6e819-73cc-4c16-9747-18029233b514 service nova] Lock "69c482e5-9f19-4f67-a64c-ec35677d9dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:16:02 user nova-compute[75378]: DEBUG nova.compute.manager [req-68138bca-8837-4a6a-a508-e0c9a713167c req-3fd6e819-73cc-4c16-9747-18029233b514 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] No waiting events found dispatching network-vif-plugged-9c5d21b2-50f1-4627-9216-9e3d1a7a18d3 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:16:02 user nova-compute[75378]: WARNING nova.compute.manager [req-68138bca-8837-4a6a-a508-e0c9a713167c req-3fd6e819-73cc-4c16-9747-18029233b514 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Received unexpected event network-vif-plugged-9c5d21b2-50f1-4627-9216-9e3d1a7a18d3 for instance with vm_state active and task_state deleting.
Nov 09 04:16:03 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:16:03 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Took 0.62 seconds to deallocate network for instance.
Nov 09 04:16:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-aedd0e4b-9ba8-4035-afd1-c96dc0d5740f req-9c388d18-e90b-4a60-99b2-250a38d47994 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Received event network-vif-deleted-9c5d21b2-50f1-4627-9216-9e3d1a7a18d3 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:16:03 user nova-compute[75378]: INFO nova.compute.manager [req-aedd0e4b-9ba8-4035-afd1-c96dc0d5740f req-9c388d18-e90b-4a60-99b2-250a38d47994 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Neutron deleted interface 9c5d21b2-50f1-4627-9216-9e3d1a7a18d3; detaching it from the instance and deleting it from the info cache
Nov 09 04:16:03 user nova-compute[75378]: DEBUG nova.network.neutron [req-aedd0e4b-9ba8-4035-afd1-c96dc0d5740f req-9c388d18-e90b-4a60-99b2-250a38d47994 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:16:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-aedd0e4b-9ba8-4035-afd1-c96dc0d5740f req-9c388d18-e90b-4a60-99b2-250a38d47994 service nova] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Detach interface failed, port_id=9c5d21b2-50f1-4627-9216-9e3d1a7a18d3, reason: Instance 69c482e5-9f19-4f67-a64c-ec35677d9dff could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 04:16:04 user nova-compute[75378]: INFO nova.compute.manager [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Took 0.97 seconds to detach 1 volumes for instance.
Nov 09 04:16:04 user nova-compute[75378]: DEBUG nova.compute.manager [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 69c482e5-9f19-4f67-a64c-ec35677d9dff] Deleting volume: b69ff060-c04c-4332-84fd-0c9109a36c13 {{(pid=75378) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 09 04:16:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:16:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:16:04 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:16:04 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:16:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:16:04 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Deleted allocations for instance 69c482e5-9f19-4f67-a64c-ec35677d9dff
Nov 09 04:16:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-288198b3-3d0e-47fb-aeee-210041cd0083 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "69c482e5-9f19-4f67-a64c-ec35677d9dff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.211s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:16:04 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:16:04 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:16:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qAPjfJrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:16:18 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:16:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:16:18 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:16:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:16:18 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e9a188-ed7f-4dce-a2c0-3c8749b12d5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 04:16:18 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d4040f-2a71-4917-bb39-a899a7d5f308]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680] added
Nov 09 04:16:18 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[05730dbd-226f-45d4-9d04-d51d70b323ca]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be032fa-a2a3-4e11-bdef-ecb36eabc1cf]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qAPjfJrD {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qAPjfJrD" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c674f17a-661c-488a-b1a8-b7dbe97d67c5]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qAPjfJrD'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[881b54ab-a4da-4cb8-9306-b76d76fe9cc2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d61c2c-701d-4af3-b849-50ad61167383]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)
Nov 09 04:16:18 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)
Nov 09 04:16:18 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13226f5-2e9c-45dd-beaf-8f8c7ac1e47a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680, portal: 172.16.0.220,3260]
Nov 09 04:16:18 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680, portal: 172.16.0.220,3260] successful.
Nov 09 04:16:18 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:16:18 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:19 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[593d515b-9980-4c1d-b2a0-4e4ded281f24]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:19 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:16:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:19 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3692710c-4679-4441-9cdb-240b258f3d7f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:19 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)
Nov 09 04:16:19 user nova-compute[75378]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 (non-flash)
Nov 09 04:16:19 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:16:19 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)
Nov 09 04:16:19 user nova-compute[75378]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 (non-flash)
Nov 09 04:16:19 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:16:19 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:16:19 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 04:16:19 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 04:16:19 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 04:16:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:19 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:19 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edd217b-1904-4c16-9163-f9d2a68e14d2]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:19 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:16:20 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:16:20 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qAPjfJrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 04:16:20 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:16:20 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26435363562623130', 'path': '/dev/sdb'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:16:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435363562623130', 'path': '/dev/sdb'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 04:16:20 user nova-compute[75378]: DEBUG nova.objects.instance [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lazy-loading 'flavor' on Instance uuid 42e015a5-b160-4b15-829b-3cab96075d6f {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:16:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 04:16:20 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:16:20 user nova-compute[75378]:   <source dev="/dev/sdb"/>
Nov 09 04:16:20 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 04:16:20 user nova-compute[75378]:   <serial>9d25b237-38c7-48a7-ab25-9c9bad3a4680</serial>
Nov 09 04:16:20 user nova-compute[75378]: </disk>
Nov 09 04:16:20 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 04:16:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:16:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:16:20 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] No VIF found with MAC fa:16:3e:f7:b5:ff, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:16:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-d9c05697-838e-43b3-8901-78969e02352c tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "42e015a5-b160-4b15-829b-3cab96075d6f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.908s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:16:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "42e015a5-b160-4b15-829b-3cab96075d6f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:16:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "42e015a5-b160-4b15-829b-3cab96075d6f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:16:23 user nova-compute[75378]: INFO nova.compute.manager [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Detaching volume 9d25b237-38c7-48a7-ab25-9c9bad3a4680
Nov 09 04:16:23 user nova-compute[75378]: INFO nova.virt.block_device [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Attempting to driver detach volume 9d25b237-38c7-48a7-ab25-9c9bad3a4680 from mountpoint /dev/vdb
Nov 09 04:16:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Attempting to detach device vdb from instance 42e015a5-b160-4b15-829b-3cab96075d6f from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 04:16:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 04:16:23 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:16:23 user nova-compute[75378]:   <source dev="/dev/sdb"/>
Nov 09 04:16:23 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 04:16:23 user nova-compute[75378]:   <serial>9d25b237-38c7-48a7-ab25-9c9bad3a4680</serial>
Nov 09 04:16:23 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 04:16:23 user nova-compute[75378]: </disk>
Nov 09 04:16:23 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 04:16:23 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Successfully detached device vdb from instance 42e015a5-b160-4b15-829b-3cab96075d6f from the persistent domain config.
Nov 09 04:16:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 42e015a5-b160-4b15-829b-3cab96075d6f from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 04:16:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 04:16:23 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:16:23 user nova-compute[75378]:   <source dev="/dev/sdb"/>
Nov 09 04:16:23 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 04:16:23 user nova-compute[75378]:   <serial>9d25b237-38c7-48a7-ab25-9c9bad3a4680</serial>
Nov 09 04:16:23 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 04:16:23 user nova-compute[75378]: </disk>
Nov 09 04:16:23 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 04:16:23 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 42e015a5-b160-4b15-829b-3cab96075d6f {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 04:16:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:16:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:16:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:16:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:16:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:16:43 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 42e015a5-b160-4b15-829b-3cab96075d6f is timed out.
Nov 09 04:16:43 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Successfully detached device vdb from instance 42e015a5-b160-4b15-829b-3cab96075d6f from the live domain config.
Nov 09 04:16:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qAPjfJrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:16:43 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:16:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5066757f-8aa1-4d4a-a579-b08d4f5147cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 04:16:43 user nova-compute[75378]: No targets found.
Nov 09 04:16:43 user nova-compute[75378]: iSNS:
Nov 09 04:16:43 user nova-compute[75378]: No targets found.
Nov 09 04:16:43 user nova-compute[75378]: STATIC:
Nov 09 04:16:43 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e
Nov 09 04:16:43 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:16:43 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:16:43 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680
Nov 09 04:16:43 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:16:43 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:16:43 user nova-compute[75378]: FIRMWARE:
Nov 09 04:16:43 user nova-compute[75378]: No targets found.
Nov 09 04:16:43 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 04:16:43 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 04:16:43 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa380e1-0786-455b-a022-9ee60263196f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca838ac7-e02b-48e7-a533-2d5e13e0b781]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)
Nov 09 04:16:43 user nova-compute[75378]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 (non-flash)
Nov 09 04:16:43 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)
Nov 09 04:16:43 user nova-compute[75378]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 (non-flash)
Nov 09 04:16:43 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c449bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680'): ({'sdb'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Removing single pathed devices sdb {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ce66fe-b3d6-442c-91e6-75076d886a64]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:43 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a8da0e-eebf-4f2c-bb53-9f730062c611]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Flushing IO for device /dev/sdb {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c37fdde-070a-4679-a08d-73e0f2ed8639]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3822c5d-0544-498e-974e-fc76f789f1f4]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0937a19f-1806-4278-8c9f-3baa2660d679]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b8c88d-3151-42d3-b71f-72109ec353da]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680, portal: 172.16.0.220,3260]
Nov 09 04:16:44 user nova-compute[75378]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680, portal: 172.16.0.220,3260] successful.
Nov 09 04:16:44 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d25b237-38c7-48a7-ab25-9c9bad3a4680 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b69ee5-8d1a-4a98-948a-90d4d3b74d17]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] <== disconnect_volume: return (312ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:16:44 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 04:16:45 user nova-compute[75378]: DEBUG nova.objects.instance [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lazy-loading 'flavor' on Instance uuid 42e015a5-b160-4b15-829b-3cab96075d6f {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:16:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-3bf4f99e-e31b-4f93-a4ab-fe2db5752bb0 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "42e015a5-b160-4b15-829b-3cab96075d6f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.838s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:16:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:16:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:16:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:16:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:16:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-ced399c6-2b02-431c-97fb-b9f67f888339 req-1b3c0efa-3e77-44e9-a725-0d2cb8279d11 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Received event network-changed-460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:16:50 user nova-compute[75378]: DEBUG nova.compute.manager [req-ced399c6-2b02-431c-97fb-b9f67f888339 req-1b3c0efa-3e77-44e9-a725-0d2cb8279d11 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Refreshing instance network info cache due to event network-changed-460e9a5d-f97c-41cd-9b47-f89ba0adc605. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:16:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ced399c6-2b02-431c-97fb-b9f67f888339 req-1b3c0efa-3e77-44e9-a725-0d2cb8279d11 service nova] Acquiring lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:16:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ced399c6-2b02-431c-97fb-b9f67f888339 req-1b3c0efa-3e77-44e9-a725-0d2cb8279d11 service nova] Acquired lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:16:50 user nova-compute[75378]: DEBUG nova.network.neutron [req-ced399c6-2b02-431c-97fb-b9f67f888339 req-1b3c0efa-3e77-44e9-a725-0d2cb8279d11 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Refreshing network info cache for port 460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:16:51 user nova-compute[75378]: DEBUG nova.network.neutron [req-ced399c6-2b02-431c-97fb-b9f67f888339 req-1b3c0efa-3e77-44e9-a725-0d2cb8279d11 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Updated VIF entry in instance network info cache for port 460e9a5d-f97c-41cd-9b47-f89ba0adc605. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:16:51 user nova-compute[75378]: DEBUG nova.network.neutron [req-ced399c6-2b02-431c-97fb-b9f67f888339 req-1b3c0efa-3e77-44e9-a725-0d2cb8279d11 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Updating instance_info_cache with network_info: [{"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:16:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ced399c6-2b02-431c-97fb-b9f67f888339 req-1b3c0efa-3e77-44e9-a725-0d2cb8279d11 service nova] Releasing lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:16:52 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:16:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:16:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Rebuilding the list of instances to heal {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 04:16:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-094fa4b5-9622-4971-99e1-e505da91612d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:16:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-094fa4b5-9622-4971-99e1-e505da91612d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:16:52 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 04:16:52 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lazy-loading 'info_cache' on Instance uuid 094fa4b5-9622-4971-99e1-e505da91612d {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:16:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:52 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Updating instance_info_cache with network_info: [{"id": "e44a956f-1034-4390-abc6-534499259134", "address": "fa:16:3e:3b:10:5b", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44a956f-10", "ovs_interfaceid": "e44a956f-1034-4390-abc6-534499259134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:16:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-094fa4b5-9622-4971-99e1-e505da91612d" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:16:52 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 04:16:54 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:16:55 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:16:55 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:16:57 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:16:57 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:16:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "9c3afa94-f203-4c45-a755-02446b204d12" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:16:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "9c3afa94-f203-4c45-a755-02446b204d12" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:16:57 user nova-compute[75378]: INFO nova.compute.manager [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Shelving
Nov 09 04:16:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:16:57 user nova-compute[75378]: DEBUG nova.compute.manager [req-c131e309-3f9a-488f-9813-2a7b416db38e req-f20cbab5-7667-42af-a122-daf16e3b8b6e service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Received event network-vif-unplugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:16:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c131e309-3f9a-488f-9813-2a7b416db38e req-f20cbab5-7667-42af-a122-daf16e3b8b6e service nova] Acquiring lock "9c3afa94-f203-4c45-a755-02446b204d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:16:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c131e309-3f9a-488f-9813-2a7b416db38e req-f20cbab5-7667-42af-a122-daf16e3b8b6e service nova] Lock "9c3afa94-f203-4c45-a755-02446b204d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:16:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c131e309-3f9a-488f-9813-2a7b416db38e req-f20cbab5-7667-42af-a122-daf16e3b8b6e service nova] Lock "9c3afa94-f203-4c45-a755-02446b204d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:16:57 user nova-compute[75378]: DEBUG nova.compute.manager [req-c131e309-3f9a-488f-9813-2a7b416db38e req-f20cbab5-7667-42af-a122-daf16e3b8b6e service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] No waiting events found dispatching network-vif-unplugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:16:57 user nova-compute[75378]: WARNING nova.compute.manager [req-c131e309-3f9a-488f-9813-2a7b416db38e req-f20cbab5-7667-42af-a122-daf16e3b8b6e service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Received unexpected event network-vif-unplugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 for instance with vm_state active and task_state shelving.
Nov 09 04:16:58 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:16:58 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:16:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:16:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:16:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:16:58 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:16:58 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Instance destroyed successfully.
Nov 09 04:16:58 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Beginning cold snapshot process
Nov 09 04:16:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:58 user nova-compute[75378]: DEBUG nova.privsep.utils [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75378) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 04:16:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk /opt/stack/data/nova/instances/snapshots/tmpue4muhs5/756f6698b084404e8c6440bda6adbb5f {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:58 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:16:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:16:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk /opt/stack/data/nova/instances/snapshots/tmpue4muhs5/756f6698b084404e8c6440bda6adbb5f" returned: 0 in 0.513s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:59 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Snapshot extracted, beginning image upload
Nov 09 04:16:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:16:59 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:16:59 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:16:59 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8747MB free_disk=25.164997100830078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:16:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:16:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:16:59 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 094fa4b5-9622-4971-99e1-e505da91612d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:16:59 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 42e015a5-b160-4b15-829b-3cab96075d6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:16:59 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9c3afa94-f203-4c45-a755-02446b204d12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:16:59 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:16:59 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:16:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-50d28690-fe67-4560-b2f9-5d446f60f9c5 req-088d1e18-d027-4add-a316-f9f4af4c0928 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Received event network-vif-plugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:16:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-50d28690-fe67-4560-b2f9-5d446f60f9c5 req-088d1e18-d027-4add-a316-f9f4af4c0928 service nova] Acquiring lock "9c3afa94-f203-4c45-a755-02446b204d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:16:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-50d28690-fe67-4560-b2f9-5d446f60f9c5 req-088d1e18-d027-4add-a316-f9f4af4c0928 service nova] Lock "9c3afa94-f203-4c45-a755-02446b204d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:16:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-50d28690-fe67-4560-b2f9-5d446f60f9c5 req-088d1e18-d027-4add-a316-f9f4af4c0928 service nova] Lock "9c3afa94-f203-4c45-a755-02446b204d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:16:59 user nova-compute[75378]: DEBUG nova.compute.manager [req-50d28690-fe67-4560-b2f9-5d446f60f9c5 req-088d1e18-d027-4add-a316-f9f4af4c0928 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] No waiting events found dispatching network-vif-plugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:16:59 user nova-compute[75378]: WARNING nova.compute.manager [req-50d28690-fe67-4560-b2f9-5d446f60f9c5 req-088d1e18-d027-4add-a316-f9f4af4c0928 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Received unexpected event network-vif-plugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 for instance with vm_state active and task_state shelving_image_uploading.
Nov 09 04:16:59 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:16:59 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:16:59 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:16:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:17:01 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Snapshot image upload complete
Nov 09 04:17:01 user nova-compute[75378]: DEBUG nova.compute.manager [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:17:02 user nova-compute[75378]: INFO nova.compute.manager [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Shelve offloading
Nov 09 04:17:02 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Instance destroyed successfully.
Nov 09 04:17:02 user nova-compute[75378]: DEBUG nova.compute.manager [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:17:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:17:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquired lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:17:02 user nova-compute[75378]: DEBUG nova.network.neutron [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:17:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:02 user nova-compute[75378]: DEBUG nova.network.neutron [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Updating instance_info_cache with network_info: [{"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:17:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Releasing lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:17:02 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Instance destroyed successfully.
Nov 09 04:17:02 user nova-compute[75378]: DEBUG nova.objects.instance [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lazy-loading 'resources' on Instance uuid 9c3afa94-f203-4c45-a755-02446b204d12 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:17:02 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:14:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1522830695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1522830695',id=48,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAmgkujsPpH7HS3IfPd/IJr2Mwu+TD3ob2qBckpyvhkAbUU6mRoar3gGTBn3TPuRspVvUQ+rdPDSBl9uy14S7ZgIiIOi9OtsnMceYEsI4if1aziXJzhOl3Kw1wSzP97bA==',key_name='tempest-keypair-1381306586',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:15:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3c5788a86f2c4fcab582d65b471fe27e',ramdisk_id='',reservation_id='r-j3uvi7ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1244090539',owner_user_name='tempest-AttachVolumeShelveTestJSON-1244090539-project-member',shelved_at='2023-11-09T04:17:01.971584',shelved_host='user',shelved_image_id='07a2cc1c-0e83-4795-b425-e429bfd4c740'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T04:16:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f996e26d3a04dd8ba5a64eaa218a9b3',uuid=9c3afa94-f203-4c45-a755-02446b204d12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:17:02 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converting VIF {"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:17:02 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:9e:dd,bridge_name='br-int',has_traffic_filtering=True,id=460e9a5d-f97c-41cd-9b47-f89ba0adc605,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460e9a5d-f9') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:17:02 user nova-compute[75378]: DEBUG os_vif [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:9e:dd,bridge_name='br-int',has_traffic_filtering=True,id=460e9a5d-f97c-41cd-9b47-f89ba0adc605,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460e9a5d-f9') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:17:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap460e9a5d-f9, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:17:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-e3970cb8-426c-4426-853e-91789d83fdb6 req-2d2b9e19-a135-45a1-8dd5-2a9463767a33 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Received event network-changed-460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:17:03 user nova-compute[75378]: DEBUG nova.compute.manager [req-e3970cb8-426c-4426-853e-91789d83fdb6 req-2d2b9e19-a135-45a1-8dd5-2a9463767a33 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Refreshing instance network info cache due to event network-changed-460e9a5d-f97c-41cd-9b47-f89ba0adc605. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:17:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e3970cb8-426c-4426-853e-91789d83fdb6 req-2d2b9e19-a135-45a1-8dd5-2a9463767a33 service nova] Acquiring lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:17:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e3970cb8-426c-4426-853e-91789d83fdb6 req-2d2b9e19-a135-45a1-8dd5-2a9463767a33 service nova] Acquired lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:17:03 user nova-compute[75378]: DEBUG nova.network.neutron [req-e3970cb8-426c-4426-853e-91789d83fdb6 req-2d2b9e19-a135-45a1-8dd5-2a9463767a33 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Refreshing network info cache for port 460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:17:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:17:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc1db159-a287-4b38-8fb9-ac44dec1ba7d) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:17:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:17:03 user nova-compute[75378]: INFO os_vif [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:9e:dd,bridge_name='br-int',has_traffic_filtering=True,id=460e9a5d-f97c-41cd-9b47-f89ba0adc605,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460e9a5d-f9')
Nov 09 04:17:03 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Deleting instance files /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12_del
Nov 09 04:17:03 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Deletion of /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12_del complete
Nov 09 04:17:03 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Deleted allocations for instance 9c3afa94-f203-4c45-a755-02446b204d12
Nov 09 04:17:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:17:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:17:03 user nova-compute[75378]: DEBUG nova.objects.instance [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lazy-loading 'numa_topology' on Instance uuid 9c3afa94-f203-4c45-a755-02446b204d12 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:17:03 user nova-compute[75378]: DEBUG nova.objects.base [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Object Instance<9c3afa94-f203-4c45-a755-02446b204d12> lazy-loaded attributes: resources,numa_topology {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 04:17:03 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:17:03 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:17:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:17:03 user nova-compute[75378]: DEBUG nova.network.neutron [req-e3970cb8-426c-4426-853e-91789d83fdb6 req-2d2b9e19-a135-45a1-8dd5-2a9463767a33 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Updated VIF entry in instance network info cache for port 460e9a5d-f97c-41cd-9b47-f89ba0adc605. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:17:03 user nova-compute[75378]: DEBUG nova.network.neutron [req-e3970cb8-426c-4426-853e-91789d83fdb6 req-2d2b9e19-a135-45a1-8dd5-2a9463767a33 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Updating instance_info_cache with network_info: [{"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:17:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-e3970cb8-426c-4426-853e-91789d83fdb6 req-2d2b9e19-a135-45a1-8dd5-2a9463767a33 service nova] Releasing lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:17:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-59b36cd3-74f8-4372-8ce4-103b62f4bf49 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "9c3afa94-f203-4c45-a755-02446b204d12" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.902s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:17:04 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:17:06 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:17:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "094fa4b5-9622-4971-99e1-e505da91612d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:17:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "094fa4b5-9622-4971-99e1-e505da91612d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:17:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "094fa4b5-9622-4971-99e1-e505da91612d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:17:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "094fa4b5-9622-4971-99e1-e505da91612d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:17:07 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "094fa4b5-9622-4971-99e1-e505da91612d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:17:07 user nova-compute[75378]: INFO nova.compute.manager [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Terminating instance
Nov 09 04:17:07 user nova-compute[75378]: DEBUG nova.compute.manager [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:17:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG nova.compute.manager [req-26dd8898-d5af-4b0a-9c96-e16c41aa3df5 req-d76371ac-25dc-4862-a732-a1029918fb37 service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Received event network-vif-unplugged-e44a956f-1034-4390-abc6-534499259134 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-26dd8898-d5af-4b0a-9c96-e16c41aa3df5 req-d76371ac-25dc-4862-a732-a1029918fb37 service nova] Acquiring lock "094fa4b5-9622-4971-99e1-e505da91612d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-26dd8898-d5af-4b0a-9c96-e16c41aa3df5 req-d76371ac-25dc-4862-a732-a1029918fb37 service nova] Lock "094fa4b5-9622-4971-99e1-e505da91612d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-26dd8898-d5af-4b0a-9c96-e16c41aa3df5 req-d76371ac-25dc-4862-a732-a1029918fb37 service nova] Lock "094fa4b5-9622-4971-99e1-e505da91612d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG nova.compute.manager [req-26dd8898-d5af-4b0a-9c96-e16c41aa3df5 req-d76371ac-25dc-4862-a732-a1029918fb37 service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] No waiting events found dispatching network-vif-unplugged-e44a956f-1034-4390-abc6-534499259134 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG nova.compute.manager [req-26dd8898-d5af-4b0a-9c96-e16c41aa3df5 req-d76371ac-25dc-4862-a732-a1029918fb37 service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Received event network-vif-unplugged-e44a956f-1034-4390-abc6-534499259134 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:08 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Instance destroyed successfully.
Nov 09 04:17:08 user nova-compute[75378]: DEBUG nova.objects.instance [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lazy-loading 'resources' on Instance uuid 094fa4b5-9622-4971-99e1-e505da91612d {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:12:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-687411826',display_name='tempest-TestVolumeBootPattern-volume-backed-server-687411826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-687411826',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz++QGmz4c35ArnzRRLJGoYgaQNUqL5bnNCPxYEZuVxbqdkm7Bu3ybnWcuW3bXUNOh5bfJ60/9UhkdIQK4h2dQ9c+vr+M7YxEy1Yayd5Zqf9UqqOw1YKGKLU96jjVA+aA==',key_name='tempest-keypair-2083989440',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:12:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed5a4bfe6ce546d2acfbf7be75334d1a',ramdisk_id='',reservation_id='r-gamxy5y4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1436829014',owner_user_name='tempest-TestVolumeBootPattern-1436829014-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T04:12:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23b841529aaf42c29a442ef9524422b2',uuid=094fa4b5-9622-4971-99e1-e505da91612d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e44a956f-1034-4390-abc6-534499259134", "address": "fa:16:3e:3b:10:5b", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44a956f-10", "ovs_interfaceid": "e44a956f-1034-4390-abc6-534499259134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converting VIF {"id": "e44a956f-1034-4390-abc6-534499259134", "address": "fa:16:3e:3b:10:5b", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape44a956f-10", "ovs_interfaceid": "e44a956f-1034-4390-abc6-534499259134", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:10:5b,bridge_name='br-int',has_traffic_filtering=True,id=e44a956f-1034-4390-abc6-534499259134,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44a956f-10') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_vif [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:10:5b,bridge_name='br-int',has_traffic_filtering=True,id=e44a956f-1034-4390-abc6-534499259134,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44a956f-10') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape44a956f-10, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34012af3-198c-406f-a5ca-69c9b5c6c881) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:17:08 user nova-compute[75378]: INFO os_vif [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:10:5b,bridge_name='br-int',has_traffic_filtering=True,id=e44a956f-1034-4390-abc6-534499259134,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape44a956f-10')
Nov 09 04:17:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdiyUEma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:17:08 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d77bea-2556-4911-9065-e0dde97bd387]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 04:17:08 user nova-compute[75378]: No targets found.
Nov 09 04:17:08 user nova-compute[75378]: iSNS:
Nov 09 04:17:08 user nova-compute[75378]: No targets found.
Nov 09 04:17:08 user nova-compute[75378]: STATIC:
Nov 09 04:17:08 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e
Nov 09 04:17:08 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:17:08 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:17:08 user nova-compute[75378]: FIRMWARE:
Nov 09 04:17:08 user nova-compute[75378]: No targets found.
Nov 09 04:17:08 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 04:17:08 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 04:17:08 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb5d609-bd47-4293-9ee6-8917f70d8f78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[041f0f08-b446-49d3-9bbd-f2c26d1387bb]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)
Nov 09 04:17:08 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e (non-flash)
Nov 09 04:17:08 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c7665f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e'): ({'sdc'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Removing single pathed devices sdc {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[595db4ea-14d2-45d1-ac8d-9f8233da5013]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f9cd18-c2f4-4f33-8238-7e18f03b84dd]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Flushing IO for device /dev/sdc {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[283ff646-9d58-47af-9b3c-32d052505ee2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac196acd-1a5a-496f-ae35-ac27eff3e137]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] SCSI volumes sdc have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO9c84fe62-8740a9ab53e9cb2f', '/dev/disk/by-id/scsi-23837343061396162', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9c84fe62') {{(pid=87049) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[622b9b44-0db4-44a9-8ec8-1d082bd46590]: (4, None) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d2b9fc-71ba-40e8-b098-85553e23a1d7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0d8dce-8319-4b70-9464-3875587f8cb4]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e, portal: 172.16.0.220,3260]
Nov 09 04:17:08 user nova-compute[75378]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e, portal: 172.16.0.220,3260] successful.
Nov 09 04:17:08 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1541c7f1-31d0-4192-80f0-8d1201ad330e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0032378b-1bab-450a-a204-694f36dc5829]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] <== disconnect_volume: return (296ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:17:08 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 04:17:08 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Deleting instance files /opt/stack/data/nova/instances/094fa4b5-9622-4971-99e1-e505da91612d_del
Nov 09 04:17:08 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Deletion of /opt/stack/data/nova/instances/094fa4b5-9622-4971-99e1-e505da91612d_del complete
Nov 09 04:17:09 user nova-compute[75378]: INFO nova.compute.manager [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 09 04:17:09 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:17:09 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:17:09 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:17:09 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:17:09 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Took 0.89 seconds to deallocate network for instance.
Nov 09 04:17:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-ac8172ec-6c3a-4c47-9d34-ed4c18ee5182 req-fdd7e7bf-ba07-44b6-b8da-c5cc8c3814fb service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Received event network-vif-plugged-e44a956f-1034-4390-abc6-534499259134 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:17:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ac8172ec-6c3a-4c47-9d34-ed4c18ee5182 req-fdd7e7bf-ba07-44b6-b8da-c5cc8c3814fb service nova] Acquiring lock "094fa4b5-9622-4971-99e1-e505da91612d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:17:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ac8172ec-6c3a-4c47-9d34-ed4c18ee5182 req-fdd7e7bf-ba07-44b6-b8da-c5cc8c3814fb service nova] Lock "094fa4b5-9622-4971-99e1-e505da91612d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:17:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ac8172ec-6c3a-4c47-9d34-ed4c18ee5182 req-fdd7e7bf-ba07-44b6-b8da-c5cc8c3814fb service nova] Lock "094fa4b5-9622-4971-99e1-e505da91612d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:17:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-ac8172ec-6c3a-4c47-9d34-ed4c18ee5182 req-fdd7e7bf-ba07-44b6-b8da-c5cc8c3814fb service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] No waiting events found dispatching network-vif-plugged-e44a956f-1034-4390-abc6-534499259134 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:17:10 user nova-compute[75378]: WARNING nova.compute.manager [req-ac8172ec-6c3a-4c47-9d34-ed4c18ee5182 req-fdd7e7bf-ba07-44b6-b8da-c5cc8c3814fb service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Received unexpected event network-vif-plugged-e44a956f-1034-4390-abc6-534499259134 for instance with vm_state active and task_state deleting.
Nov 09 04:17:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-ac8172ec-6c3a-4c47-9d34-ed4c18ee5182 req-fdd7e7bf-ba07-44b6-b8da-c5cc8c3814fb service nova] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Received event network-vif-deleted-e44a956f-1034-4390-abc6-534499259134 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:17:11 user nova-compute[75378]: INFO nova.compute.manager [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Took 1.21 seconds to detach 1 volumes for instance.
Nov 09 04:17:11 user nova-compute[75378]: DEBUG nova.compute.manager [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 094fa4b5-9622-4971-99e1-e505da91612d] Deleting volume: 1541c7f1-31d0-4192-80f0-8d1201ad330e {{(pid=75378) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 09 04:17:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:17:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:17:11 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:17:11 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:17:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:17:11 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Deleted allocations for instance 094fa4b5-9622-4971-99e1-e505da91612d
Nov 09 04:17:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-a90b5ef5-3180-42a8-ba52-137ef5d41a06 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "094fa4b5-9622-4971-99e1-e505da91612d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.615s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:17:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:17:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:17:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:17:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:17:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:17:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:26 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:17:27 user nova-compute[75378]: DEBUG nova.compute.manager [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:17:27 user nova-compute[75378]: INFO nova.compute.manager [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] instance snapshotting
Nov 09 04:17:27 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Beginning live snapshot process
Nov 09 04:17:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json -f qcow2 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json -f qcow2 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.173s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7laft481/360270466c564e85a0df3e48906609e6.delta 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7laft481/360270466c564e85a0df3e48906609e6.delta 1073741824" returned: 0 in 0.049s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:27 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 09 04:17:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75378) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 04:17:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:17:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] COPY block job progress, current cursor: 74973184 final cursor: 75563008 {{(pid=75378) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 04:17:29 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75378) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 04:17:29 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 09 04:17:29 user nova-compute[75378]: DEBUG nova.privsep.utils [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75378) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 04:17:29 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7laft481/360270466c564e85a0df3e48906609e6.delta /opt/stack/data/nova/instances/snapshots/tmp7laft481/360270466c564e85a0df3e48906609e6 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:30 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7laft481/360270466c564e85a0df3e48906609e6.delta /opt/stack/data/nova/instances/snapshots/tmp7laft481/360270466c564e85a0df3e48906609e6" returned: 0 in 0.563s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:30 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Snapshot extracted, beginning image upload
Nov 09 04:17:32 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Snapshot image upload complete
Nov 09 04:17:32 user nova-compute[75378]: INFO nova.compute.manager [None req-3ea44fe2-bb59-4356-9512-955b2a47f0aa tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Took 5.90 seconds to snapshot the instance on the hypervisor.
Nov 09 04:17:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:17:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:17:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:17:35 user nova-compute[75378]: DEBUG nova.compute.manager [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 04:17:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:17:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:17:35 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 04:17:35 user nova-compute[75378]: INFO nova.compute.claims [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Claim successful on node user
Nov 09 04:17:35 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:17:35 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:17:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:17:35 user nova-compute[75378]: DEBUG nova.compute.manager [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 04:17:35 user nova-compute[75378]: DEBUG nova.compute.manager [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 04:17:35 user nova-compute[75378]: DEBUG nova.network.neutron [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 04:17:35 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 04:17:35 user nova-compute[75378]: DEBUG nova.compute.manager [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 04:17:35 user nova-compute[75378]: DEBUG nova.policy [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81d9391c05f24db4874155808fac2b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987017c936a547f09de17b5a724d6694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 04:17:35 user nova-compute[75378]: DEBUG nova.compute.manager [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 04:17:35 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 04:17:35 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Creating image(s)
Nov 09 04:17:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "/opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:17:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "/opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:17:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "/opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:17:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "aedeb2fa524b32ebd8f34c7a44cded05d1deadf4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:17:35 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "aedeb2fa524b32ebd8f34c7a44cded05d1deadf4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:17:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aedeb2fa524b32ebd8f34c7a44cded05d1deadf4.part --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:36 user nova-compute[75378]: DEBUG nova.network.neutron [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Successfully created port: 6d717eba-e166-4f12-a8d0-76a407144f95 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 04:17:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aedeb2fa524b32ebd8f34c7a44cded05d1deadf4.part --force-share --output=json" returned: 0 in 0.217s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:36 user nova-compute[75378]: DEBUG nova.virt.images [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] 4cc38938-62b8-4ea8-8035-1863d32dbf08 was qcow2, converting to raw {{(pid=75378) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 04:17:36 user nova-compute[75378]: DEBUG nova.privsep.utils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75378) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 04:17:36 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aedeb2fa524b32ebd8f34c7a44cded05d1deadf4.part /opt/stack/data/nova/instances/_base/aedeb2fa524b32ebd8f34c7a44cded05d1deadf4.converted {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aedeb2fa524b32ebd8f34c7a44cded05d1deadf4.part /opt/stack/data/nova/instances/_base/aedeb2fa524b32ebd8f34c7a44cded05d1deadf4.converted" returned: 0 in 0.448s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aedeb2fa524b32ebd8f34c7a44cded05d1deadf4.converted --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG nova.network.neutron [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Successfully updated port: 6d717eba-e166-4f12-a8d0-76a407144f95 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "refresh_cache-1814a4d1-29cc-43d6-b1f0-2d4c2098d411" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquired lock "refresh_cache-1814a4d1-29cc-43d6-b1f0-2d4c2098d411" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG nova.network.neutron [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG nova.compute.manager [req-89cb0a1d-21f3-49d4-b30e-ed1db1c41e96 req-53bcfd58-9a83-4dbd-82ec-63284ac23a94 service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Received event network-changed-6d717eba-e166-4f12-a8d0-76a407144f95 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG nova.compute.manager [req-89cb0a1d-21f3-49d4-b30e-ed1db1c41e96 req-53bcfd58-9a83-4dbd-82ec-63284ac23a94 service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Refreshing instance network info cache due to event network-changed-6d717eba-e166-4f12-a8d0-76a407144f95. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-89cb0a1d-21f3-49d4-b30e-ed1db1c41e96 req-53bcfd58-9a83-4dbd-82ec-63284ac23a94 service nova] Acquiring lock "refresh_cache-1814a4d1-29cc-43d6-b1f0-2d4c2098d411" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG nova.network.neutron [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aedeb2fa524b32ebd8f34c7a44cded05d1deadf4.converted --force-share --output=json" returned: 0 in 0.220s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "aedeb2fa524b32ebd8f34c7a44cded05d1deadf4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.823s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aedeb2fa524b32ebd8f34c7a44cded05d1deadf4 --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG nova.network.neutron [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Updating instance_info_cache with network_info: [{"id": "6d717eba-e166-4f12-a8d0-76a407144f95", "address": "fa:16:3e:2e:86:00", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d717eba-e1", "ovs_interfaceid": "6d717eba-e166-4f12-a8d0-76a407144f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aedeb2fa524b32ebd8f34c7a44cded05d1deadf4 --force-share --output=json" returned: 0 in 0.176s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "aedeb2fa524b32ebd8f34c7a44cded05d1deadf4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "aedeb2fa524b32ebd8f34c7a44cded05d1deadf4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aedeb2fa524b32ebd8f34c7a44cded05d1deadf4 --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Releasing lock "refresh_cache-1814a4d1-29cc-43d6-b1f0-2d4c2098d411" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG nova.compute.manager [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Instance network_info: |[{"id": "6d717eba-e166-4f12-a8d0-76a407144f95", "address": "fa:16:3e:2e:86:00", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d717eba-e1", "ovs_interfaceid": "6d717eba-e166-4f12-a8d0-76a407144f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-89cb0a1d-21f3-49d4-b30e-ed1db1c41e96 req-53bcfd58-9a83-4dbd-82ec-63284ac23a94 service nova] Acquired lock "refresh_cache-1814a4d1-29cc-43d6-b1f0-2d4c2098d411" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG nova.network.neutron [req-89cb0a1d-21f3-49d4-b30e-ed1db1c41e96 req-53bcfd58-9a83-4dbd-82ec-63284ac23a94 service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Refreshing network info cache for port 6d717eba-e166-4f12-a8d0-76a407144f95 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aedeb2fa524b32ebd8f34c7a44cded05d1deadf4 --force-share --output=json" returned: 0 in 0.175s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aedeb2fa524b32ebd8f34c7a44cded05d1deadf4,backing_fmt=raw /opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aedeb2fa524b32ebd8f34c7a44cded05d1deadf4,backing_fmt=raw /opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411/disk 1073741824" returned: 0 in 0.057s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "aedeb2fa524b32ebd8f34c7a44cded05d1deadf4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:17:37 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aedeb2fa524b32ebd8f34c7a44cded05d1deadf4 --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aedeb2fa524b32ebd8f34c7a44cded05d1deadf4 --force-share --output=json" returned: 0 in 0.213s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Ensure instance console log exists: /opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Start _get_guest_xml network_info=[{"id": "6d717eba-e166-4f12-a8d0-76a407144f95", "address": "fa:16:3e:2e:86:00", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d717eba-e1", "ovs_interfaceid": "6d717eba-e166-4f12-a8d0-76a407144f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='7153165ea60a5c894e5ced361bb83e0f',container_format='bare',created_at=2023-11-09T04:17:27Z,direct_url=<?>,disk_format='qcow2',id=4cc38938-62b8-4ea8-8035-1863d32dbf08,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-670257459',owner='987017c936a547f09de17b5a724d6694',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-09T04:17:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '4cc38938-62b8-4ea8-8035-1863d32dbf08'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 04:17:38 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:17:38 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7153165ea60a5c894e5ced361bb83e0f',container_format='bare',created_at=2023-11-09T04:17:27Z,direct_url=<?>,disk_format='qcow2',id=4cc38938-62b8-4ea8-8035-1863d32dbf08,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-670257459',owner='987017c936a547f09de17b5a724d6694',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-09T04:17:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:17:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1246017334',display_name='tempest-TestStampPattern-server-1246017334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1246017334',id=49,image_ref='4cc38938-62b8-4ea8-8035-1863d32dbf08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdSgjDyj3H0LIu1u2r//kjG1Z/kJV/2D9kHnyqGf+23Yh1IXJheit8b0DpysYeACB7JwG5OcFZYK6MPjM1Qc7O4TA+G/vX1U0avmELYZy8D9iV/yA0LiISJ8RtiQ14fQg==',key_name='tempest-TestStampPattern-1317567266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='987017c936a547f09de17b5a724d6694',ramdisk_id='',reservation_id='r-hhs4co85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='42e015a5-b160-4b15-829b-3cab96075d6f',image_min_disk='1',image_min_ram='0',image_owner_id='987017c936a547f09de17b5a724d6694',image_owner_project_name='tempest-TestStampPattern-1195876613',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1195876613-project-member',image_user_id='81d9391c05f24db4874155808fac2b67',network_allocated='True',owner_project_name='tempest-TestStampPattern-1195876613',owner_user_name='tempest-TestStampPattern-1195876613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:17:36Z,user_data=None,user_id='81d9391c05f24db4874155808fac2b67',uuid=1814a4d1-29cc-43d6-b1f0-2d4c2098d411,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d717eba-e166-4f12-a8d0-76a407144f95", "address": "fa:16:3e:2e:86:00", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d717eba-e1", "ovs_interfaceid": "6d717eba-e166-4f12-a8d0-76a407144f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Converting VIF {"id": "6d717eba-e166-4f12-a8d0-76a407144f95", "address": "fa:16:3e:2e:86:00", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d717eba-e1", "ovs_interfaceid": "6d717eba-e166-4f12-a8d0-76a407144f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:86:00,bridge_name='br-int',has_traffic_filtering=True,id=6d717eba-e166-4f12-a8d0-76a407144f95,network=Network(10df6958-101d-4086-b128-51b210209887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d717eba-e1') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.objects.instance [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lazy-loading 'pci_devices' on Instance uuid 1814a4d1-29cc-43d6-b1f0-2d4c2098d411 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] End _get_guest_xml xml=<domain type="kvm">
Nov 09 04:17:38 user nova-compute[75378]:   <uuid>1814a4d1-29cc-43d6-b1f0-2d4c2098d411</uuid>
Nov 09 04:17:38 user nova-compute[75378]:   <name>instance-00000031</name>
Nov 09 04:17:38 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 04:17:38 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 04:17:38 user nova-compute[75378]:   <metadata>
Nov 09 04:17:38 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 04:17:38 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 04:17:38 user nova-compute[75378]:       <nova:name>tempest-TestStampPattern-server-1246017334</nova:name>
Nov 09 04:17:38 user nova-compute[75378]:       <nova:creationTime>2023-11-09 04:17:38</nova:creationTime>
Nov 09 04:17:38 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 04:17:38 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 04:17:38 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 04:17:38 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 04:17:38 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 04:17:38 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 04:17:38 user nova-compute[75378]:       </nova:flavor>
Nov 09 04:17:38 user nova-compute[75378]:       <nova:owner>
Nov 09 04:17:38 user nova-compute[75378]:         <nova:user uuid="81d9391c05f24db4874155808fac2b67">tempest-TestStampPattern-1195876613-project-member</nova:user>
Nov 09 04:17:38 user nova-compute[75378]:         <nova:project uuid="987017c936a547f09de17b5a724d6694">tempest-TestStampPattern-1195876613</nova:project>
Nov 09 04:17:38 user nova-compute[75378]:       </nova:owner>
Nov 09 04:17:38 user nova-compute[75378]:       <nova:root type="image" uuid="4cc38938-62b8-4ea8-8035-1863d32dbf08"/>
Nov 09 04:17:38 user nova-compute[75378]:       <nova:ports>
Nov 09 04:17:38 user nova-compute[75378]:         <nova:port uuid="6d717eba-e166-4f12-a8d0-76a407144f95">
Nov 09 04:17:38 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 09 04:17:38 user nova-compute[75378]:         </nova:port>
Nov 09 04:17:38 user nova-compute[75378]:       </nova:ports>
Nov 09 04:17:38 user nova-compute[75378]:     </nova:instance>
Nov 09 04:17:38 user nova-compute[75378]:   </metadata>
Nov 09 04:17:38 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 04:17:38 user nova-compute[75378]:     <system>
Nov 09 04:17:38 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 04:17:38 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 04:17:38 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 04:17:38 user nova-compute[75378]:       <entry name="serial">1814a4d1-29cc-43d6-b1f0-2d4c2098d411</entry>
Nov 09 04:17:38 user nova-compute[75378]:       <entry name="uuid">1814a4d1-29cc-43d6-b1f0-2d4c2098d411</entry>
Nov 09 04:17:38 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 04:17:38 user nova-compute[75378]:     </system>
Nov 09 04:17:38 user nova-compute[75378]:   </sysinfo>
Nov 09 04:17:38 user nova-compute[75378]:   <os>
Nov 09 04:17:38 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 04:17:38 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 04:17:38 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 04:17:38 user nova-compute[75378]:   </os>
Nov 09 04:17:38 user nova-compute[75378]:   <features>
Nov 09 04:17:38 user nova-compute[75378]:     <acpi/>
Nov 09 04:17:38 user nova-compute[75378]:     <apic/>
Nov 09 04:17:38 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 04:17:38 user nova-compute[75378]:   </features>
Nov 09 04:17:38 user nova-compute[75378]:   <clock offset="utc">
Nov 09 04:17:38 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 04:17:38 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 04:17:38 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 04:17:38 user nova-compute[75378]:   </clock>
Nov 09 04:17:38 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 04:17:38 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 04:17:38 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 04:17:38 user nova-compute[75378]:   </cpu>
Nov 09 04:17:38 user nova-compute[75378]:   <devices>
Nov 09 04:17:38 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 04:17:38 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 04:17:38 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411/disk"/>
Nov 09 04:17:38 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 04:17:38 user nova-compute[75378]:     </disk>
Nov 09 04:17:38 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 04:17:38 user nova-compute[75378]:       <mac address="fa:16:3e:2e:86:00"/>
Nov 09 04:17:38 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:17:38 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 04:17:38 user nova-compute[75378]:       <target dev="tap6d717eba-e1"/>
Nov 09 04:17:38 user nova-compute[75378]:     </interface>
Nov 09 04:17:38 user nova-compute[75378]:     <serial type="pty">
Nov 09 04:17:38 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411/console.log" append="off"/>
Nov 09 04:17:38 user nova-compute[75378]:     </serial>
Nov 09 04:17:38 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 04:17:38 user nova-compute[75378]:     <video>
Nov 09 04:17:38 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:17:38 user nova-compute[75378]:     </video>
Nov 09 04:17:38 user nova-compute[75378]:     <rng model="virtio">
Nov 09 04:17:38 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 04:17:38 user nova-compute[75378]:     </rng>
Nov 09 04:17:38 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 04:17:38 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 04:17:38 user nova-compute[75378]:       <stats period="10"/>
Nov 09 04:17:38 user nova-compute[75378]:     </memballoon>
Nov 09 04:17:38 user nova-compute[75378]:   </devices>
Nov 09 04:17:38 user nova-compute[75378]: </domain>
Nov 09 04:17:38 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:17:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1246017334',display_name='tempest-TestStampPattern-server-1246017334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1246017334',id=49,image_ref='4cc38938-62b8-4ea8-8035-1863d32dbf08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdSgjDyj3H0LIu1u2r//kjG1Z/kJV/2D9kHnyqGf+23Yh1IXJheit8b0DpysYeACB7JwG5OcFZYK6MPjM1Qc7O4TA+G/vX1U0avmELYZy8D9iV/yA0LiISJ8RtiQ14fQg==',key_name='tempest-TestStampPattern-1317567266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='987017c936a547f09de17b5a724d6694',ramdisk_id='',reservation_id='r-hhs4co85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='42e015a5-b160-4b15-829b-3cab96075d6f',image_min_disk='1',image_min_ram='0',image_owner_id='987017c936a547f09de17b5a724d6694',image_owner_project_name='tempest-TestStampPattern-1195876613',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1195876613-project-member',image_user_id='81d9391c05f24db4874155808fac2b67',network_allocated='True',owner_project_name='tempest-TestStampPattern-1195876613',owner_user_name='tempest-TestStampPattern-1195876613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:17:36Z,user_data=None,user_id='81d9391c05f24db4874155808fac2b67',uuid=1814a4d1-29cc-43d6-b1f0-2d4c2098d411,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d717eba-e166-4f12-a8d0-76a407144f95", "address": "fa:16:3e:2e:86:00", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d717eba-e1", "ovs_interfaceid": "6d717eba-e166-4f12-a8d0-76a407144f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Converting VIF {"id": "6d717eba-e166-4f12-a8d0-76a407144f95", "address": "fa:16:3e:2e:86:00", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d717eba-e1", "ovs_interfaceid": "6d717eba-e166-4f12-a8d0-76a407144f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:86:00,bridge_name='br-int',has_traffic_filtering=True,id=6d717eba-e166-4f12-a8d0-76a407144f95,network=Network(10df6958-101d-4086-b128-51b210209887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d717eba-e1') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG os_vif [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:86:00,bridge_name='br-int',has_traffic_filtering=True,id=6d717eba-e166-4f12-a8d0-76a407144f95,network=Network(10df6958-101d-4086-b128-51b210209887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d717eba-e1') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63b7ca5d-f183-52a4-9cf3-3b64e893bd0b', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d717eba-e1, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d717eba-e1, col_values=(('qos', UUID('5ff685e0-5dba-497e-bc74-775727287005')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d717eba-e1, col_values=(('external_ids', {'iface-id': '6d717eba-e166-4f12-a8d0-76a407144f95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:86:00', 'vm-uuid': '1814a4d1-29cc-43d6-b1f0-2d4c2098d411'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:38 user nova-compute[75378]: INFO os_vif [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:86:00,bridge_name='br-int',has_traffic_filtering=True,id=6d717eba-e166-4f12-a8d0-76a407144f95,network=Network(10df6958-101d-4086-b128-51b210209887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d717eba-e1')
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.network.neutron [req-89cb0a1d-21f3-49d4-b30e-ed1db1c41e96 req-53bcfd58-9a83-4dbd-82ec-63284ac23a94 service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Updated VIF entry in instance network info cache for port 6d717eba-e166-4f12-a8d0-76a407144f95. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.network.neutron [req-89cb0a1d-21f3-49d4-b30e-ed1db1c41e96 req-53bcfd58-9a83-4dbd-82ec-63284ac23a94 service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Updating instance_info_cache with network_info: [{"id": "6d717eba-e166-4f12-a8d0-76a407144f95", "address": "fa:16:3e:2e:86:00", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d717eba-e1", "ovs_interfaceid": "6d717eba-e166-4f12-a8d0-76a407144f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-89cb0a1d-21f3-49d4-b30e-ed1db1c41e96 req-53bcfd58-9a83-4dbd-82ec-63284ac23a94 service nova] Releasing lock "refresh_cache-1814a4d1-29cc-43d6-b1f0-2d4c2098d411" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:17:38 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] No VIF found with MAC fa:16:3e:2e:86:00, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:17:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:39 user nova-compute[75378]: DEBUG nova.compute.manager [req-f1bbfa9e-7026-40c7-8f8b-b3966f3aa3d6 req-a6887d37-4ebc-46c5-91be-28557b9cc7cc service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Received event network-vif-plugged-6d717eba-e166-4f12-a8d0-76a407144f95 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:17:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f1bbfa9e-7026-40c7-8f8b-b3966f3aa3d6 req-a6887d37-4ebc-46c5-91be-28557b9cc7cc service nova] Acquiring lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:17:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f1bbfa9e-7026-40c7-8f8b-b3966f3aa3d6 req-a6887d37-4ebc-46c5-91be-28557b9cc7cc service nova] Lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:17:39 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f1bbfa9e-7026-40c7-8f8b-b3966f3aa3d6 req-a6887d37-4ebc-46c5-91be-28557b9cc7cc service nova] Lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:17:39 user nova-compute[75378]: DEBUG nova.compute.manager [req-f1bbfa9e-7026-40c7-8f8b-b3966f3aa3d6 req-a6887d37-4ebc-46c5-91be-28557b9cc7cc service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] No waiting events found dispatching network-vif-plugged-6d717eba-e166-4f12-a8d0-76a407144f95 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:17:39 user nova-compute[75378]: WARNING nova.compute.manager [req-f1bbfa9e-7026-40c7-8f8b-b3966f3aa3d6 req-a6887d37-4ebc-46c5-91be-28557b9cc7cc service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Received unexpected event network-vif-plugged-6d717eba-e166-4f12-a8d0-76a407144f95 for instance with vm_state building and task_state spawning.
Nov 09 04:17:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:41 user nova-compute[75378]: DEBUG nova.compute.manager [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 04:17:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 04:17:41 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Instance spawned successfully.
Nov 09 04:17:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 04:17:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:17:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:17:41 user nova-compute[75378]: INFO nova.compute.manager [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 09 04:17:41 user nova-compute[75378]: DEBUG nova.compute.manager [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:17:41 user nova-compute[75378]: DEBUG nova.compute.manager [req-fa8fcb5a-a301-4923-a02a-5647cd1e14b3 req-8bc48020-7bc4-4e33-8572-545f0378dfc7 service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Received event network-vif-plugged-6d717eba-e166-4f12-a8d0-76a407144f95 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:17:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-fa8fcb5a-a301-4923-a02a-5647cd1e14b3 req-8bc48020-7bc4-4e33-8572-545f0378dfc7 service nova] Acquiring lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:17:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-fa8fcb5a-a301-4923-a02a-5647cd1e14b3 req-8bc48020-7bc4-4e33-8572-545f0378dfc7 service nova] Lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:17:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-fa8fcb5a-a301-4923-a02a-5647cd1e14b3 req-8bc48020-7bc4-4e33-8572-545f0378dfc7 service nova] Lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:17:41 user nova-compute[75378]: DEBUG nova.compute.manager [req-fa8fcb5a-a301-4923-a02a-5647cd1e14b3 req-8bc48020-7bc4-4e33-8572-545f0378dfc7 service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] No waiting events found dispatching network-vif-plugged-6d717eba-e166-4f12-a8d0-76a407144f95 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:17:41 user nova-compute[75378]: WARNING nova.compute.manager [req-fa8fcb5a-a301-4923-a02a-5647cd1e14b3 req-8bc48020-7bc4-4e33-8572-545f0378dfc7 service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Received unexpected event network-vif-plugged-6d717eba-e166-4f12-a8d0-76a407144f95 for instance with vm_state building and task_state spawning.
Nov 09 04:17:41 user nova-compute[75378]: INFO nova.compute.manager [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Took 6.72 seconds to build instance.
Nov 09 04:17:41 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-55c7698c-dd5f-4407-aebb-9bc611b67b36 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.825s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:17:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:17:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:17:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:17:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:17:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:54 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:17:54 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:17:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-42e015a5-b160-4b15-829b-3cab96075d6f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:17:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-42e015a5-b160-4b15-829b-3cab96075d6f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:17:54 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 04:17:54 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Updating instance_info_cache with network_info: [{"id": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "address": "fa:16:3e:f7:b5:ff", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00629a2d-5f", "ovs_interfaceid": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:17:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-42e015a5-b160-4b15-829b-3cab96075d6f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:17:54 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 04:17:55 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:17:55 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:17:55 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:17:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:58 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:17:58 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:17:58 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:17:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:17:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:17:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:17:58 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:17:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:17:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:58 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:17:59 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:17:59 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:17:59 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:17:59 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8696MB free_disk=24.997947692871094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:17:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:17:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:17:59 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 42e015a5-b160-4b15-829b-3cab96075d6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:17:59 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 1814a4d1-29cc-43d6-b1f0-2d4c2098d411 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:17:59 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:17:59 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:17:59 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing inventories for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 04:17:59 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Updating ProviderTree inventory for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 04:17:59 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Updating inventory in ProviderTree for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 04:17:59 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing aggregate associations for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8, aggregates: None {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 04:17:59 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing trait associations for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8, traits: HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 04:17:59 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:17:59 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:17:59 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:17:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:18:00 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:18:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:05 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:18:06 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:18:06 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:18:06 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Cleaning up deleted instances {{(pid=75378) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 04:18:06 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] There are 0 instances to clean {{(pid=75378) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 04:18:07 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:18:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:18:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "28e28c32-bab9-4e3e-9584-4db17d4375a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:18:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "28e28c32-bab9-4e3e-9584-4db17d4375a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:18:19 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 04:18:20 user nova-compute[75378]: INFO nova.compute.claims [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Claim successful on node user
Nov 09 04:18:20 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.226s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 04:18:20 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 04:18:20 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG nova.policy [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23b841529aaf42c29a442ef9524422b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5a4bfe6ce546d2acfbf7be75334d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 04:18:20 user nova-compute[75378]: INFO nova.virt.block_device [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Booting with volume e07bcfba-dc74-4540-bc64-9e08f3eb8654 at /dev/vda
Nov 09 04:18:20 user nova-compute[75378]: DEBUG os_brick.utils [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7823ae-8215-44ab-99f4-7d83f5c40986]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9d5fb3-6177-4d58-b779-ce32b1e1acfa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[db074fb7-bd34-43d5-9754-54f11c1092a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[896d4fd3-64e5-4ba4-bf42-3afa3be3a0f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:18:20 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 04:18:20 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5de96d-dbef-41e8-b407-828969836897]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG os_brick.utils [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:18:20 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Updating existing volume attachment record: 6bcd0835-2417-4710-9617-f6163c61cb02 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 04:18:21 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Successfully created port: d64749f4-bad0-4ccf-909f-7ff29f90d6fa {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 04:18:21 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Successfully updated port: d64749f4-bad0-4ccf-909f-7ff29f90d6fa {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 04:18:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "refresh_cache-28e28c32-bab9-4e3e-9584-4db17d4375a2" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:18:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquired lock "refresh_cache-28e28c32-bab9-4e3e-9584-4db17d4375a2" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:18:21 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:18:21 user nova-compute[75378]: DEBUG nova.compute.manager [req-8ce3c155-b2c1-4a7b-803e-79af86a2d6f2 req-a3adc2cd-7b27-4378-9233-9f05bc97c9b5 service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Received event network-changed-d64749f4-bad0-4ccf-909f-7ff29f90d6fa {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:18:21 user nova-compute[75378]: DEBUG nova.compute.manager [req-8ce3c155-b2c1-4a7b-803e-79af86a2d6f2 req-a3adc2cd-7b27-4378-9233-9f05bc97c9b5 service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Refreshing instance network info cache due to event network-changed-d64749f4-bad0-4ccf-909f-7ff29f90d6fa. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:18:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8ce3c155-b2c1-4a7b-803e-79af86a2d6f2 req-a3adc2cd-7b27-4378-9233-9f05bc97c9b5 service nova] Acquiring lock "refresh_cache-28e28c32-bab9-4e3e-9584-4db17d4375a2" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:18:21 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 04:18:21 user nova-compute[75378]: DEBUG nova.network.neutron [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Updating instance_info_cache with network_info: [{"id": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "address": "fa:16:3e:4d:32:fe", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd64749f4-ba", "ovs_interfaceid": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:18:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Releasing lock "refresh_cache-28e28c32-bab9-4e3e-9584-4db17d4375a2" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:18:21 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Instance network_info: |[{"id": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "address": "fa:16:3e:4d:32:fe", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd64749f4-ba", "ovs_interfaceid": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 04:18:21 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8ce3c155-b2c1-4a7b-803e-79af86a2d6f2 req-a3adc2cd-7b27-4378-9233-9f05bc97c9b5 service nova] Acquired lock "refresh_cache-28e28c32-bab9-4e3e-9584-4db17d4375a2" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:18:21 user nova-compute[75378]: DEBUG nova.network.neutron [req-8ce3c155-b2c1-4a7b-803e-79af86a2d6f2 req-a3adc2cd-7b27-4378-9233-9f05bc97c9b5 service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Refreshing network info cache for port d64749f4-bad0-4ccf-909f-7ff29f90d6fa {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:18:22 user nova-compute[75378]: DEBUG nova.network.neutron [req-8ce3c155-b2c1-4a7b-803e-79af86a2d6f2 req-a3adc2cd-7b27-4378-9233-9f05bc97c9b5 service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Updated VIF entry in instance network info cache for port d64749f4-bad0-4ccf-909f-7ff29f90d6fa. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:18:22 user nova-compute[75378]: DEBUG nova.network.neutron [req-8ce3c155-b2c1-4a7b-803e-79af86a2d6f2 req-a3adc2cd-7b27-4378-9233-9f05bc97c9b5 service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Updating instance_info_cache with network_info: [{"id": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "address": "fa:16:3e:4d:32:fe", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd64749f4-ba", "ovs_interfaceid": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:18:22 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-8ce3c155-b2c1-4a7b-803e-79af86a2d6f2 req-a3adc2cd-7b27-4378-9233-9f05bc97c9b5 service nova] Releasing lock "refresh_cache-28e28c32-bab9-4e3e-9584-4db17d4375a2" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:18:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:18:26 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:18:26 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75378) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 04:18:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:18:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:18:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:18:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:18:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:18:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 04:18:42 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Creating image(s)
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Did not create local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Ensure instance console log exists: /opt/stack/data/nova/instances/28e28c32-bab9-4e3e-9584-4db17d4375a2/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Start _get_guest_xml network_info=[{"id": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "address": "fa:16:3e:4d:32:fe", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd64749f4-ba", "ovs_interfaceid": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHaudejw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '28e28c32-bab9-4e3e-9584-4db17d4375a2', 'attached_at': '', 'detached_at': '', 'volume_id': 'e07bcfba-dc74-4540-bc64-9e08f3eb8654', 'serial': 'e07bcfba-dc74-4540-bc64-9e08f3eb8654'}, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': '6bcd0835-2417-4710-9617-f6163c61cb02', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 04:18:42 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:18:42 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHaudejw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:18:42 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:18:42 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:18:42 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50c0a58-73e6-451c-9847-88e2a481f19b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 04:18:42 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87282ab-a62a-47f3-af1a-f58f42ab6801]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654] added
Nov 09 04:18:42 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a6ec81-fa35-4d93-be56-c69556477449]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[842ed75c-67f9-464c-9807-84b7d7df367d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MHaudejw {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MHaudejw" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dce9e1b-dfa6-40ca-a06c-7f6505e7e967]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MHaudejw'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[794382db-cc9b-4ce9-8169-bcf8f41bfc36]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e8a0a0-c0e4-4247-969a-0d3a9cf72ea3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 04:18:42 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 04:18:42 user nova-compute[75378]:  {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:18:42 user nova-compute[75378]: WARNING os_brick.initiator.connectors.iscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 04:18:42 user nova-compute[75378]: 
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0daa09-d081-4693-b110-1bf139ec967c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654, portal: 172.16.0.220,3260]
Nov 09 04:18:42 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654, portal: 172.16.0.220,3260] successful.
Nov 09 04:18:42 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2935a475-b64b-434d-bb33-4fd9ce424206]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a12297-a752-4d2f-b54e-25be26da4045]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)
Nov 09 04:18:42 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)
Nov 09 04:18:42 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff175b2e-2178-4c3c-9cdf-ca074064f918]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:18:42 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHaudejw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26235666631613433', 'path': '/dev/sdb'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235666631613433', 'path': '/dev/sdb'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:18:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1963551964',display_name='tempest-TestVolumeBootPattern-server-1963551964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1963551964',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIi6MoXfdtoHEdwPWb+lWBCIxxkWR94j+DvoRNdiCeJq2S7kvIBHTpDH0k237JeK83nJZ3VdWHYahvDy+qLUM0dmkr7n9qytWZXFGwnMeX/Mols0eY6D/GRmBaaR1kjt8w==',key_name='tempest-TestVolumeBootPattern-1437224047',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed5a4bfe6ce546d2acfbf7be75334d1a',ramdisk_id='',reservation_id='r-hcd7urlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1436829014',owner_user_name='tempest-TestVolumeBootPattern-1436829014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:18:20Z,user_data=None,user_id='23b841529aaf42c29a442ef9524422b2',uuid=28e28c32-bab9-4e3e-9584-4db17d4375a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "address": "fa:16:3e:4d:32:fe", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd64749f4-ba", "ovs_interfaceid": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converting VIF {"id": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "address": "fa:16:3e:4d:32:fe", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd64749f4-ba", "ovs_interfaceid": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:32:fe,bridge_name='br-int',has_traffic_filtering=True,id=d64749f4-bad0-4ccf-909f-7ff29f90d6fa,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd64749f4-ba') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG nova.objects.instance [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lazy-loading 'pci_devices' on Instance uuid 28e28c32-bab9-4e3e-9584-4db17d4375a2 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] End _get_guest_xml xml=<domain type="kvm">
Nov 09 04:18:43 user nova-compute[75378]:   <uuid>28e28c32-bab9-4e3e-9584-4db17d4375a2</uuid>
Nov 09 04:18:43 user nova-compute[75378]:   <name>instance-00000032</name>
Nov 09 04:18:43 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 04:18:43 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 04:18:43 user nova-compute[75378]:   <metadata>
Nov 09 04:18:43 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 04:18:43 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 04:18:43 user nova-compute[75378]:       <nova:name>tempest-TestVolumeBootPattern-server-1963551964</nova:name>
Nov 09 04:18:43 user nova-compute[75378]:       <nova:creationTime>2023-11-09 04:18:42</nova:creationTime>
Nov 09 04:18:43 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 04:18:43 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 04:18:43 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 04:18:43 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 04:18:43 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 04:18:43 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 04:18:43 user nova-compute[75378]:       </nova:flavor>
Nov 09 04:18:43 user nova-compute[75378]:       <nova:owner>
Nov 09 04:18:43 user nova-compute[75378]:         <nova:user uuid="23b841529aaf42c29a442ef9524422b2">tempest-TestVolumeBootPattern-1436829014-project-member</nova:user>
Nov 09 04:18:43 user nova-compute[75378]:         <nova:project uuid="ed5a4bfe6ce546d2acfbf7be75334d1a">tempest-TestVolumeBootPattern-1436829014</nova:project>
Nov 09 04:18:43 user nova-compute[75378]:       </nova:owner>
Nov 09 04:18:43 user nova-compute[75378]:       <nova:ports>
Nov 09 04:18:43 user nova-compute[75378]:         <nova:port uuid="d64749f4-bad0-4ccf-909f-7ff29f90d6fa">
Nov 09 04:18:43 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 04:18:43 user nova-compute[75378]:         </nova:port>
Nov 09 04:18:43 user nova-compute[75378]:       </nova:ports>
Nov 09 04:18:43 user nova-compute[75378]:     </nova:instance>
Nov 09 04:18:43 user nova-compute[75378]:   </metadata>
Nov 09 04:18:43 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 04:18:43 user nova-compute[75378]:     <system>
Nov 09 04:18:43 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 04:18:43 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 04:18:43 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 04:18:43 user nova-compute[75378]:       <entry name="serial">28e28c32-bab9-4e3e-9584-4db17d4375a2</entry>
Nov 09 04:18:43 user nova-compute[75378]:       <entry name="uuid">28e28c32-bab9-4e3e-9584-4db17d4375a2</entry>
Nov 09 04:18:43 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 04:18:43 user nova-compute[75378]:     </system>
Nov 09 04:18:43 user nova-compute[75378]:   </sysinfo>
Nov 09 04:18:43 user nova-compute[75378]:   <os>
Nov 09 04:18:43 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 04:18:43 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 04:18:43 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 04:18:43 user nova-compute[75378]:   </os>
Nov 09 04:18:43 user nova-compute[75378]:   <features>
Nov 09 04:18:43 user nova-compute[75378]:     <acpi/>
Nov 09 04:18:43 user nova-compute[75378]:     <apic/>
Nov 09 04:18:43 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 04:18:43 user nova-compute[75378]:   </features>
Nov 09 04:18:43 user nova-compute[75378]:   <clock offset="utc">
Nov 09 04:18:43 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 04:18:43 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 04:18:43 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 04:18:43 user nova-compute[75378]:   </clock>
Nov 09 04:18:43 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 04:18:43 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 04:18:43 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 04:18:43 user nova-compute[75378]:   </cpu>
Nov 09 04:18:43 user nova-compute[75378]:   <devices>
Nov 09 04:18:43 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 04:18:43 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:18:43 user nova-compute[75378]:       <source dev="/dev/sdb"/>
Nov 09 04:18:43 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 04:18:43 user nova-compute[75378]:       <serial>e07bcfba-dc74-4540-bc64-9e08f3eb8654</serial>
Nov 09 04:18:43 user nova-compute[75378]:     </disk>
Nov 09 04:18:43 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 04:18:43 user nova-compute[75378]:       <mac address="fa:16:3e:4d:32:fe"/>
Nov 09 04:18:43 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:18:43 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 04:18:43 user nova-compute[75378]:       <target dev="tapd64749f4-ba"/>
Nov 09 04:18:43 user nova-compute[75378]:     </interface>
Nov 09 04:18:43 user nova-compute[75378]:     <serial type="pty">
Nov 09 04:18:43 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/28e28c32-bab9-4e3e-9584-4db17d4375a2/console.log" append="off"/>
Nov 09 04:18:43 user nova-compute[75378]:     </serial>
Nov 09 04:18:43 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 04:18:43 user nova-compute[75378]:     <video>
Nov 09 04:18:43 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:18:43 user nova-compute[75378]:     </video>
Nov 09 04:18:43 user nova-compute[75378]:     <rng model="virtio">
Nov 09 04:18:43 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 04:18:43 user nova-compute[75378]:     </rng>
Nov 09 04:18:43 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 04:18:43 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 04:18:43 user nova-compute[75378]:       <stats period="10"/>
Nov 09 04:18:43 user nova-compute[75378]:     </memballoon>
Nov 09 04:18:43 user nova-compute[75378]:   </devices>
Nov 09 04:18:43 user nova-compute[75378]: </domain>
Nov 09 04:18:43 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:18:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1963551964',display_name='tempest-TestVolumeBootPattern-server-1963551964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1963551964',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIi6MoXfdtoHEdwPWb+lWBCIxxkWR94j+DvoRNdiCeJq2S7kvIBHTpDH0k237JeK83nJZ3VdWHYahvDy+qLUM0dmkr7n9qytWZXFGwnMeX/Mols0eY6D/GRmBaaR1kjt8w==',key_name='tempest-TestVolumeBootPattern-1437224047',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed5a4bfe6ce546d2acfbf7be75334d1a',ramdisk_id='',reservation_id='r-hcd7urlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1436829014',owner_user_name='tempest-TestVolumeBootPattern-1436829014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:18:20Z,user_data=None,user_id='23b841529aaf42c29a442ef9524422b2',uuid=28e28c32-bab9-4e3e-9584-4db17d4375a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "address": "fa:16:3e:4d:32:fe", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd64749f4-ba", "ovs_interfaceid": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converting VIF {"id": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "address": "fa:16:3e:4d:32:fe", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd64749f4-ba", "ovs_interfaceid": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:32:fe,bridge_name='br-int',has_traffic_filtering=True,id=d64749f4-bad0-4ccf-909f-7ff29f90d6fa,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd64749f4-ba') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG os_vif [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:32:fe,bridge_name='br-int',has_traffic_filtering=True,id=d64749f4-bad0-4ccf-909f-7ff29f90d6fa,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd64749f4-ba') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9fb4a72d-0f09-58d2-9d92-db8c9c2a6fc9', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd64749f4-ba, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd64749f4-ba, col_values=(('qos', UUID('612b4623-fa72-4b2c-b991-cde679ba2303')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd64749f4-ba, col_values=(('external_ids', {'iface-id': 'd64749f4-bad0-4ccf-909f-7ff29f90d6fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:32:fe', 'vm-uuid': '28e28c32-bab9-4e3e-9584-4db17d4375a2'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:43 user nova-compute[75378]: INFO os_vif [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:32:fe,bridge_name='br-int',has_traffic_filtering=True,id=d64749f4-bad0-4ccf-909f-7ff29f90d6fa,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd64749f4-ba')
Nov 09 04:18:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:18:43 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] No VIF found with MAC fa:16:3e:4d:32:fe, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:18:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-12f459ec-0f87-4eee-a661-5ecf8a9e3034 req-f1ddbac3-9cdd-49b6-90d5-974244c4da0a service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Received event network-vif-plugged-d64749f4-bad0-4ccf-909f-7ff29f90d6fa {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:18:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-12f459ec-0f87-4eee-a661-5ecf8a9e3034 req-f1ddbac3-9cdd-49b6-90d5-974244c4da0a service nova] Acquiring lock "28e28c32-bab9-4e3e-9584-4db17d4375a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:18:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-12f459ec-0f87-4eee-a661-5ecf8a9e3034 req-f1ddbac3-9cdd-49b6-90d5-974244c4da0a service nova] Lock "28e28c32-bab9-4e3e-9584-4db17d4375a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:18:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-12f459ec-0f87-4eee-a661-5ecf8a9e3034 req-f1ddbac3-9cdd-49b6-90d5-974244c4da0a service nova] Lock "28e28c32-bab9-4e3e-9584-4db17d4375a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:18:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-12f459ec-0f87-4eee-a661-5ecf8a9e3034 req-f1ddbac3-9cdd-49b6-90d5-974244c4da0a service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] No waiting events found dispatching network-vif-plugged-d64749f4-bad0-4ccf-909f-7ff29f90d6fa {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:18:45 user nova-compute[75378]: WARNING nova.compute.manager [req-12f459ec-0f87-4eee-a661-5ecf8a9e3034 req-f1ddbac3-9cdd-49b6-90d5-974244c4da0a service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Received unexpected event network-vif-plugged-d64749f4-bad0-4ccf-909f-7ff29f90d6fa for instance with vm_state building and task_state spawning.
Nov 09 04:18:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 04:18:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 04:18:47 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Instance spawned successfully.
Nov 09 04:18:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 04:18:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:18:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:18:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:18:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:18:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:18:47 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:18:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:47 user nova-compute[75378]: INFO nova.compute.manager [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 09 04:18:47 user nova-compute[75378]: DEBUG nova.compute.manager [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:18:47 user nova-compute[75378]: INFO nova.compute.manager [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Took 27.40 seconds to build instance.
Nov 09 04:18:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-9dba1b8f-798b-4c66-96bd-ecd167be734d tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "28e28c32-bab9-4e3e-9584-4db17d4375a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.493s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:18:47 user nova-compute[75378]: DEBUG nova.compute.manager [req-3d41f9e3-5d98-45b3-bb63-5c6e21531d0e req-c82a10c5-82d4-4fee-af12-7932875228a3 service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Received event network-vif-plugged-d64749f4-bad0-4ccf-909f-7ff29f90d6fa {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:18:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3d41f9e3-5d98-45b3-bb63-5c6e21531d0e req-c82a10c5-82d4-4fee-af12-7932875228a3 service nova] Acquiring lock "28e28c32-bab9-4e3e-9584-4db17d4375a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:18:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3d41f9e3-5d98-45b3-bb63-5c6e21531d0e req-c82a10c5-82d4-4fee-af12-7932875228a3 service nova] Lock "28e28c32-bab9-4e3e-9584-4db17d4375a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:18:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3d41f9e3-5d98-45b3-bb63-5c6e21531d0e req-c82a10c5-82d4-4fee-af12-7932875228a3 service nova] Lock "28e28c32-bab9-4e3e-9584-4db17d4375a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:18:47 user nova-compute[75378]: DEBUG nova.compute.manager [req-3d41f9e3-5d98-45b3-bb63-5c6e21531d0e req-c82a10c5-82d4-4fee-af12-7932875228a3 service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] No waiting events found dispatching network-vif-plugged-d64749f4-bad0-4ccf-909f-7ff29f90d6fa {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:18:47 user nova-compute[75378]: WARNING nova.compute.manager [req-3d41f9e3-5d98-45b3-bb63-5c6e21531d0e req-c82a10c5-82d4-4fee-af12-7932875228a3 service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Received unexpected event network-vif-plugged-d64749f4-bad0-4ccf-909f-7ff29f90d6fa for instance with vm_state active and task_state None.
Nov 09 04:18:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "9c3afa94-f203-4c45-a755-02446b204d12" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:18:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "9c3afa94-f203-4c45-a755-02446b204d12" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:18:50 user nova-compute[75378]: INFO nova.compute.manager [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Unshelving
Nov 09 04:18:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:18:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:18:50 user nova-compute[75378]: DEBUG nova.objects.instance [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lazy-loading 'pci_requests' on Instance uuid 9c3afa94-f203-4c45-a755-02446b204d12 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:18:50 user nova-compute[75378]: DEBUG nova.objects.instance [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lazy-loading 'numa_topology' on Instance uuid 9c3afa94-f203-4c45-a755-02446b204d12 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:18:50 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 04:18:50 user nova-compute[75378]: INFO nova.compute.claims [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Claim successful on node user
Nov 09 04:18:50 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:18:50 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:18:50 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.303s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:18:50 user nova-compute[75378]: INFO nova.network.neutron [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Updating port 460e9a5d-f97c-41cd-9b47-f89ba0adc605 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 09 04:18:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:18:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquired lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:18:51 user nova-compute[75378]: DEBUG nova.network.neutron [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:18:51 user nova-compute[75378]: DEBUG nova.compute.manager [req-29dc6ff8-cdf2-4866-8ad0-c272655f6785 req-464fa057-e5a6-421e-8b54-c8b3bbb73cc0 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Received event network-changed-460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:18:51 user nova-compute[75378]: DEBUG nova.compute.manager [req-29dc6ff8-cdf2-4866-8ad0-c272655f6785 req-464fa057-e5a6-421e-8b54-c8b3bbb73cc0 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Refreshing instance network info cache due to event network-changed-460e9a5d-f97c-41cd-9b47-f89ba0adc605. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:18:51 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-29dc6ff8-cdf2-4866-8ad0-c272655f6785 req-464fa057-e5a6-421e-8b54-c8b3bbb73cc0 service nova] Acquiring lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:18:52 user nova-compute[75378]: DEBUG nova.network.neutron [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Updating instance_info_cache with network_info: [{"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:18:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Releasing lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:18:52 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 04:18:52 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Creating image(s)
Nov 09 04:18:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:18:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "/opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:18:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "/opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:18:52 user nova-compute[75378]: DEBUG nova.objects.instance [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9c3afa94-f203-4c45-a755-02446b204d12 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:18:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-29dc6ff8-cdf2-4866-8ad0-c272655f6785 req-464fa057-e5a6-421e-8b54-c8b3bbb73cc0 service nova] Acquired lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:18:52 user nova-compute[75378]: DEBUG nova.network.neutron [req-29dc6ff8-cdf2-4866-8ad0-c272655f6785 req-464fa057-e5a6-421e-8b54-c8b3bbb73cc0 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Refreshing network info cache for port 460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:18:52 user nova-compute[75378]: DEBUG nova.objects.base [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Object Instance<9c3afa94-f203-4c45-a755-02446b204d12> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 04:18:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "c842576761a9c2e5d30f3c459087c7233e33b81f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:18:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "c842576761a9c2e5d30f3c459087c7233e33b81f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:18:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c842576761a9c2e5d30f3c459087c7233e33b81f.part --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c842576761a9c2e5d30f3c459087c7233e33b81f.part --force-share --output=json" returned: 0 in 0.181s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:53 user nova-compute[75378]: DEBUG nova.virt.images [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] 07a2cc1c-0e83-4795-b425-e429bfd4c740 was qcow2, converting to raw {{(pid=75378) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 04:18:53 user nova-compute[75378]: DEBUG nova.privsep.utils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75378) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 04:18:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c842576761a9c2e5d30f3c459087c7233e33b81f.part /opt/stack/data/nova/instances/_base/c842576761a9c2e5d30f3c459087c7233e33b81f.converted {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:53 user nova-compute[75378]: DEBUG nova.network.neutron [req-29dc6ff8-cdf2-4866-8ad0-c272655f6785 req-464fa057-e5a6-421e-8b54-c8b3bbb73cc0 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Updated VIF entry in instance network info cache for port 460e9a5d-f97c-41cd-9b47-f89ba0adc605. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:18:53 user nova-compute[75378]: DEBUG nova.network.neutron [req-29dc6ff8-cdf2-4866-8ad0-c272655f6785 req-464fa057-e5a6-421e-8b54-c8b3bbb73cc0 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Updating instance_info_cache with network_info: [{"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:18:53 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-29dc6ff8-cdf2-4866-8ad0-c272655f6785 req-464fa057-e5a6-421e-8b54-c8b3bbb73cc0 service nova] Releasing lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:18:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c842576761a9c2e5d30f3c459087c7233e33b81f.part /opt/stack/data/nova/instances/_base/c842576761a9c2e5d30f3c459087c7233e33b81f.converted" returned: 0 in 0.612s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:53 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c842576761a9c2e5d30f3c459087c7233e33b81f.converted --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c842576761a9c2e5d30f3c459087c7233e33b81f.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "c842576761a9c2e5d30f3c459087c7233e33b81f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.036s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:18:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c842576761a9c2e5d30f3c459087c7233e33b81f --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c842576761a9c2e5d30f3c459087c7233e33b81f --force-share --output=json" returned: 0 in 0.167s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "c842576761a9c2e5d30f3c459087c7233e33b81f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:18:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "c842576761a9c2e5d30f3c459087c7233e33b81f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:18:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c842576761a9c2e5d30f3c459087c7233e33b81f --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c842576761a9c2e5d30f3c459087c7233e33b81f --force-share --output=json" returned: 0 in 0.170s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c842576761a9c2e5d30f3c459087c7233e33b81f,backing_fmt=raw /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk 1073741824 {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c842576761a9c2e5d30f3c459087c7233e33b81f,backing_fmt=raw /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk 1073741824" returned: 0 in 0.047s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "c842576761a9c2e5d30f3c459087c7233e33b81f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:18:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c842576761a9c2e5d30f3c459087c7233e33b81f --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c842576761a9c2e5d30f3c459087c7233e33b81f --force-share --output=json" returned: 0 in 0.187s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:54 user nova-compute[75378]: DEBUG nova.objects.instance [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lazy-loading 'migration_context' on Instance uuid 9c3afa94-f203-4c45-a755-02446b204d12 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:18:54 user nova-compute[75378]: DEBUG nova.objects.base [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Object Instance<9c3afa94-f203-4c45-a755-02446b204d12> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 04:18:54 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Rebasing disk image.
Nov 09 04:18:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a --force-share --output=json" returned: 0 in 0.181s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:54 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a -F raw /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:18:55 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:18:55 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:18:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:18:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:18:55 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 04:18:55 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Updating instance_info_cache with network_info: [{"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:18:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-9c3afa94-f203-4c45-a755-02446b204d12" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:18:55 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 04:18:55 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/2ef19bea51ac5815dc9f558430b64f7f4894d52a -F raw /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk" returned: 0 in 2.184s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Created local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Ensure instance console log exists: /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Start _get_guest_xml network_info=[{"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='9219e40b9bbb8e2e5324c9d57249565b',container_format='bare',created_at=2023-11-09T04:16:57Z,direct_url=<?>,disk_format='qcow2',id=07a2cc1c-0e83-4795-b425-e429bfd4c740,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1522830695-shelved',owner='3c5788a86f2c4fcab582d65b471fe27e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-09T04:17:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'c162665b-54ae-441d-9cd1-28ea81cc5de8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 04:18:57 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:18:57 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='9219e40b9bbb8e2e5324c9d57249565b',container_format='bare',created_at=2023-11-09T04:16:57Z,direct_url=<?>,disk_format='qcow2',id=07a2cc1c-0e83-4795-b425-e429bfd4c740,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1522830695-shelved',owner='3c5788a86f2c4fcab582d65b471fe27e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-09T04:17:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.objects.instance [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9c3afa94-f203-4c45-a755-02446b204d12 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.objects.base [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Object Instance<9c3afa94-f203-4c45-a755-02446b204d12> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T04:14:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1522830695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1522830695',id=48,image_ref='07a2cc1c-0e83-4795-b425-e429bfd4c740',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1381306586',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:15:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3c5788a86f2c4fcab582d65b471fe27e',ramdisk_id='',reservation_id='r-j3uvi7ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1244090539',owner_user_name='tempest-AttachVolumeShelveTestJSON-1244090539-project-member',shelved_at='2023-11-09T04:17:01.971584',shelved_host='user',shelved_image_id='07a2cc1c-0e83-4795-b425-e429bfd4c740'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:18:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f996e26d3a04dd8ba5a64eaa218a9b3',uuid=9c3afa94-f203-4c45-a755-02446b204d12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converting VIF {"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:9e:dd,bridge_name='br-int',has_traffic_filtering=True,id=460e9a5d-f97c-41cd-9b47-f89ba0adc605,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460e9a5d-f9') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.objects.instance [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c3afa94-f203-4c45-a755-02446b204d12 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.objects.base [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Object Instance<9c3afa94-f203-4c45-a755-02446b204d12> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75378) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] End _get_guest_xml xml=<domain type="kvm">
Nov 09 04:18:57 user nova-compute[75378]:   <uuid>9c3afa94-f203-4c45-a755-02446b204d12</uuid>
Nov 09 04:18:57 user nova-compute[75378]:   <name>instance-00000030</name>
Nov 09 04:18:57 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 04:18:57 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 04:18:57 user nova-compute[75378]:   <metadata>
Nov 09 04:18:57 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 04:18:57 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 04:18:57 user nova-compute[75378]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1522830695</nova:name>
Nov 09 04:18:57 user nova-compute[75378]:       <nova:creationTime>2023-11-09 04:18:57</nova:creationTime>
Nov 09 04:18:57 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 04:18:57 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 04:18:57 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 04:18:57 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 04:18:57 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 04:18:57 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 04:18:57 user nova-compute[75378]:       </nova:flavor>
Nov 09 04:18:57 user nova-compute[75378]:       <nova:owner>
Nov 09 04:18:57 user nova-compute[75378]:         <nova:user uuid="5f996e26d3a04dd8ba5a64eaa218a9b3">tempest-AttachVolumeShelveTestJSON-1244090539-project-member</nova:user>
Nov 09 04:18:57 user nova-compute[75378]:         <nova:project uuid="3c5788a86f2c4fcab582d65b471fe27e">tempest-AttachVolumeShelveTestJSON-1244090539</nova:project>
Nov 09 04:18:57 user nova-compute[75378]:       </nova:owner>
Nov 09 04:18:57 user nova-compute[75378]:       <nova:root type="image" uuid="07a2cc1c-0e83-4795-b425-e429bfd4c740"/>
Nov 09 04:18:57 user nova-compute[75378]:       <nova:ports>
Nov 09 04:18:57 user nova-compute[75378]:         <nova:port uuid="460e9a5d-f97c-41cd-9b47-f89ba0adc605">
Nov 09 04:18:57 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 09 04:18:57 user nova-compute[75378]:         </nova:port>
Nov 09 04:18:57 user nova-compute[75378]:       </nova:ports>
Nov 09 04:18:57 user nova-compute[75378]:     </nova:instance>
Nov 09 04:18:57 user nova-compute[75378]:   </metadata>
Nov 09 04:18:57 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 04:18:57 user nova-compute[75378]:     <system>
Nov 09 04:18:57 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 04:18:57 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 04:18:57 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 04:18:57 user nova-compute[75378]:       <entry name="serial">9c3afa94-f203-4c45-a755-02446b204d12</entry>
Nov 09 04:18:57 user nova-compute[75378]:       <entry name="uuid">9c3afa94-f203-4c45-a755-02446b204d12</entry>
Nov 09 04:18:57 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 04:18:57 user nova-compute[75378]:     </system>
Nov 09 04:18:57 user nova-compute[75378]:   </sysinfo>
Nov 09 04:18:57 user nova-compute[75378]:   <os>
Nov 09 04:18:57 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 04:18:57 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 04:18:57 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 04:18:57 user nova-compute[75378]:   </os>
Nov 09 04:18:57 user nova-compute[75378]:   <features>
Nov 09 04:18:57 user nova-compute[75378]:     <acpi/>
Nov 09 04:18:57 user nova-compute[75378]:     <apic/>
Nov 09 04:18:57 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 04:18:57 user nova-compute[75378]:   </features>
Nov 09 04:18:57 user nova-compute[75378]:   <clock offset="utc">
Nov 09 04:18:57 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 04:18:57 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 04:18:57 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 04:18:57 user nova-compute[75378]:   </clock>
Nov 09 04:18:57 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 04:18:57 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 04:18:57 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 04:18:57 user nova-compute[75378]:   </cpu>
Nov 09 04:18:57 user nova-compute[75378]:   <devices>
Nov 09 04:18:57 user nova-compute[75378]:     <disk type="file" device="disk">
Nov 09 04:18:57 user nova-compute[75378]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 04:18:57 user nova-compute[75378]:       <source file="/opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk"/>
Nov 09 04:18:57 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 04:18:57 user nova-compute[75378]:     </disk>
Nov 09 04:18:57 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 04:18:57 user nova-compute[75378]:       <mac address="fa:16:3e:6c:9e:dd"/>
Nov 09 04:18:57 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:18:57 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 04:18:57 user nova-compute[75378]:       <target dev="tap460e9a5d-f9"/>
Nov 09 04:18:57 user nova-compute[75378]:     </interface>
Nov 09 04:18:57 user nova-compute[75378]:     <serial type="pty">
Nov 09 04:18:57 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/console.log" append="off"/>
Nov 09 04:18:57 user nova-compute[75378]:     </serial>
Nov 09 04:18:57 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 04:18:57 user nova-compute[75378]:     <video>
Nov 09 04:18:57 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:18:57 user nova-compute[75378]:     </video>
Nov 09 04:18:57 user nova-compute[75378]:     <rng model="virtio">
Nov 09 04:18:57 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 04:18:57 user nova-compute[75378]:     </rng>
Nov 09 04:18:57 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 04:18:57 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 04:18:57 user nova-compute[75378]:       <stats period="10"/>
Nov 09 04:18:57 user nova-compute[75378]:     </memballoon>
Nov 09 04:18:57 user nova-compute[75378]:   </devices>
Nov 09 04:18:57 user nova-compute[75378]: </domain>
Nov 09 04:18:57 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T04:14:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1522830695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1522830695',id=48,image_ref='07a2cc1c-0e83-4795-b425-e429bfd4c740',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1381306586',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:15:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3c5788a86f2c4fcab582d65b471fe27e',ramdisk_id='',reservation_id='r-j3uvi7ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1244090539',owner_user_name='tempest-AttachVolumeShelveTestJSON-1244090539-project-member',shelved_at='2023-11-09T04:17:01.971584',shelved_host='user',shelved_image_id='07a2cc1c-0e83-4795-b425-e429bfd4c740'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:18:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f996e26d3a04dd8ba5a64eaa218a9b3',uuid=9c3afa94-f203-4c45-a755-02446b204d12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converting VIF {"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:9e:dd,bridge_name='br-int',has_traffic_filtering=True,id=460e9a5d-f97c-41cd-9b47-f89ba0adc605,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460e9a5d-f9') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG os_vif [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:9e:dd,bridge_name='br-int',has_traffic_filtering=True,id=460e9a5d-f97c-41cd-9b47-f89ba0adc605,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460e9a5d-f9') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2054e33a-0997-509b-a551-5f0437cb3389', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap460e9a5d-f9, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap460e9a5d-f9, col_values=(('qos', UUID('328815de-6a52-46a8-8ed4-b010aa1082f8')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap460e9a5d-f9, col_values=(('external_ids', {'iface-id': '460e9a5d-f97c-41cd-9b47-f89ba0adc605', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:9e:dd', 'vm-uuid': '9c3afa94-f203-4c45-a755-02446b204d12'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:57 user nova-compute[75378]: INFO os_vif [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:9e:dd,bridge_name='br-int',has_traffic_filtering=True,id=460e9a5d-f97c-41cd-9b47-f89ba0adc605,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460e9a5d-f9')
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:18:57 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] No VIF found with MAC fa:16:3e:6c:9e:dd, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:18:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:58 user nova-compute[75378]: DEBUG nova.compute.manager [req-a1557e43-053e-495c-acd0-62edf470c6eb req-7df06023-802a-461d-bba6-1d70207b15b5 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Received event network-vif-plugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:18:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a1557e43-053e-495c-acd0-62edf470c6eb req-7df06023-802a-461d-bba6-1d70207b15b5 service nova] Acquiring lock "9c3afa94-f203-4c45-a755-02446b204d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:18:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a1557e43-053e-495c-acd0-62edf470c6eb req-7df06023-802a-461d-bba6-1d70207b15b5 service nova] Lock "9c3afa94-f203-4c45-a755-02446b204d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:18:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a1557e43-053e-495c-acd0-62edf470c6eb req-7df06023-802a-461d-bba6-1d70207b15b5 service nova] Lock "9c3afa94-f203-4c45-a755-02446b204d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:18:58 user nova-compute[75378]: DEBUG nova.compute.manager [req-a1557e43-053e-495c-acd0-62edf470c6eb req-7df06023-802a-461d-bba6-1d70207b15b5 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] No waiting events found dispatching network-vif-plugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:18:58 user nova-compute[75378]: WARNING nova.compute.manager [req-a1557e43-053e-495c-acd0-62edf470c6eb req-7df06023-802a-461d-bba6-1d70207b15b5 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Received unexpected event network-vif-plugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 09 04:18:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:59 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:18:59 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:18:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:18:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:00 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:19:00 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:19:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:19:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:19:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:19:00 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:19:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:19:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:19:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:19:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:19:00 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-f3b2b5b5-a03a-48dc-8e36-92d7f02e781f req-b34dd850-bb0c-4465-9ded-d117130c6203 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Received event network-vif-plugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:19:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f3b2b5b5-a03a-48dc-8e36-92d7f02e781f req-b34dd850-bb0c-4465-9ded-d117130c6203 service nova] Acquiring lock "9c3afa94-f203-4c45-a755-02446b204d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:19:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f3b2b5b5-a03a-48dc-8e36-92d7f02e781f req-b34dd850-bb0c-4465-9ded-d117130c6203 service nova] Lock "9c3afa94-f203-4c45-a755-02446b204d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:19:00 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-f3b2b5b5-a03a-48dc-8e36-92d7f02e781f req-b34dd850-bb0c-4465-9ded-d117130c6203 service nova] Lock "9c3afa94-f203-4c45-a755-02446b204d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:19:00 user nova-compute[75378]: DEBUG nova.compute.manager [req-f3b2b5b5-a03a-48dc-8e36-92d7f02e781f req-b34dd850-bb0c-4465-9ded-d117130c6203 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] No waiting events found dispatching network-vif-plugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:19:00 user nova-compute[75378]: WARNING nova.compute.manager [req-f3b2b5b5-a03a-48dc-8e36-92d7f02e781f req-b34dd850-bb0c-4465-9ded-d117130c6203 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Received unexpected event network-vif-plugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 09 04:19:00 user nova-compute[75378]: DEBUG nova.compute.manager [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 04:19:00 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 04:19:01 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Instance spawned successfully.
Nov 09 04:19:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:19:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:01 user nova-compute[75378]: DEBUG nova.compute.manager [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:19:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:19:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-188e9f4b-285e-4e47-bd1a-0c8f124b1ff9 tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "9c3afa94-f203-4c45-a755-02446b204d12" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.854s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:19:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:19:01 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:19:01 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:19:01 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8559MB free_disk=24.864540100097656GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:19:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:19:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:19:02 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 42e015a5-b160-4b15-829b-3cab96075d6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:19:02 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 1814a4d1-29cc-43d6-b1f0-2d4c2098d411 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:19:02 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 28e28c32-bab9-4e3e-9584-4db17d4375a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:19:02 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9c3afa94-f203-4c45-a755-02446b204d12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:19:02 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:19:02 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:19:02 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:19:02 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:19:02 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:19:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:19:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:08 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:19:08 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:19:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:22 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:26 user nova-compute[75378]: DEBUG nova.compute.manager [req-b5c4e0c4-d4b5-45da-9525-36cac45a6a4b req-4f9aa3a2-db89-43ea-b686-710dc04b7e93 service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Received event network-changed-6d717eba-e166-4f12-a8d0-76a407144f95 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:19:26 user nova-compute[75378]: DEBUG nova.compute.manager [req-b5c4e0c4-d4b5-45da-9525-36cac45a6a4b req-4f9aa3a2-db89-43ea-b686-710dc04b7e93 service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Refreshing instance network info cache due to event network-changed-6d717eba-e166-4f12-a8d0-76a407144f95. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:19:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b5c4e0c4-d4b5-45da-9525-36cac45a6a4b req-4f9aa3a2-db89-43ea-b686-710dc04b7e93 service nova] Acquiring lock "refresh_cache-1814a4d1-29cc-43d6-b1f0-2d4c2098d411" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:19:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b5c4e0c4-d4b5-45da-9525-36cac45a6a4b req-4f9aa3a2-db89-43ea-b686-710dc04b7e93 service nova] Acquired lock "refresh_cache-1814a4d1-29cc-43d6-b1f0-2d4c2098d411" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:19:26 user nova-compute[75378]: DEBUG nova.network.neutron [req-b5c4e0c4-d4b5-45da-9525-36cac45a6a4b req-4f9aa3a2-db89-43ea-b686-710dc04b7e93 service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Refreshing network info cache for port 6d717eba-e166-4f12-a8d0-76a407144f95 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG nova.network.neutron [req-b5c4e0c4-d4b5-45da-9525-36cac45a6a4b req-4f9aa3a2-db89-43ea-b686-710dc04b7e93 service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Updated VIF entry in instance network info cache for port 6d717eba-e166-4f12-a8d0-76a407144f95. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG nova.network.neutron [req-b5c4e0c4-d4b5-45da-9525-36cac45a6a4b req-4f9aa3a2-db89-43ea-b686-710dc04b7e93 service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Updating instance_info_cache with network_info: [{"id": "6d717eba-e166-4f12-a8d0-76a407144f95", "address": "fa:16:3e:2e:86:00", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d717eba-e1", "ovs_interfaceid": "6d717eba-e166-4f12-a8d0-76a407144f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG nova.objects.instance [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lazy-loading 'flavor' on Instance uuid 1814a4d1-29cc-43d6-b1f0-2d4c2098d411 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b5c4e0c4-d4b5-45da-9525-36cac45a6a4b req-4f9aa3a2-db89-43ea-b686-710dc04b7e93 service nova] Releasing lock "refresh_cache-1814a4d1-29cc-43d6-b1f0-2d4c2098d411" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:19:27 user nova-compute[75378]: INFO nova.compute.manager [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Attaching volume a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb to /dev/vdb
Nov 09 04:19:27 user nova-compute[75378]: DEBUG os_brick.utils [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[de894935-baef-4905-b9c9-3b7b8165dbef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15d8e99-37b4-422d-84ec-e123c0ec76d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bebf325-6e11-467a-8839-670d2a3d621d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[495b21dd-dee8-48ec-8267-174a3919e2ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:19:27 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 04:19:27 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[da17e376-17c3-485c-a9e1-ff60b32c6172]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG os_brick.utils [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:19:27 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Updating existing volume attachment record: 7339b2db-9d34-42fc-96d6-a200755047c7 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 04:19:28 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:19:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:37 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTcxjwOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:19:50 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:19:50 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:19:50 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e020a87-19d8-4027-ab59-88ac995560e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 04:19:50 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0abb02-8412-41f4-93ff-7c15c0edaac1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb] added
Nov 09 04:19:50 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f12608-61cb-493d-bd26-56e22ae5d280]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55ab8d5-4a68-4c82-a18c-c0e5e5dda705]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTcxjwOh {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTcxjwOh" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e376d2-9894-4fae-84f6-070ce8526205]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BTcxjwOh'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f759c6-0f15-4a7a-82a9-b60a5689e963]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[861eb352-d3b8-436e-8859-25b929f40bed]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)
Nov 09 04:19:50 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)
Nov 09 04:19:50 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0d978a-ae82-491e-9efc-966db247b861]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb, portal: 172.16.0.220,3260]
Nov 09 04:19:50 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb, portal: 172.16.0.220,3260] successful.
Nov 09 04:19:50 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa78218-d097-49cf-8ff2-696693dda2e3]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bfb87d-4727-4428-a772-322716064535]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)
Nov 09 04:19:50 user nova-compute[75378]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb (non-flash)
Nov 09 04:19:50 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)
Nov 09 04:19:50 user nova-compute[75378]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb (non-flash)
Nov 09 04:19:50 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0613201e-b8df-4f84-8bac-ce53627e5b20]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:19:50 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTcxjwOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 04:19:51 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:19:51 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23265663334343461', 'path': '/dev/sdc'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:19:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265663334343461', 'path': '/dev/sdc'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 04:19:51 user nova-compute[75378]: DEBUG nova.objects.instance [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lazy-loading 'flavor' on Instance uuid 1814a4d1-29cc-43d6-b1f0-2d4c2098d411 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:19:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 04:19:51 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:19:51 user nova-compute[75378]:   <source dev="/dev/sdc"/>
Nov 09 04:19:51 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 04:19:51 user nova-compute[75378]:   <serial>a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb</serial>
Nov 09 04:19:51 user nova-compute[75378]: </disk>
Nov 09 04:19:51 user nova-compute[75378]:  {{(pid=75378) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 04:19:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:19:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:19:51 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] No VIF found with MAC fa:16:3e:2e:86:00, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:19:52 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-7eb31b79-6211-428b-997b-31cb30830a7d tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.735s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:19:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:19:54 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:19:54 user nova-compute[75378]: INFO nova.compute.manager [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Detaching volume a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb
Nov 09 04:19:54 user nova-compute[75378]: INFO nova.virt.block_device [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Attempting to driver detach volume a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb from mountpoint /dev/vdb
Nov 09 04:19:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Attempting to detach device vdb from instance 1814a4d1-29cc-43d6-b1f0-2d4c2098d411 from the persistent domain config. {{(pid=75378) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 04:19:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 04:19:54 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:19:54 user nova-compute[75378]:   <source dev="/dev/sdc"/>
Nov 09 04:19:54 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 04:19:54 user nova-compute[75378]:   <serial>a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb</serial>
Nov 09 04:19:54 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 04:19:54 user nova-compute[75378]: </disk>
Nov 09 04:19:54 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 04:19:54 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Successfully detached device vdb from instance 1814a4d1-29cc-43d6-b1f0-2d4c2098d411 from the persistent domain config.
Nov 09 04:19:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1814a4d1-29cc-43d6-b1f0-2d4c2098d411 from the live domain config. {{(pid=75378) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 04:19:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.guest [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 04:19:54 user nova-compute[75378]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:19:54 user nova-compute[75378]:   <source dev="/dev/sdc"/>
Nov 09 04:19:54 user nova-compute[75378]:   <target dev="vdb" bus="virtio"/>
Nov 09 04:19:54 user nova-compute[75378]:   <serial>a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb</serial>
Nov 09 04:19:54 user nova-compute[75378]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 04:19:54 user nova-compute[75378]: </disk>
Nov 09 04:19:54 user nova-compute[75378]:  {{(pid=75378) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 04:19:54 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1814a4d1-29cc-43d6-b1f0-2d4c2098d411 {{(pid=75378) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 04:19:55 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:19:55 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:19:55 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Rebuilding the list of instances to heal {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 04:19:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-42e015a5-b160-4b15-829b-3cab96075d6f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:19:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-42e015a5-b160-4b15-829b-3cab96075d6f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:19:55 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 04:19:55 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lazy-loading 'info_cache' on Instance uuid 42e015a5-b160-4b15-829b-3cab96075d6f {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:19:55 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Updating instance_info_cache with network_info: [{"id": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "address": "fa:16:3e:f7:b5:ff", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00629a2d-5f", "ovs_interfaceid": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:19:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-42e015a5-b160-4b15-829b-3cab96075d6f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:19:55 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 04:19:56 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:19:57 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:19:57 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:19:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:19:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:19:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:19:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:19:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:19:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:19:59 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:19:59 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:20:01 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:20:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:20:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:20:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:20:01 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:20:01 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:20:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:01 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:02 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:20:02 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:20:02 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8528MB free_disk=24.960391998291016GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:20:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:20:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:20:02 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 42e015a5-b160-4b15-829b-3cab96075d6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:20:02 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 1814a4d1-29cc-43d6-b1f0-2d4c2098d411 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:20:02 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 28e28c32-bab9-4e3e-9584-4db17d4375a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:20:02 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 9c3afa94-f203-4c45-a755-02446b204d12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:20:02 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:20:02 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:20:03 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:20:03 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:20:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:20:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:20:04 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:20:06 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:20:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:09 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:20:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:11 user nova-compute[75378]: DEBUG nova.compute.manager [req-b876ef13-007f-44fa-9c03-51ab64070654 req-25dcfcb5-1a2a-4acc-95ac-e11925184d2f service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Received event network-changed-d64749f4-bad0-4ccf-909f-7ff29f90d6fa {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:20:11 user nova-compute[75378]: DEBUG nova.compute.manager [req-b876ef13-007f-44fa-9c03-51ab64070654 req-25dcfcb5-1a2a-4acc-95ac-e11925184d2f service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Refreshing instance network info cache due to event network-changed-d64749f4-bad0-4ccf-909f-7ff29f90d6fa. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:20:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b876ef13-007f-44fa-9c03-51ab64070654 req-25dcfcb5-1a2a-4acc-95ac-e11925184d2f service nova] Acquiring lock "refresh_cache-28e28c32-bab9-4e3e-9584-4db17d4375a2" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:20:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b876ef13-007f-44fa-9c03-51ab64070654 req-25dcfcb5-1a2a-4acc-95ac-e11925184d2f service nova] Acquired lock "refresh_cache-28e28c32-bab9-4e3e-9584-4db17d4375a2" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:20:11 user nova-compute[75378]: DEBUG nova.network.neutron [req-b876ef13-007f-44fa-9c03-51ab64070654 req-25dcfcb5-1a2a-4acc-95ac-e11925184d2f service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Refreshing network info cache for port d64749f4-bad0-4ccf-909f-7ff29f90d6fa {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:20:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:12 user nova-compute[75378]: DEBUG nova.network.neutron [req-b876ef13-007f-44fa-9c03-51ab64070654 req-25dcfcb5-1a2a-4acc-95ac-e11925184d2f service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Updated VIF entry in instance network info cache for port d64749f4-bad0-4ccf-909f-7ff29f90d6fa. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:20:12 user nova-compute[75378]: DEBUG nova.network.neutron [req-b876ef13-007f-44fa-9c03-51ab64070654 req-25dcfcb5-1a2a-4acc-95ac-e11925184d2f service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Updating instance_info_cache with network_info: [{"id": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "address": "fa:16:3e:4d:32:fe", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd64749f4-ba", "ovs_interfaceid": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:20:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-b876ef13-007f-44fa-9c03-51ab64070654 req-25dcfcb5-1a2a-4acc-95ac-e11925184d2f service nova] Releasing lock "refresh_cache-28e28c32-bab9-4e3e-9584-4db17d4375a2" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:20:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "28e28c32-bab9-4e3e-9584-4db17d4375a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:20:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "28e28c32-bab9-4e3e-9584-4db17d4375a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:20:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "28e28c32-bab9-4e3e-9584-4db17d4375a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:20:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "28e28c32-bab9-4e3e-9584-4db17d4375a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:20:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "28e28c32-bab9-4e3e-9584-4db17d4375a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:20:12 user nova-compute[75378]: INFO nova.compute.manager [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Terminating instance
Nov 09 04:20:12 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:20:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-ab190dde-9fc0-4f03-ace6-4675f45d9602 req-6187cb2e-102f-43f9-b989-449cbc7b725b service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Received event network-vif-unplugged-d64749f4-bad0-4ccf-909f-7ff29f90d6fa {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:20:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ab190dde-9fc0-4f03-ace6-4675f45d9602 req-6187cb2e-102f-43f9-b989-449cbc7b725b service nova] Acquiring lock "28e28c32-bab9-4e3e-9584-4db17d4375a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:20:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ab190dde-9fc0-4f03-ace6-4675f45d9602 req-6187cb2e-102f-43f9-b989-449cbc7b725b service nova] Lock "28e28c32-bab9-4e3e-9584-4db17d4375a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:20:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ab190dde-9fc0-4f03-ace6-4675f45d9602 req-6187cb2e-102f-43f9-b989-449cbc7b725b service nova] Lock "28e28c32-bab9-4e3e-9584-4db17d4375a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:20:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-ab190dde-9fc0-4f03-ace6-4675f45d9602 req-6187cb2e-102f-43f9-b989-449cbc7b725b service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] No waiting events found dispatching network-vif-unplugged-d64749f4-bad0-4ccf-909f-7ff29f90d6fa {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:20:12 user nova-compute[75378]: DEBUG nova.compute.manager [req-ab190dde-9fc0-4f03-ace6-4675f45d9602 req-6187cb2e-102f-43f9-b989-449cbc7b725b service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Received event network-vif-unplugged-d64749f4-bad0-4ccf-909f-7ff29f90d6fa for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:20:13 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Instance destroyed successfully.
Nov 09 04:20:13 user nova-compute[75378]: DEBUG nova.objects.instance [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lazy-loading 'resources' on Instance uuid 28e28c32-bab9-4e3e-9584-4db17d4375a2 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:18:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1963551964',display_name='tempest-TestVolumeBootPattern-server-1963551964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1963551964',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIi6MoXfdtoHEdwPWb+lWBCIxxkWR94j+DvoRNdiCeJq2S7kvIBHTpDH0k237JeK83nJZ3VdWHYahvDy+qLUM0dmkr7n9qytWZXFGwnMeX/Mols0eY6D/GRmBaaR1kjt8w==',key_name='tempest-TestVolumeBootPattern-1437224047',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:18:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed5a4bfe6ce546d2acfbf7be75334d1a',ramdisk_id='',reservation_id='r-hcd7urlt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1436829014',owner_user_name='tempest-TestVolumeBootPattern-1436829014-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T04:18:47Z,user_data=None,user_id='23b841529aaf42c29a442ef9524422b2',uuid=28e28c32-bab9-4e3e-9584-4db17d4375a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "address": "fa:16:3e:4d:32:fe", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd64749f4-ba", "ovs_interfaceid": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converting VIF {"id": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "address": "fa:16:3e:4d:32:fe", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd64749f4-ba", "ovs_interfaceid": "d64749f4-bad0-4ccf-909f-7ff29f90d6fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:32:fe,bridge_name='br-int',has_traffic_filtering=True,id=d64749f4-bad0-4ccf-909f-7ff29f90d6fa,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd64749f4-ba') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_vif [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:32:fe,bridge_name='br-int',has_traffic_filtering=True,id=d64749f4-bad0-4ccf-909f-7ff29f90d6fa,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd64749f4-ba') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd64749f4-ba, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=612b4623-fa72-4b2c-b991-cde679ba2303) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:13 user nova-compute[75378]: INFO os_vif [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:32:fe,bridge_name='br-int',has_traffic_filtering=True,id=d64749f4-bad0-4ccf-909f-7ff29f90d6fa,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd64749f4-ba')
Nov 09 04:20:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHaudejw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:20:13 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc56137-3e27-42fe-a212-c30fa07d6a38]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 04:20:13 user nova-compute[75378]: No targets found.
Nov 09 04:20:13 user nova-compute[75378]: iSNS:
Nov 09 04:20:13 user nova-compute[75378]: No targets found.
Nov 09 04:20:13 user nova-compute[75378]: STATIC:
Nov 09 04:20:13 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb
Nov 09 04:20:13 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:20:13 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:20:13 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654
Nov 09 04:20:13 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:20:13 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:20:13 user nova-compute[75378]: FIRMWARE:
Nov 09 04:20:13 user nova-compute[75378]: No targets found.
Nov 09 04:20:13 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 04:20:13 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 04:20:13 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e2fa51-b729-485b-aac0-e1d3771a37ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e92343e-52e1-440c-be44-961045debab7]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)
Nov 09 04:20:13 user nova-compute[75378]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb (non-flash)
Nov 09 04:20:13 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)
Nov 09 04:20:13 user nova-compute[75378]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb (non-flash)
Nov 09 04:20:13 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c7ca5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654'): ({'sdb'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Removing single pathed devices sdb {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[771a6e63-f501-41fd-a9af-785f608117e8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[77df5523-f229-4abf-a81c-30b204862cf8]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Flushing IO for device /dev/sdb {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[645bd42e-594b-4d11-8187-ac7c99ed77ef]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ac0f88-b72c-40c3-a75b-369fa02a2426]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO35c11dfa-b5ff1a435b0f80d3', '/dev/disk/by-id/scsi-26235666631613433', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_35c11dfa') {{(pid=87049) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6c8a97-c2d4-4710-bbc1-0ae6783b7d5a]: (4, None) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.043s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9135f469-7204-4c42-8ad5-aa04377956e5]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e59daf-5307-4ade-b286-3bca5777820a]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654, portal: 172.16.0.220,3260]
Nov 09 04:20:13 user nova-compute[75378]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654, portal: 172.16.0.220,3260] successful.
Nov 09 04:20:13 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef67572f-3e9d-4449-acce-31dada9ff867]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] <== disconnect_volume: return (311ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 04:20:13 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Deleting instance files /opt/stack/data/nova/instances/28e28c32-bab9-4e3e-9584-4db17d4375a2_del
Nov 09 04:20:13 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Deletion of /opt/stack/data/nova/instances/28e28c32-bab9-4e3e-9584-4db17d4375a2_del complete
Nov 09 04:20:13 user nova-compute[75378]: INFO nova.compute.manager [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 09 04:20:13 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:20:13 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:20:14 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Took 0.73 seconds to deallocate network for instance.
Nov 09 04:20:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-34950e48-8ecf-44c2-8a2e-c1d61462880c req-ed3eb960-c254-4e06-8e14-a29ee3e25461 service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Received event network-vif-deleted-d64749f4-bad0-4ccf-909f-7ff29f90d6fa {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-4fe476e5-605e-4480-b6e1-bea5606d6ac7 req-33c3b9c7-1735-40f8-b53b-c23b9d3f7b9a service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Received event network-vif-plugged-d64749f4-bad0-4ccf-909f-7ff29f90d6fa {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4fe476e5-605e-4480-b6e1-bea5606d6ac7 req-33c3b9c7-1735-40f8-b53b-c23b9d3f7b9a service nova] Acquiring lock "28e28c32-bab9-4e3e-9584-4db17d4375a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4fe476e5-605e-4480-b6e1-bea5606d6ac7 req-33c3b9c7-1735-40f8-b53b-c23b9d3f7b9a service nova] Lock "28e28c32-bab9-4e3e-9584-4db17d4375a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-4fe476e5-605e-4480-b6e1-bea5606d6ac7 req-33c3b9c7-1735-40f8-b53b-c23b9d3f7b9a service nova] Lock "28e28c32-bab9-4e3e-9584-4db17d4375a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG nova.compute.manager [req-4fe476e5-605e-4480-b6e1-bea5606d6ac7 req-33c3b9c7-1735-40f8-b53b-c23b9d3f7b9a service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] No waiting events found dispatching network-vif-plugged-d64749f4-bad0-4ccf-909f-7ff29f90d6fa {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:20:14 user nova-compute[75378]: WARNING nova.compute.manager [req-4fe476e5-605e-4480-b6e1-bea5606d6ac7 req-33c3b9c7-1735-40f8-b53b-c23b9d3f7b9a service nova] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Received unexpected event network-vif-plugged-d64749f4-bad0-4ccf-909f-7ff29f90d6fa for instance with vm_state active and task_state deleting.
Nov 09 04:20:14 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1814a4d1-29cc-43d6-b1f0-2d4c2098d411 is timed out.
Nov 09 04:20:14 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Successfully detached device vdb from instance 1814a4d1-29cc-43d6-b1f0-2d4c2098d411 from the live domain config.
Nov 09 04:20:14 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTcxjwOh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:20:14 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:20:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf1b823-d3f8-4758-a33f-de98262cb841]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 04:20:14 user nova-compute[75378]: No targets found.
Nov 09 04:20:14 user nova-compute[75378]: iSNS:
Nov 09 04:20:14 user nova-compute[75378]: No targets found.
Nov 09 04:20:14 user nova-compute[75378]: STATIC:
Nov 09 04:20:14 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb
Nov 09 04:20:14 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:20:14 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:20:14 user nova-compute[75378]: FIRMWARE:
Nov 09 04:20:14 user nova-compute[75378]: No targets found.
Nov 09 04:20:14 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 04:20:14 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 04:20:14 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e90a91f-2cac-4659-b7ef-92a7ca43f0dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[692b465a-e943-4704-8573-398ca749c738]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb (non-flash)
Nov 09 04:20:14 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb (non-flash)
Nov 09 04:20:14 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c501ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb'): ({'sdc'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Removing single pathed devices sdc {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee51404-bbda-4e59-a527-ee6de0d89b61]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[559c34fe-e3ea-4446-b3a5-49450c7e22b2]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Flushing IO for device /dev/sdc {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 04:20:14 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[69304fbf-b7a8-4e06-8fa0-56f718730491]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c78d56-a6cd-478e-9c52-24d2867f928b]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] SCSI volumes sdc have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee91daf-1328-4271-96b1-93dd9b615d01]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab31c0a-b14b-4a4b-81fc-dfd3d2a18da7]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb, portal: 172.16.0.220,3260]
Nov 09 04:20:15 user nova-compute[75378]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb, portal: 172.16.0.220,3260] successful.
Nov 09 04:20:15 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8b6fe73-48bd-4bd3-9f1d-8cc2e47e02bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3a250a-923c-4e0d-ad2e-a425eb7c9f23]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] <== disconnect_volume: return (318ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 04:20:15 user nova-compute[75378]: INFO nova.compute.manager [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 28e28c32-bab9-4e3e-9584-4db17d4375a2] Took 1.10 seconds to detach 1 volumes for instance.
Nov 09 04:20:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:20:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:20:15 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Deleted allocations for instance 28e28c32-bab9-4e3e-9584-4db17d4375a2
Nov 09 04:20:15 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4d677493-d20d-4b66-817a-07ed87b65e67 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "28e28c32-bab9-4e3e-9584-4db17d4375a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.358s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:20:16 user nova-compute[75378]: DEBUG nova.objects.instance [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lazy-loading 'flavor' on Instance uuid 1814a4d1-29cc-43d6-b1f0-2d4c2098d411 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:20:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-5e9111e2-99f8-47ad-8673-59aac2534076 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.899s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:20:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:20:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:20:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:20:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "9c3afa94-f203-4c45-a755-02446b204d12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:20:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "9c3afa94-f203-4c45-a755-02446b204d12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:20:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "9c3afa94-f203-4c45-a755-02446b204d12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:20:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "9c3afa94-f203-4c45-a755-02446b204d12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:20:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "9c3afa94-f203-4c45-a755-02446b204d12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:20:40 user nova-compute[75378]: INFO nova.compute.manager [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Terminating instance
Nov 09 04:20:40 user nova-compute[75378]: DEBUG nova.compute.manager [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:20:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:40 user nova-compute[75378]: DEBUG nova.compute.manager [req-3d557d4e-c66b-4a65-8e1f-84f9c5d86b92 req-8b571876-661f-4897-9fa5-3b90cfe99de7 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Received event network-vif-unplugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:20:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3d557d4e-c66b-4a65-8e1f-84f9c5d86b92 req-8b571876-661f-4897-9fa5-3b90cfe99de7 service nova] Acquiring lock "9c3afa94-f203-4c45-a755-02446b204d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:20:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3d557d4e-c66b-4a65-8e1f-84f9c5d86b92 req-8b571876-661f-4897-9fa5-3b90cfe99de7 service nova] Lock "9c3afa94-f203-4c45-a755-02446b204d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:20:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3d557d4e-c66b-4a65-8e1f-84f9c5d86b92 req-8b571876-661f-4897-9fa5-3b90cfe99de7 service nova] Lock "9c3afa94-f203-4c45-a755-02446b204d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:20:40 user nova-compute[75378]: DEBUG nova.compute.manager [req-3d557d4e-c66b-4a65-8e1f-84f9c5d86b92 req-8b571876-661f-4897-9fa5-3b90cfe99de7 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] No waiting events found dispatching network-vif-unplugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:20:40 user nova-compute[75378]: DEBUG nova.compute.manager [req-3d557d4e-c66b-4a65-8e1f-84f9c5d86b92 req-8b571876-661f-4897-9fa5-3b90cfe99de7 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Received event network-vif-unplugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:20:41 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Instance destroyed successfully.
Nov 09 04:20:41 user nova-compute[75378]: DEBUG nova.objects.instance [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lazy-loading 'resources' on Instance uuid 9c3afa94-f203-4c45-a755-02446b204d12 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:20:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T04:14:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1522830695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1522830695',id=48,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAmgkujsPpH7HS3IfPd/IJr2Mwu+TD3ob2qBckpyvhkAbUU6mRoar3gGTBn3TPuRspVvUQ+rdPDSBl9uy14S7ZgIiIOi9OtsnMceYEsI4if1aziXJzhOl3Kw1wSzP97bA==',key_name='tempest-keypair-1381306586',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:19:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c5788a86f2c4fcab582d65b471fe27e',ramdisk_id='',reservation_id='r-j3uvi7ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1244090539',owner_user_name='tempest-AttachVolumeShelveTestJSON-1244090539-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T04:19:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f996e26d3a04dd8ba5a64eaa218a9b3',uuid=9c3afa94-f203-4c45-a755-02446b204d12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:20:41 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converting VIF {"id": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "address": "fa:16:3e:6c:9e:dd", "network": {"id": "7d81fea4-17bc-4e4c-bd27-c9630f6d47a9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-403837992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c5788a86f2c4fcab582d65b471fe27e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap460e9a5d-f9", "ovs_interfaceid": "460e9a5d-f97c-41cd-9b47-f89ba0adc605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:20:41 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:9e:dd,bridge_name='br-int',has_traffic_filtering=True,id=460e9a5d-f97c-41cd-9b47-f89ba0adc605,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460e9a5d-f9') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:20:41 user nova-compute[75378]: DEBUG os_vif [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:9e:dd,bridge_name='br-int',has_traffic_filtering=True,id=460e9a5d-f97c-41cd-9b47-f89ba0adc605,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460e9a5d-f9') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:20:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap460e9a5d-f9, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:20:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:20:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=328815de-6a52-46a8-8ed4-b010aa1082f8) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:20:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:20:41 user nova-compute[75378]: INFO os_vif [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:9e:dd,bridge_name='br-int',has_traffic_filtering=True,id=460e9a5d-f97c-41cd-9b47-f89ba0adc605,network=Network(7d81fea4-17bc-4e4c-bd27-c9630f6d47a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap460e9a5d-f9')
Nov 09 04:20:41 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Deleting instance files /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12_del
Nov 09 04:20:41 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Deletion of /opt/stack/data/nova/instances/9c3afa94-f203-4c45-a755-02446b204d12_del complete
Nov 09 04:20:41 user nova-compute[75378]: INFO nova.compute.manager [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 09 04:20:41 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:20:41 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:20:41 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:20:42 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:20:42 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Took 0.71 seconds to deallocate network for instance.
Nov 09 04:20:42 user nova-compute[75378]: DEBUG nova.compute.manager [req-9c4963a0-75d2-4823-beca-998fe399523b req-d86ae558-b667-44ff-8d09-1ad128f11dfa service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Received event network-vif-deleted-460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:20:42 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:20:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:20:42 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:20:42 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:20:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:20:42 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Deleted allocations for instance 9c3afa94-f203-4c45-a755-02446b204d12
Nov 09 04:20:42 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-c49f97af-3d47-4020-a9b5-f8d005c28eda tempest-AttachVolumeShelveTestJSON-1244090539 tempest-AttachVolumeShelveTestJSON-1244090539-project-member] Lock "9c3afa94-f203-4c45-a755-02446b204d12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.945s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:20:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-ceb66050-abea-4e71-baf0-36721b8b31f3 req-9907e368-1d99-4668-982a-436aee59ec99 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Received event network-vif-plugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:20:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ceb66050-abea-4e71-baf0-36721b8b31f3 req-9907e368-1d99-4668-982a-436aee59ec99 service nova] Acquiring lock "9c3afa94-f203-4c45-a755-02446b204d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:20:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ceb66050-abea-4e71-baf0-36721b8b31f3 req-9907e368-1d99-4668-982a-436aee59ec99 service nova] Lock "9c3afa94-f203-4c45-a755-02446b204d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:20:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ceb66050-abea-4e71-baf0-36721b8b31f3 req-9907e368-1d99-4668-982a-436aee59ec99 service nova] Lock "9c3afa94-f203-4c45-a755-02446b204d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:20:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-ceb66050-abea-4e71-baf0-36721b8b31f3 req-9907e368-1d99-4668-982a-436aee59ec99 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] No waiting events found dispatching network-vif-plugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:20:43 user nova-compute[75378]: WARNING nova.compute.manager [req-ceb66050-abea-4e71-baf0-36721b8b31f3 req-9907e368-1d99-4668-982a-436aee59ec99 service nova] [instance: 9c3afa94-f203-4c45-a755-02446b204d12] Received unexpected event network-vif-plugged-460e9a5d-f97c-41cd-9b47-f89ba0adc605 for instance with vm_state deleted and task_state None.
Nov 09 04:20:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-39cebad9-561f-477e-a328-4a028777c666 req-51b8f29c-db5b-4379-8104-d47c33a2f3e2 service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Received event network-changed-6d717eba-e166-4f12-a8d0-76a407144f95 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-39cebad9-561f-477e-a328-4a028777c666 req-51b8f29c-db5b-4379-8104-d47c33a2f3e2 service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Refreshing instance network info cache due to event network-changed-6d717eba-e166-4f12-a8d0-76a407144f95. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-39cebad9-561f-477e-a328-4a028777c666 req-51b8f29c-db5b-4379-8104-d47c33a2f3e2 service nova] Acquiring lock "refresh_cache-1814a4d1-29cc-43d6-b1f0-2d4c2098d411" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-39cebad9-561f-477e-a328-4a028777c666 req-51b8f29c-db5b-4379-8104-d47c33a2f3e2 service nova] Acquired lock "refresh_cache-1814a4d1-29cc-43d6-b1f0-2d4c2098d411" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG nova.network.neutron [req-39cebad9-561f-477e-a328-4a028777c666 req-51b8f29c-db5b-4379-8104-d47c33a2f3e2 service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Refreshing network info cache for port 6d717eba-e166-4f12-a8d0-76a407144f95 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:20:45 user nova-compute[75378]: INFO nova.compute.manager [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Terminating instance
Nov 09 04:20:45 user nova-compute[75378]: DEBUG nova.compute.manager [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-fe9987fa-2588-4df1-bd6a-46bbbcf1d19d req-57745a69-1597-4a9d-b64c-5db273ce9632 service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Received event network-vif-unplugged-6d717eba-e166-4f12-a8d0-76a407144f95 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-fe9987fa-2588-4df1-bd6a-46bbbcf1d19d req-57745a69-1597-4a9d-b64c-5db273ce9632 service nova] Acquiring lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-fe9987fa-2588-4df1-bd6a-46bbbcf1d19d req-57745a69-1597-4a9d-b64c-5db273ce9632 service nova] Lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-fe9987fa-2588-4df1-bd6a-46bbbcf1d19d req-57745a69-1597-4a9d-b64c-5db273ce9632 service nova] Lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-fe9987fa-2588-4df1-bd6a-46bbbcf1d19d req-57745a69-1597-4a9d-b64c-5db273ce9632 service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] No waiting events found dispatching network-vif-unplugged-6d717eba-e166-4f12-a8d0-76a407144f95 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-fe9987fa-2588-4df1-bd6a-46bbbcf1d19d req-57745a69-1597-4a9d-b64c-5db273ce9632 service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Received event network-vif-unplugged-6d717eba-e166-4f12-a8d0-76a407144f95 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG nova.network.neutron [req-39cebad9-561f-477e-a328-4a028777c666 req-51b8f29c-db5b-4379-8104-d47c33a2f3e2 service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Updated VIF entry in instance network info cache for port 6d717eba-e166-4f12-a8d0-76a407144f95. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG nova.network.neutron [req-39cebad9-561f-477e-a328-4a028777c666 req-51b8f29c-db5b-4379-8104-d47c33a2f3e2 service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Updating instance_info_cache with network_info: [{"id": "6d717eba-e166-4f12-a8d0-76a407144f95", "address": "fa:16:3e:2e:86:00", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d717eba-e1", "ovs_interfaceid": "6d717eba-e166-4f12-a8d0-76a407144f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-39cebad9-561f-477e-a328-4a028777c666 req-51b8f29c-db5b-4379-8104-d47c33a2f3e2 service nova] Releasing lock "refresh_cache-1814a4d1-29cc-43d6-b1f0-2d4c2098d411" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:45 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Instance destroyed successfully.
Nov 09 04:20:45 user nova-compute[75378]: DEBUG nova.objects.instance [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lazy-loading 'resources' on Instance uuid 1814a4d1-29cc-43d6-b1f0-2d4c2098d411 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:17:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1246017334',display_name='tempest-TestStampPattern-server-1246017334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1246017334',id=49,image_ref='4cc38938-62b8-4ea8-8035-1863d32dbf08',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdSgjDyj3H0LIu1u2r//kjG1Z/kJV/2D9kHnyqGf+23Yh1IXJheit8b0DpysYeACB7JwG5OcFZYK6MPjM1Qc7O4TA+G/vX1U0avmELYZy8D9iV/yA0LiISJ8RtiQ14fQg==',key_name='tempest-TestStampPattern-1317567266',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:17:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='987017c936a547f09de17b5a724d6694',ramdisk_id='',reservation_id='r-hhs4co85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='42e015a5-b160-4b15-829b-3cab96075d6f',image_min_disk='1',image_min_ram='0',image_owner_id='987017c936a547f09de17b5a724d6694',image_owner_project_name='tempest-TestStampPattern-1195876613',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1195876613-project-member',image_user_id='81d9391c05f24db4874155808fac2b67',owner_project_name='tempest-TestStampPattern-1195876613',owner_user_name='tempest-TestStampPattern-1195876613-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T04:17:42Z,user_data=None,user_id='81d9391c05f24db4874155808fac2b67',uuid=1814a4d1-29cc-43d6-b1f0-2d4c2098d411,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d717eba-e166-4f12-a8d0-76a407144f95", "address": "fa:16:3e:2e:86:00", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d717eba-e1", "ovs_interfaceid": "6d717eba-e166-4f12-a8d0-76a407144f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Converting VIF {"id": "6d717eba-e166-4f12-a8d0-76a407144f95", "address": "fa:16:3e:2e:86:00", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d717eba-e1", "ovs_interfaceid": "6d717eba-e166-4f12-a8d0-76a407144f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:20:45 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:86:00,bridge_name='br-int',has_traffic_filtering=True,id=6d717eba-e166-4f12-a8d0-76a407144f95,network=Network(10df6958-101d-4086-b128-51b210209887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d717eba-e1') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:20:46 user nova-compute[75378]: DEBUG os_vif [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:86:00,bridge_name='br-int',has_traffic_filtering=True,id=6d717eba-e166-4f12-a8d0-76a407144f95,network=Network(10df6958-101d-4086-b128-51b210209887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d717eba-e1') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:20:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d717eba-e1, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:20:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:20:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ff685e0-5dba-497e-bc74-775727287005) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:20:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:20:46 user nova-compute[75378]: INFO os_vif [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:86:00,bridge_name='br-int',has_traffic_filtering=True,id=6d717eba-e166-4f12-a8d0-76a407144f95,network=Network(10df6958-101d-4086-b128-51b210209887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d717eba-e1')
Nov 09 04:20:46 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Deleting instance files /opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411_del
Nov 09 04:20:46 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Deletion of /opt/stack/data/nova/instances/1814a4d1-29cc-43d6-b1f0-2d4c2098d411_del complete
Nov 09 04:20:46 user nova-compute[75378]: INFO nova.compute.manager [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 09 04:20:46 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:20:46 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:20:46 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:20:46 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:20:46 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Took 0.52 seconds to deallocate network for instance.
Nov 09 04:20:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:20:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:20:46 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:20:46 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:20:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:20:46 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Deleted allocations for instance 1814a4d1-29cc-43d6-b1f0-2d4c2098d411
Nov 09 04:20:46 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-1162ecdd-0780-418b-8978-6952706762ab tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.730s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:20:47 user nova-compute[75378]: DEBUG nova.compute.manager [req-a08428c2-6810-4c51-b407-5207feb6bb73 req-c5fbdd8c-1cdc-44f9-aa6d-027eff9223fd service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Received event network-vif-plugged-6d717eba-e166-4f12-a8d0-76a407144f95 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:20:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a08428c2-6810-4c51-b407-5207feb6bb73 req-c5fbdd8c-1cdc-44f9-aa6d-027eff9223fd service nova] Acquiring lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:20:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a08428c2-6810-4c51-b407-5207feb6bb73 req-c5fbdd8c-1cdc-44f9-aa6d-027eff9223fd service nova] Lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:20:47 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-a08428c2-6810-4c51-b407-5207feb6bb73 req-c5fbdd8c-1cdc-44f9-aa6d-027eff9223fd service nova] Lock "1814a4d1-29cc-43d6-b1f0-2d4c2098d411-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:20:47 user nova-compute[75378]: DEBUG nova.compute.manager [req-a08428c2-6810-4c51-b407-5207feb6bb73 req-c5fbdd8c-1cdc-44f9-aa6d-027eff9223fd service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] No waiting events found dispatching network-vif-plugged-6d717eba-e166-4f12-a8d0-76a407144f95 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:20:47 user nova-compute[75378]: WARNING nova.compute.manager [req-a08428c2-6810-4c51-b407-5207feb6bb73 req-c5fbdd8c-1cdc-44f9-aa6d-027eff9223fd service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Received unexpected event network-vif-plugged-6d717eba-e166-4f12-a8d0-76a407144f95 for instance with vm_state deleted and task_state None.
Nov 09 04:20:47 user nova-compute[75378]: DEBUG nova.compute.manager [req-a08428c2-6810-4c51-b407-5207feb6bb73 req-c5fbdd8c-1cdc-44f9-aa6d-027eff9223fd service nova] [instance: 1814a4d1-29cc-43d6-b1f0-2d4c2098d411] Received event network-vif-deleted-6d717eba-e166-4f12-a8d0-76a407144f95 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:20:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:20:57 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:20:57 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:20:57 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Didn't find any instances for network info cache update. {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 04:20:57 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:20:57 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:20:57 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:20:59 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:21:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:01 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:21:02 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:21:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:21:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:21:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:21:02 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:21:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:21:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:21:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:21:02 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:21:02 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:21:02 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:21:02 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8855MB free_disk=24.98862075805664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:21:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:21:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:21:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 42e015a5-b160-4b15-829b-3cab96075d6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:21:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:21:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:21:03 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:21:03 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:21:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:21:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:21:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:21:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:21:03 user nova-compute[75378]: DEBUG nova.compute.manager [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 04:21:04 user nova-compute[75378]: INFO nova.compute.claims [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Claim successful on node user
Nov 09 04:21:04 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG nova.compute.manager [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG nova.compute.manager [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG nova.network.neutron [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 04:21:04 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 04:21:04 user nova-compute[75378]: DEBUG nova.compute.manager [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG nova.policy [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23b841529aaf42c29a442ef9524422b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5a4bfe6ce546d2acfbf7be75334d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 04:21:04 user nova-compute[75378]: INFO nova.virt.block_device [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Booting with volume e07bcfba-dc74-4540-bc64-9e08f3eb8654 at /dev/vda
Nov 09 04:21:04 user nova-compute[75378]: DEBUG os_brick.utils [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d298a408-dea8-4963-bad8-17e1f327aacb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cced187-da20-4cea-a65c-62a3ce345e3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2a3b86-ea6f-478a-81c6-2924ec68bf6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8619c800-3f5e-4697-90ed-0b03fe7f2348]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:21:04 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 04:21:04 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[860c899b-3eab-48ec-be4a-abbf6003e421]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG os_brick.utils [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:21:04 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Updating existing volume attachment record: 50e1f5f5-6336-4c90-b54f-b810365921b2 {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 04:21:05 user nova-compute[75378]: DEBUG nova.network.neutron [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Successfully created port: d8def4ce-2a93-4f67-a5b8-6e16ed28596f {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 04:21:05 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG nova.network.neutron [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Successfully updated port: d8def4ce-2a93-4f67-a5b8-6e16ed28596f {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "refresh_cache-d9f6a6a9-e5bc-4174-be32-74d08af8cab8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquired lock "refresh_cache-d9f6a6a9-e5bc-4174-be32-74d08af8cab8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG nova.network.neutron [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-22974988-3550-4d0a-970c-e2495a0be991 req-1e425b75-1f4e-4c39-a385-c83df64ce822 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Received event network-changed-d8def4ce-2a93-4f67-a5b8-6e16ed28596f {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG nova.compute.manager [req-22974988-3550-4d0a-970c-e2495a0be991 req-1e425b75-1f4e-4c39-a385-c83df64ce822 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Refreshing instance network info cache due to event network-changed-d8def4ce-2a93-4f67-a5b8-6e16ed28596f. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-22974988-3550-4d0a-970c-e2495a0be991 req-1e425b75-1f4e-4c39-a385-c83df64ce822 service nova] Acquiring lock "refresh_cache-d9f6a6a9-e5bc-4174-be32-74d08af8cab8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG nova.network.neutron [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG nova.network.neutron [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Updating instance_info_cache with network_info: [{"id": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "address": "fa:16:3e:94:bc:e9", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8def4ce-2a", "ovs_interfaceid": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Releasing lock "refresh_cache-d9f6a6a9-e5bc-4174-be32-74d08af8cab8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG nova.compute.manager [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Instance network_info: |[{"id": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "address": "fa:16:3e:94:bc:e9", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8def4ce-2a", "ovs_interfaceid": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-22974988-3550-4d0a-970c-e2495a0be991 req-1e425b75-1f4e-4c39-a385-c83df64ce822 service nova] Acquired lock "refresh_cache-d9f6a6a9-e5bc-4174-be32-74d08af8cab8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG nova.network.neutron [req-22974988-3550-4d0a-970c-e2495a0be991 req-1e425b75-1f4e-4c39-a385-c83df64ce822 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Refreshing network info cache for port d8def4ce-2a93-4f67-a5b8-6e16ed28596f {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG nova.network.neutron [req-22974988-3550-4d0a-970c-e2495a0be991 req-1e425b75-1f4e-4c39-a385-c83df64ce822 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Updated VIF entry in instance network info cache for port d8def4ce-2a93-4f67-a5b8-6e16ed28596f. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG nova.network.neutron [req-22974988-3550-4d0a-970c-e2495a0be991 req-1e425b75-1f4e-4c39-a385-c83df64ce822 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Updating instance_info_cache with network_info: [{"id": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "address": "fa:16:3e:94:bc:e9", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8def4ce-2a", "ovs_interfaceid": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:21:06 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-22974988-3550-4d0a-970c-e2495a0be991 req-1e425b75-1f4e-4c39-a385-c83df64ce822 service nova] Releasing lock "refresh_cache-d9f6a6a9-e5bc-4174-be32-74d08af8cab8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:21:07 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:21:09 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:21:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:21:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:21:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:21:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:21:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.compute.manager [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 04:21:26 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Creating image(s)
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Did not create local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Ensure instance console log exists: /opt/stack/data/nova/instances/d9f6a6a9-e5bc-4174-be32-74d08af8cab8/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Start _get_guest_xml network_info=[{"id": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "address": "fa:16:3e:94:bc:e9", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8def4ce-2a", "ovs_interfaceid": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHaudejw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd9f6a6a9-e5bc-4174-be32-74d08af8cab8', 'attached_at': '', 'detached_at': '', 'volume_id': 'e07bcfba-dc74-4540-bc64-9e08f3eb8654', 'serial': 'e07bcfba-dc74-4540-bc64-9e08f3eb8654'}, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': '50e1f5f5-6336-4c90-b54f-b810365921b2', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 04:21:26 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:21:26 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHaudejw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:21:26 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:21:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:21:26 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:21:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:21:26 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[365e429a-a9f8-4bf4-90e2-98c80964cbfe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 04:21:26 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1123931f-3932-48eb-abda-51a337199247]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654] added
Nov 09 04:21:26 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c98d9b5-34fb-4c89-96bd-e7b321c62b30]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[31caf7b3-e3b5-489e-861c-fa380ecd7f54]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MHaudejw {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MHaudejw" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f211f9ca-c780-4f68-b8a6-01829222802c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MHaudejw'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8df71de-31f6-46c5-b205-eb6b56e40482]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a83ddb4-5989-4615-9217-053b4ab51839]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 04:21:26 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 04:21:26 user nova-compute[75378]:  {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:21:26 user nova-compute[75378]: WARNING os_brick.initiator.connectors.iscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 04:21:26 user nova-compute[75378]: 
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2305991-9334-494d-900d-32c0246dda59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654, portal: 172.16.0.220,3260]
Nov 09 04:21:26 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654, portal: 172.16.0.220,3260] successful.
Nov 09 04:21:26 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ab2d50-81b3-438f-9162-75edb6c3c1cd]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cce463-3d3e-460c-9d8a-d7177e53b91f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)
Nov 09 04:21:26 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)
Nov 09 04:21:26 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 04:21:26 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:21:27 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:21:27 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bd5a3b-c5a5-4439-a3f5-eee6cc6cf5b4]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:21:27 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:21:27 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHaudejw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26235666631613433', 'path': '/dev/sdb'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235666631613433', 'path': '/dev/sdb'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1873937445',display_name='tempest-TestVolumeBootPattern-server-1873937445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1873937445',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIi6MoXfdtoHEdwPWb+lWBCIxxkWR94j+DvoRNdiCeJq2S7kvIBHTpDH0k237JeK83nJZ3VdWHYahvDy+qLUM0dmkr7n9qytWZXFGwnMeX/Mols0eY6D/GRmBaaR1kjt8w==',key_name='tempest-TestVolumeBootPattern-1437224047',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed5a4bfe6ce546d2acfbf7be75334d1a',ramdisk_id='',reservation_id='r-xy09m7f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1436829014',owner_user_name='tempest-TestVolumeBootPattern-1436829014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:21:04Z,user_data=None,user_id='23b841529aaf42c29a442ef9524422b2',uuid=d9f6a6a9-e5bc-4174-be32-74d08af8cab8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "address": "fa:16:3e:94:bc:e9", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8def4ce-2a", "ovs_interfaceid": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converting VIF {"id": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "address": "fa:16:3e:94:bc:e9", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8def4ce-2a", "ovs_interfaceid": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:bc:e9,bridge_name='br-int',has_traffic_filtering=True,id=d8def4ce-2a93-4f67-a5b8-6e16ed28596f,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8def4ce-2a') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG nova.objects.instance [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lazy-loading 'pci_devices' on Instance uuid d9f6a6a9-e5bc-4174-be32-74d08af8cab8 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] End _get_guest_xml xml=<domain type="kvm">
Nov 09 04:21:28 user nova-compute[75378]:   <uuid>d9f6a6a9-e5bc-4174-be32-74d08af8cab8</uuid>
Nov 09 04:21:28 user nova-compute[75378]:   <name>instance-00000033</name>
Nov 09 04:21:28 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 04:21:28 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 04:21:28 user nova-compute[75378]:   <metadata>
Nov 09 04:21:28 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 04:21:28 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 04:21:28 user nova-compute[75378]:       <nova:name>tempest-TestVolumeBootPattern-server-1873937445</nova:name>
Nov 09 04:21:28 user nova-compute[75378]:       <nova:creationTime>2023-11-09 04:21:26</nova:creationTime>
Nov 09 04:21:28 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 04:21:28 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 04:21:28 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 04:21:28 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 04:21:28 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 04:21:28 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 04:21:28 user nova-compute[75378]:       </nova:flavor>
Nov 09 04:21:28 user nova-compute[75378]:       <nova:owner>
Nov 09 04:21:28 user nova-compute[75378]:         <nova:user uuid="23b841529aaf42c29a442ef9524422b2">tempest-TestVolumeBootPattern-1436829014-project-member</nova:user>
Nov 09 04:21:28 user nova-compute[75378]:         <nova:project uuid="ed5a4bfe6ce546d2acfbf7be75334d1a">tempest-TestVolumeBootPattern-1436829014</nova:project>
Nov 09 04:21:28 user nova-compute[75378]:       </nova:owner>
Nov 09 04:21:28 user nova-compute[75378]:       <nova:ports>
Nov 09 04:21:28 user nova-compute[75378]:         <nova:port uuid="d8def4ce-2a93-4f67-a5b8-6e16ed28596f">
Nov 09 04:21:28 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 04:21:28 user nova-compute[75378]:         </nova:port>
Nov 09 04:21:28 user nova-compute[75378]:       </nova:ports>
Nov 09 04:21:28 user nova-compute[75378]:     </nova:instance>
Nov 09 04:21:28 user nova-compute[75378]:   </metadata>
Nov 09 04:21:28 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 04:21:28 user nova-compute[75378]:     <system>
Nov 09 04:21:28 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 04:21:28 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 04:21:28 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 04:21:28 user nova-compute[75378]:       <entry name="serial">d9f6a6a9-e5bc-4174-be32-74d08af8cab8</entry>
Nov 09 04:21:28 user nova-compute[75378]:       <entry name="uuid">d9f6a6a9-e5bc-4174-be32-74d08af8cab8</entry>
Nov 09 04:21:28 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 04:21:28 user nova-compute[75378]:     </system>
Nov 09 04:21:28 user nova-compute[75378]:   </sysinfo>
Nov 09 04:21:28 user nova-compute[75378]:   <os>
Nov 09 04:21:28 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 04:21:28 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 04:21:28 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 04:21:28 user nova-compute[75378]:   </os>
Nov 09 04:21:28 user nova-compute[75378]:   <features>
Nov 09 04:21:28 user nova-compute[75378]:     <acpi/>
Nov 09 04:21:28 user nova-compute[75378]:     <apic/>
Nov 09 04:21:28 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 04:21:28 user nova-compute[75378]:   </features>
Nov 09 04:21:28 user nova-compute[75378]:   <clock offset="utc">
Nov 09 04:21:28 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 04:21:28 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 04:21:28 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 04:21:28 user nova-compute[75378]:   </clock>
Nov 09 04:21:28 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 04:21:28 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 04:21:28 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 04:21:28 user nova-compute[75378]:   </cpu>
Nov 09 04:21:28 user nova-compute[75378]:   <devices>
Nov 09 04:21:28 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 04:21:28 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:21:28 user nova-compute[75378]:       <source dev="/dev/sdb"/>
Nov 09 04:21:28 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 04:21:28 user nova-compute[75378]:       <serial>e07bcfba-dc74-4540-bc64-9e08f3eb8654</serial>
Nov 09 04:21:28 user nova-compute[75378]:     </disk>
Nov 09 04:21:28 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 04:21:28 user nova-compute[75378]:       <mac address="fa:16:3e:94:bc:e9"/>
Nov 09 04:21:28 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:21:28 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 04:21:28 user nova-compute[75378]:       <target dev="tapd8def4ce-2a"/>
Nov 09 04:21:28 user nova-compute[75378]:     </interface>
Nov 09 04:21:28 user nova-compute[75378]:     <serial type="pty">
Nov 09 04:21:28 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/d9f6a6a9-e5bc-4174-be32-74d08af8cab8/console.log" append="off"/>
Nov 09 04:21:28 user nova-compute[75378]:     </serial>
Nov 09 04:21:28 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 04:21:28 user nova-compute[75378]:     <video>
Nov 09 04:21:28 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:21:28 user nova-compute[75378]:     </video>
Nov 09 04:21:28 user nova-compute[75378]:     <rng model="virtio">
Nov 09 04:21:28 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 04:21:28 user nova-compute[75378]:     </rng>
Nov 09 04:21:28 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 04:21:28 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 04:21:28 user nova-compute[75378]:       <stats period="10"/>
Nov 09 04:21:28 user nova-compute[75378]:     </memballoon>
Nov 09 04:21:28 user nova-compute[75378]:   </devices>
Nov 09 04:21:28 user nova-compute[75378]: </domain>
Nov 09 04:21:28 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1873937445',display_name='tempest-TestVolumeBootPattern-server-1873937445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1873937445',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIi6MoXfdtoHEdwPWb+lWBCIxxkWR94j+DvoRNdiCeJq2S7kvIBHTpDH0k237JeK83nJZ3VdWHYahvDy+qLUM0dmkr7n9qytWZXFGwnMeX/Mols0eY6D/GRmBaaR1kjt8w==',key_name='tempest-TestVolumeBootPattern-1437224047',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed5a4bfe6ce546d2acfbf7be75334d1a',ramdisk_id='',reservation_id='r-xy09m7f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1436829014',owner_user_name='tempest-TestVolumeBootPattern-1436829014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:21:04Z,user_data=None,user_id='23b841529aaf42c29a442ef9524422b2',uuid=d9f6a6a9-e5bc-4174-be32-74d08af8cab8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "address": "fa:16:3e:94:bc:e9", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8def4ce-2a", "ovs_interfaceid": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converting VIF {"id": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "address": "fa:16:3e:94:bc:e9", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8def4ce-2a", "ovs_interfaceid": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:bc:e9,bridge_name='br-int',has_traffic_filtering=True,id=d8def4ce-2a93-4f67-a5b8-6e16ed28596f,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8def4ce-2a') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG os_vif [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:bc:e9,bridge_name='br-int',has_traffic_filtering=True,id=d8def4ce-2a93-4f67-a5b8-6e16ed28596f,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8def4ce-2a') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b7930f9-d8de-509a-8eea-2f0b310b3c40', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8def4ce-2a, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8def4ce-2a, col_values=(('qos', UUID('8ee610f7-4e9a-4cb7-bfa4-497f48003526')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8def4ce-2a, col_values=(('external_ids', {'iface-id': 'd8def4ce-2a93-4f67-a5b8-6e16ed28596f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:bc:e9', 'vm-uuid': 'd9f6a6a9-e5bc-4174-be32-74d08af8cab8'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:28 user nova-compute[75378]: INFO os_vif [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:bc:e9,bridge_name='br-int',has_traffic_filtering=True,id=d8def4ce-2a93-4f67-a5b8-6e16ed28596f,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8def4ce-2a')
Nov 09 04:21:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] No VIF found with MAC fa:16:3e:94:bc:e9, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:21:28 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:21:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-bd823553-3b6f-4048-9d4f-b1f23c5572f8 req-ff259b0b-b93d-43fc-94b1-ec34f209e895 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Received event network-vif-plugged-d8def4ce-2a93-4f67-a5b8-6e16ed28596f {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:21:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bd823553-3b6f-4048-9d4f-b1f23c5572f8 req-ff259b0b-b93d-43fc-94b1-ec34f209e895 service nova] Acquiring lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:21:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bd823553-3b6f-4048-9d4f-b1f23c5572f8 req-ff259b0b-b93d-43fc-94b1-ec34f209e895 service nova] Lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:21:29 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bd823553-3b6f-4048-9d4f-b1f23c5572f8 req-ff259b0b-b93d-43fc-94b1-ec34f209e895 service nova] Lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:21:29 user nova-compute[75378]: DEBUG nova.compute.manager [req-bd823553-3b6f-4048-9d4f-b1f23c5572f8 req-ff259b0b-b93d-43fc-94b1-ec34f209e895 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] No waiting events found dispatching network-vif-plugged-d8def4ce-2a93-4f67-a5b8-6e16ed28596f {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:21:29 user nova-compute[75378]: WARNING nova.compute.manager [req-bd823553-3b6f-4048-9d4f-b1f23c5572f8 req-ff259b0b-b93d-43fc-94b1-ec34f209e895 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Received unexpected event network-vif-plugged-d8def4ce-2a93-4f67-a5b8-6e16ed28596f for instance with vm_state building and task_state spawning.
Nov 09 04:21:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:31 user nova-compute[75378]: DEBUG nova.compute.manager [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 04:21:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 04:21:31 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Instance spawned successfully.
Nov 09 04:21:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 04:21:31 user nova-compute[75378]: DEBUG nova.compute.manager [req-0f28bc3f-3dfb-4598-a374-a9fa87f3e0cd req-b62a15cc-8d00-4607-97b6-7e936021ad60 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Received event network-vif-plugged-d8def4ce-2a93-4f67-a5b8-6e16ed28596f {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:21:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0f28bc3f-3dfb-4598-a374-a9fa87f3e0cd req-b62a15cc-8d00-4607-97b6-7e936021ad60 service nova] Acquiring lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:21:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0f28bc3f-3dfb-4598-a374-a9fa87f3e0cd req-b62a15cc-8d00-4607-97b6-7e936021ad60 service nova] Lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:21:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-0f28bc3f-3dfb-4598-a374-a9fa87f3e0cd req-b62a15cc-8d00-4607-97b6-7e936021ad60 service nova] Lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:21:31 user nova-compute[75378]: DEBUG nova.compute.manager [req-0f28bc3f-3dfb-4598-a374-a9fa87f3e0cd req-b62a15cc-8d00-4607-97b6-7e936021ad60 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] No waiting events found dispatching network-vif-plugged-d8def4ce-2a93-4f67-a5b8-6e16ed28596f {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:21:31 user nova-compute[75378]: WARNING nova.compute.manager [req-0f28bc3f-3dfb-4598-a374-a9fa87f3e0cd req-b62a15cc-8d00-4607-97b6-7e936021ad60 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Received unexpected event network-vif-plugged-d8def4ce-2a93-4f67-a5b8-6e16ed28596f for instance with vm_state building and task_state spawning.
Nov 09 04:21:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:21:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:21:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:21:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:21:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:21:31 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:21:31 user nova-compute[75378]: INFO nova.compute.manager [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 09 04:21:31 user nova-compute[75378]: DEBUG nova.compute.manager [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:21:31 user nova-compute[75378]: INFO nova.compute.manager [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Took 27.83 seconds to build instance.
Nov 09 04:21:31 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-cd8d8688-7fa2-446e-b895-eb116b79069a tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.921s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:21:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:21:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:21:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:21:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:21:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:52 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:57 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:21:57 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:21:57 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Rebuilding the list of instances to heal {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 04:21:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-42e015a5-b160-4b15-829b-3cab96075d6f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:21:57 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-42e015a5-b160-4b15-829b-3cab96075d6f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:21:57 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 04:21:57 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lazy-loading 'info_cache' on Instance uuid 42e015a5-b160-4b15-829b-3cab96075d6f {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:21:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:58 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Updating instance_info_cache with network_info: [{"id": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "address": "fa:16:3e:f7:b5:ff", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00629a2d-5f", "ovs_interfaceid": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:21:58 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-42e015a5-b160-4b15-829b-3cab96075d6f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:21:58 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 04:21:58 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:21:58 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:21:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:21:58 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:21:59 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG nova.compute.manager [req-998b5862-ae4e-4382-8b9a-4e045b910e66 req-a9153fe8-0107-4171-bd00-e21db4d8a5b8 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Received event network-changed-00629a2d-5f73-4c4a-b23b-95032fdbeb09 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG nova.compute.manager [req-998b5862-ae4e-4382-8b9a-4e045b910e66 req-a9153fe8-0107-4171-bd00-e21db4d8a5b8 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Refreshing instance network info cache due to event network-changed-00629a2d-5f73-4c4a-b23b-95032fdbeb09. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-998b5862-ae4e-4382-8b9a-4e045b910e66 req-a9153fe8-0107-4171-bd00-e21db4d8a5b8 service nova] Acquiring lock "refresh_cache-42e015a5-b160-4b15-829b-3cab96075d6f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-998b5862-ae4e-4382-8b9a-4e045b910e66 req-a9153fe8-0107-4171-bd00-e21db4d8a5b8 service nova] Acquired lock "refresh_cache-42e015a5-b160-4b15-829b-3cab96075d6f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG nova.network.neutron [req-998b5862-ae4e-4382-8b9a-4e045b910e66 req-a9153fe8-0107-4171-bd00-e21db4d8a5b8 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Refreshing network info cache for port 00629a2d-5f73-4c4a-b23b-95032fdbeb09 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "42e015a5-b160-4b15-829b-3cab96075d6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "42e015a5-b160-4b15-829b-3cab96075d6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "42e015a5-b160-4b15-829b-3cab96075d6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "42e015a5-b160-4b15-829b-3cab96075d6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "42e015a5-b160-4b15-829b-3cab96075d6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:22:02 user nova-compute[75378]: INFO nova.compute.manager [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Terminating instance
Nov 09 04:22:02 user nova-compute[75378]: DEBUG nova.compute.manager [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG nova.compute.manager [req-3a4257d7-6bf2-4c7a-8544-af0bf1faaced req-32954ec7-27ce-4413-b5ed-790877ad895f service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Received event network-vif-unplugged-00629a2d-5f73-4c4a-b23b-95032fdbeb09 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3a4257d7-6bf2-4c7a-8544-af0bf1faaced req-32954ec7-27ce-4413-b5ed-790877ad895f service nova] Acquiring lock "42e015a5-b160-4b15-829b-3cab96075d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3a4257d7-6bf2-4c7a-8544-af0bf1faaced req-32954ec7-27ce-4413-b5ed-790877ad895f service nova] Lock "42e015a5-b160-4b15-829b-3cab96075d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3a4257d7-6bf2-4c7a-8544-af0bf1faaced req-32954ec7-27ce-4413-b5ed-790877ad895f service nova] Lock "42e015a5-b160-4b15-829b-3cab96075d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG nova.compute.manager [req-3a4257d7-6bf2-4c7a-8544-af0bf1faaced req-32954ec7-27ce-4413-b5ed-790877ad895f service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] No waiting events found dispatching network-vif-unplugged-00629a2d-5f73-4c4a-b23b-95032fdbeb09 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG nova.compute.manager [req-3a4257d7-6bf2-4c7a-8544-af0bf1faaced req-32954ec7-27ce-4413-b5ed-790877ad895f service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Received event network-vif-unplugged-00629a2d-5f73-4c4a-b23b-95032fdbeb09 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG nova.network.neutron [req-998b5862-ae4e-4382-8b9a-4e045b910e66 req-a9153fe8-0107-4171-bd00-e21db4d8a5b8 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Updated VIF entry in instance network info cache for port 00629a2d-5f73-4c4a-b23b-95032fdbeb09. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG nova.network.neutron [req-998b5862-ae4e-4382-8b9a-4e045b910e66 req-a9153fe8-0107-4171-bd00-e21db4d8a5b8 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Updating instance_info_cache with network_info: [{"id": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "address": "fa:16:3e:f7:b5:ff", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00629a2d-5f", "ovs_interfaceid": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:22:02 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-998b5862-ae4e-4382-8b9a-4e045b910e66 req-a9153fe8-0107-4171-bd00-e21db4d8a5b8 service nova] Releasing lock "refresh_cache-42e015a5-b160-4b15-829b-3cab96075d6f" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:03 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Instance destroyed successfully.
Nov 09 04:22:03 user nova-compute[75378]: DEBUG nova.objects.instance [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lazy-loading 'resources' on Instance uuid 42e015a5-b160-4b15-829b-3cab96075d6f {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:14:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-336831372',display_name='tempest-TestStampPattern-server-336831372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-336831372',id=46,image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdSgjDyj3H0LIu1u2r//kjG1Z/kJV/2D9kHnyqGf+23Yh1IXJheit8b0DpysYeACB7JwG5OcFZYK6MPjM1Qc7O4TA+G/vX1U0avmELYZy8D9iV/yA0LiISJ8RtiQ14fQg==',key_name='tempest-TestStampPattern-1317567266',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:14:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='987017c936a547f09de17b5a724d6694',ramdisk_id='',reservation_id='r-ebtvw7cm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c162665b-54ae-441d-9cd1-28ea81cc5de8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1195876613',owner_user_name='tempest-TestStampPattern-1195876613-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T04:17:33Z,user_data=None,user_id='81d9391c05f24db4874155808fac2b67',uuid=42e015a5-b160-4b15-829b-3cab96075d6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "address": "fa:16:3e:f7:b5:ff", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00629a2d-5f", "ovs_interfaceid": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Converting VIF {"id": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "address": "fa:16:3e:f7:b5:ff", "network": {"id": "10df6958-101d-4086-b128-51b210209887", "bridge": "br-int", "label": "tempest-TestStampPattern-1420360774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "987017c936a547f09de17b5a724d6694", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00629a2d-5f", "ovs_interfaceid": "00629a2d-5f73-4c4a-b23b-95032fdbeb09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:b5:ff,bridge_name='br-int',has_traffic_filtering=True,id=00629a2d-5f73-4c4a-b23b-95032fdbeb09,network=Network(10df6958-101d-4086-b128-51b210209887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00629a2d-5f') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG os_vif [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:b5:ff,bridge_name='br-int',has_traffic_filtering=True,id=00629a2d-5f73-4c4a-b23b-95032fdbeb09,network=Network(10df6958-101d-4086-b128-51b210209887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00629a2d-5f') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00629a2d-5f, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90cb033a-9650-43e0-8327-e3dd5657f22e) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:22:03 user nova-compute[75378]: INFO os_vif [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:b5:ff,bridge_name='br-int',has_traffic_filtering=True,id=00629a2d-5f73-4c4a-b23b-95032fdbeb09,network=Network(10df6958-101d-4086-b128-51b210209887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00629a2d-5f')
Nov 09 04:22:03 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Deleting instance files /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f_del
Nov 09 04:22:03 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Deletion of /opt/stack/data/nova/instances/42e015a5-b160-4b15-829b-3cab96075d6f_del complete
Nov 09 04:22:03 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:22:03 user nova-compute[75378]: INFO nova.compute.manager [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 09 04:22:03 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:22:03 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Error from libvirt while getting description of instance-0000002e: [Error Code 42] Domain not found: no domain with matching uuid '42e015a5-b160-4b15-829b-3cab96075d6f' (instance-0000002e): libvirt.libvirtError: Domain not found: no domain with matching uuid '42e015a5-b160-4b15-829b-3cab96075d6f' (instance-0000002e)
Nov 09 04:22:03 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:22:03 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:22:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8800MB free_disk=25.111465454101562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 42e015a5-b160-4b15-829b-3cab96075d6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance d9f6a6a9-e5bc-4174-be32-74d08af8cab8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:22:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:22:04 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:22:04 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Took 0.84 seconds to deallocate network for instance.
Nov 09 04:22:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:22:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:22:04 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:22:04 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:22:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-5550be6a-68da-4249-b213-38b61970094e req-10754efc-a970-4682-afa9-7b1714131df5 service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Received event network-vif-deleted-00629a2d-5f73-4c4a-b23b-95032fdbeb09 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:22:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:22:04 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Deleted allocations for instance 42e015a5-b160-4b15-829b-3cab96075d6f
Nov 09 04:22:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-f233b86c-2e46-4ec8-9d49-757c70cb2d33 tempest-TestStampPattern-1195876613 tempest-TestStampPattern-1195876613-project-member] Lock "42e015a5-b160-4b15-829b-3cab96075d6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.091s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:22:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-96918b12-6a07-4881-b2d1-01d5d6ec34b1 req-a7191e56-aa5c-4108-857a-42a83192b20d service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Received event network-vif-plugged-00629a2d-5f73-4c4a-b23b-95032fdbeb09 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:22:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-96918b12-6a07-4881-b2d1-01d5d6ec34b1 req-a7191e56-aa5c-4108-857a-42a83192b20d service nova] Acquiring lock "42e015a5-b160-4b15-829b-3cab96075d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:22:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-96918b12-6a07-4881-b2d1-01d5d6ec34b1 req-a7191e56-aa5c-4108-857a-42a83192b20d service nova] Lock "42e015a5-b160-4b15-829b-3cab96075d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:22:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-96918b12-6a07-4881-b2d1-01d5d6ec34b1 req-a7191e56-aa5c-4108-857a-42a83192b20d service nova] Lock "42e015a5-b160-4b15-829b-3cab96075d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:22:04 user nova-compute[75378]: DEBUG nova.compute.manager [req-96918b12-6a07-4881-b2d1-01d5d6ec34b1 req-a7191e56-aa5c-4108-857a-42a83192b20d service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] No waiting events found dispatching network-vif-plugged-00629a2d-5f73-4c4a-b23b-95032fdbeb09 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:22:04 user nova-compute[75378]: WARNING nova.compute.manager [req-96918b12-6a07-4881-b2d1-01d5d6ec34b1 req-a7191e56-aa5c-4108-857a-42a83192b20d service nova] [instance: 42e015a5-b160-4b15-829b-3cab96075d6f] Received unexpected event network-vif-plugged-00629a2d-5f73-4c4a-b23b-95032fdbeb09 for instance with vm_state deleted and task_state None.
Nov 09 04:22:04 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:22:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:08 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:22:11 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:22:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:22:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:22:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:22:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:22:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:22:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:22:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:22:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:22:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:22:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:22:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:22:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:22:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:22:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:22:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:22:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:53 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-bf67da78-9827-4b76-a8a8-808b2254d803 req-38d0e706-13f4-4188-bba2-3966a0b26692 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Received event network-changed-d8def4ce-2a93-4f67-a5b8-6e16ed28596f {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:22:55 user nova-compute[75378]: DEBUG nova.compute.manager [req-bf67da78-9827-4b76-a8a8-808b2254d803 req-38d0e706-13f4-4188-bba2-3966a0b26692 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Refreshing instance network info cache due to event network-changed-d8def4ce-2a93-4f67-a5b8-6e16ed28596f. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:22:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bf67da78-9827-4b76-a8a8-808b2254d803 req-38d0e706-13f4-4188-bba2-3966a0b26692 service nova] Acquiring lock "refresh_cache-d9f6a6a9-e5bc-4174-be32-74d08af8cab8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:22:55 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bf67da78-9827-4b76-a8a8-808b2254d803 req-38d0e706-13f4-4188-bba2-3966a0b26692 service nova] Acquired lock "refresh_cache-d9f6a6a9-e5bc-4174-be32-74d08af8cab8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:22:55 user nova-compute[75378]: DEBUG nova.network.neutron [req-bf67da78-9827-4b76-a8a8-808b2254d803 req-38d0e706-13f4-4188-bba2-3966a0b26692 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Refreshing network info cache for port d8def4ce-2a93-4f67-a5b8-6e16ed28596f {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:22:56 user nova-compute[75378]: DEBUG nova.network.neutron [req-bf67da78-9827-4b76-a8a8-808b2254d803 req-38d0e706-13f4-4188-bba2-3966a0b26692 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Updated VIF entry in instance network info cache for port d8def4ce-2a93-4f67-a5b8-6e16ed28596f. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:22:56 user nova-compute[75378]: DEBUG nova.network.neutron [req-bf67da78-9827-4b76-a8a8-808b2254d803 req-38d0e706-13f4-4188-bba2-3966a0b26692 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Updating instance_info_cache with network_info: [{"id": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "address": "fa:16:3e:94:bc:e9", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8def4ce-2a", "ovs_interfaceid": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:22:56 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-bf67da78-9827-4b76-a8a8-808b2254d803 req-38d0e706-13f4-4188-bba2-3966a0b26692 service nova] Releasing lock "refresh_cache-d9f6a6a9-e5bc-4174-be32-74d08af8cab8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:22:57 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:22:57 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:22:57 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:58 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:22:58 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:22:59 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:22:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:22:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-d9f6a6a9-e5bc-4174-be32-74d08af8cab8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:22:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-d9f6a6a9-e5bc-4174-be32-74d08af8cab8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:22:59 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 04:22:59 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Updating instance_info_cache with network_info: [{"id": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "address": "fa:16:3e:94:bc:e9", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8def4ce-2a", "ovs_interfaceid": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:22:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-d9f6a6a9-e5bc-4174-be32-74d08af8cab8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:22:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 04:23:01 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:23:02 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:23:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:03 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:23:03 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:23:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:23:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:23:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:23:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:23:03 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:23:03 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:23:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8850MB free_disk=25.102157592773438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:23:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:23:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:23:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance d9f6a6a9-e5bc-4174-be32-74d08af8cab8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:23:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:23:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:23:03 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing inventories for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 04:23:03 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Updating ProviderTree inventory for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 04:23:03 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Updating inventory in ProviderTree for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 04:23:03 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing aggregate associations for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8, aggregates: None {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 04:23:03 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Refreshing trait associations for resource provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8, traits: HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=75378) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 04:23:04 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:23:04 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:23:04 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:23:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:23:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:05 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:23:08 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:23:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:08 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:13 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:23:13 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:23:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:23:16 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Starting instance... {{(pid=75378) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 04:23:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:23:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:23:16 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75378) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 04:23:16 user nova-compute[75378]: INFO nova.compute.claims [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Claim successful on node user
Nov 09 04:23:16 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:23:16 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:23:16 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:23:16 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Start building networks asynchronously for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 04:23:16 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Allocating IP information in the background. {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 04:23:16 user nova-compute[75378]: DEBUG nova.network.neutron [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] allocate_for_instance() {{(pid=75378) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 04:23:16 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 04:23:17 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Start building block device mappings for instance. {{(pid=75378) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG nova.policy [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23b841529aaf42c29a442ef9524422b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed5a4bfe6ce546d2acfbf7be75334d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75378) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 04:23:17 user nova-compute[75378]: INFO nova.virt.block_device [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Booting with volume 25a33332-f905-47b7-93ca-261193fe7d62 at /dev/vda
Nov 09 04:23:17 user nova-compute[75378]: DEBUG os_brick.utils [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b02202-cb50-45c1-abc8-3c61f77df51a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1e7990699619\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2864602c-330e-495d-a0ef-8505f2e1fefa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[535d64da-5d18-4039-83f5-e4deb37d6fef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[448b1432-6ffc-46ea-851c-d2fc317eab02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Running cmd (subprocess): nvme version {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] 'nvme version' failed. Not Retrying. {{(pid=75378) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] nvme not present on system {{(pid=75378) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 04:23:17 user nova-compute[75378]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 04:23:17 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd6dece-9256-46ca-b898-45be80649aef]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75378) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.lightos [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] LIGHTOS: no hostnqn found. {{(pid=75378) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG os_brick.utils [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1e7990699619', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG nova.virt.block_device [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Updating existing volume attachment record: e0c09bdf-86b3-4fdd-83c0-a7b59e4092bd {{(pid=75378) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 04:23:17 user nova-compute[75378]: DEBUG nova.network.neutron [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Successfully created port: 6cac780c-ba8f-4770-9006-78e5dc225ae4 {{(pid=75378) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 04:23:18 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:23:18 user nova-compute[75378]: DEBUG nova.network.neutron [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Successfully updated port: 6cac780c-ba8f-4770-9006-78e5dc225ae4 {{(pid=75378) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 04:23:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "refresh_cache-03989b0c-6de1-4ff3-b358-3bbc059bab0c" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:23:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquired lock "refresh_cache-03989b0c-6de1-4ff3-b358-3bbc059bab0c" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:23:18 user nova-compute[75378]: DEBUG nova.network.neutron [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Building network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 04:23:18 user nova-compute[75378]: DEBUG nova.compute.manager [req-06d5f72d-8cb7-4826-9cca-503c7650c01a req-523f9b1c-adfa-48b4-97c1-a38977aa65c7 service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Received event network-changed-6cac780c-ba8f-4770-9006-78e5dc225ae4 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:23:18 user nova-compute[75378]: DEBUG nova.compute.manager [req-06d5f72d-8cb7-4826-9cca-503c7650c01a req-523f9b1c-adfa-48b4-97c1-a38977aa65c7 service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Refreshing instance network info cache due to event network-changed-6cac780c-ba8f-4770-9006-78e5dc225ae4. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:23:18 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-06d5f72d-8cb7-4826-9cca-503c7650c01a req-523f9b1c-adfa-48b4-97c1-a38977aa65c7 service nova] Acquiring lock "refresh_cache-03989b0c-6de1-4ff3-b358-3bbc059bab0c" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:23:18 user nova-compute[75378]: DEBUG nova.network.neutron [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Instance cache missing network info. {{(pid=75378) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 04:23:19 user nova-compute[75378]: DEBUG nova.network.neutron [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Updating instance_info_cache with network_info: [{"id": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "address": "fa:16:3e:b9:3c:78", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cac780c-ba", "ovs_interfaceid": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:23:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Releasing lock "refresh_cache-03989b0c-6de1-4ff3-b358-3bbc059bab0c" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:23:19 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Instance network_info: |[{"id": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "address": "fa:16:3e:b9:3c:78", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cac780c-ba", "ovs_interfaceid": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75378) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 04:23:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-06d5f72d-8cb7-4826-9cca-503c7650c01a req-523f9b1c-adfa-48b4-97c1-a38977aa65c7 service nova] Acquired lock "refresh_cache-03989b0c-6de1-4ff3-b358-3bbc059bab0c" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:23:19 user nova-compute[75378]: DEBUG nova.network.neutron [req-06d5f72d-8cb7-4826-9cca-503c7650c01a req-523f9b1c-adfa-48b4-97c1-a38977aa65c7 service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Refreshing network info cache for port 6cac780c-ba8f-4770-9006-78e5dc225ae4 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:23:19 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:23:19 user nova-compute[75378]: DEBUG nova.network.neutron [req-06d5f72d-8cb7-4826-9cca-503c7650c01a req-523f9b1c-adfa-48b4-97c1-a38977aa65c7 service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Updated VIF entry in instance network info cache for port 6cac780c-ba8f-4770-9006-78e5dc225ae4. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:23:19 user nova-compute[75378]: DEBUG nova.network.neutron [req-06d5f72d-8cb7-4826-9cca-503c7650c01a req-523f9b1c-adfa-48b4-97c1-a38977aa65c7 service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Updating instance_info_cache with network_info: [{"id": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "address": "fa:16:3e:b9:3c:78", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cac780c-ba", "ovs_interfaceid": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:23:19 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-06d5f72d-8cb7-4826-9cca-503c7650c01a req-523f9b1c-adfa-48b4-97c1-a38977aa65c7 service nova] Releasing lock "refresh_cache-03989b0c-6de1-4ff3-b358-3bbc059bab0c" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:23:20 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:23:20 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Cleaning up deleted instances {{(pid=75378) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 04:23:20 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] There are 0 instances to clean {{(pid=75378) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 04:23:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:23:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:23:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:23:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:23:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:27 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:28 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:23:28 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:23:28 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75378) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 04:23:28 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:33 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:38 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Start spawning the instance on the hypervisor. {{(pid=75378) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Creating instance directory {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 04:23:40 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Creating image(s)
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Did not create local disks {{(pid=75378) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Ensure instance console log exists: /opt/stack/data/nova/instances/03989b0c-6de1-4ff3-b358-3bbc059bab0c/console.log {{(pid=75378) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Start _get_guest_xml network_info=[{"id": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "address": "fa:16:3e:b9:3c:78", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cac780c-ba", "ovs_interfaceid": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JxbhAwYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '03989b0c-6de1-4ff3-b358-3bbc059bab0c', 'attached_at': '', 'detached_at': '', 'volume_id': '25a33332-f905-47b7-93ca-261193fe7d62', 'serial': '25a33332-f905-47b7-93ca-261193fe7d62'}, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'e0c09bdf-86b3-4fdd-83c0-a7b59e4092bd', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 04:23:40 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:23:40 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] CPU controller missing on host. {{(pid=75378) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.host [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] CPU controller found on host. {{(pid=75378) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75378) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T03:32:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Flavor limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Image limits 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Flavor pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Image pref 0:0:0 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Got 1 possible topologies {{(pid=75378) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.virt.hardware [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75378) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Calling os-brick to attach iSCSI Volume {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JxbhAwYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:23:40 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:23:40 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:23:40 user nova-compute[75378]: INFO os_brick.initiator.connectors.iscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[757c9533-2f88-49eb-9b21-50e602746da4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 04:23:40 user nova-compute[75378]:  {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[60180a45-11c9-43d4-9ece-b6719a925bd0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62] added
Nov 09 04:23:40 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d844f30-cdaa-46ec-a29c-3bdb8eda7e29]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f042e54a-cbfd-4465-93b3-90cce43107bb]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JxbhAwYQ {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JxbhAwYQ" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b039d5-c468-4394-85c1-c21d7b856285]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JxbhAwYQ'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bd3c0a-79f7-4f70-be81-70f43d04c762]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d5fe16-6a16-4be1-a2a6-bb2340d5efe2]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)
Nov 09 04:23:40 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)
Nov 09 04:23:40 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[08029be5-2c59-4ee7-8d0c-15dead6b0d64]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62, portal: 172.16.0.220,3260]
Nov 09 04:23:40 user nova-compute[75378]: Login to [iface: default, target: iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62, portal: 172.16.0.220,3260] successful.
Nov 09 04:23:40 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[d625936f-4258-43b5-aa09-2fd529939b61]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf69550-f204-4488-874d-b769ab48d441]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)
Nov 09 04:23:40 user nova-compute[75378]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 (non-flash)
Nov 09 04:23:40 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)
Nov 09 04:23:40 user nova-compute[75378]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 (non-flash)
Nov 09 04:23:40 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Connected to 172.16.0.220:3260 {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75378) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75378) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8479a0a7-1f67-42c4-96df-82fe4d17e7eb]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75378) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 04:23:40 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JxbhAwYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75378) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26232316536656566', 'path': '/dev/sdc'} {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232316536656566', 'path': '/dev/sdc'} {{(pid=75378) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-728803294',display_name='tempest-TestVolumeBootPattern-server-728803294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-728803294',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIi6MoXfdtoHEdwPWb+lWBCIxxkWR94j+DvoRNdiCeJq2S7kvIBHTpDH0k237JeK83nJZ3VdWHYahvDy+qLUM0dmkr7n9qytWZXFGwnMeX/Mols0eY6D/GRmBaaR1kjt8w==',key_name='tempest-TestVolumeBootPattern-1437224047',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed5a4bfe6ce546d2acfbf7be75334d1a',ramdisk_id='',reservation_id='r-1yju8pdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1436829014',owner_user_name='tempest-TestVolumeBootPattern-1436829014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:23:17Z,user_data=None,user_id='23b841529aaf42c29a442ef9524422b2',uuid=03989b0c-6de1-4ff3-b358-3bbc059bab0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "address": "fa:16:3e:b9:3c:78", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cac780c-ba", "ovs_interfaceid": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75378) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converting VIF {"id": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "address": "fa:16:3e:b9:3c:78", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cac780c-ba", "ovs_interfaceid": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:3c:78,bridge_name='br-int',has_traffic_filtering=True,id=6cac780c-ba8f-4770-9006-78e5dc225ae4,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cac780c-ba') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG nova.objects.instance [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lazy-loading 'pci_devices' on Instance uuid 03989b0c-6de1-4ff3-b358-3bbc059bab0c {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] End _get_guest_xml xml=<domain type="kvm">
Nov 09 04:23:41 user nova-compute[75378]:   <uuid>03989b0c-6de1-4ff3-b358-3bbc059bab0c</uuid>
Nov 09 04:23:41 user nova-compute[75378]:   <name>instance-00000034</name>
Nov 09 04:23:41 user nova-compute[75378]:   <memory>524288</memory>
Nov 09 04:23:41 user nova-compute[75378]:   <vcpu>1</vcpu>
Nov 09 04:23:41 user nova-compute[75378]:   <metadata>
Nov 09 04:23:41 user nova-compute[75378]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 04:23:41 user nova-compute[75378]:       <nova:package version="0.0.0"/>
Nov 09 04:23:41 user nova-compute[75378]:       <nova:name>tempest-TestVolumeBootPattern-server-728803294</nova:name>
Nov 09 04:23:41 user nova-compute[75378]:       <nova:creationTime>2023-11-09 04:23:40</nova:creationTime>
Nov 09 04:23:41 user nova-compute[75378]:       <nova:flavor name="m1.tiny">
Nov 09 04:23:41 user nova-compute[75378]:         <nova:memory>512</nova:memory>
Nov 09 04:23:41 user nova-compute[75378]:         <nova:disk>1</nova:disk>
Nov 09 04:23:41 user nova-compute[75378]:         <nova:swap>0</nova:swap>
Nov 09 04:23:41 user nova-compute[75378]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 04:23:41 user nova-compute[75378]:         <nova:vcpus>1</nova:vcpus>
Nov 09 04:23:41 user nova-compute[75378]:       </nova:flavor>
Nov 09 04:23:41 user nova-compute[75378]:       <nova:owner>
Nov 09 04:23:41 user nova-compute[75378]:         <nova:user uuid="23b841529aaf42c29a442ef9524422b2">tempest-TestVolumeBootPattern-1436829014-project-member</nova:user>
Nov 09 04:23:41 user nova-compute[75378]:         <nova:project uuid="ed5a4bfe6ce546d2acfbf7be75334d1a">tempest-TestVolumeBootPattern-1436829014</nova:project>
Nov 09 04:23:41 user nova-compute[75378]:       </nova:owner>
Nov 09 04:23:41 user nova-compute[75378]:       <nova:ports>
Nov 09 04:23:41 user nova-compute[75378]:         <nova:port uuid="6cac780c-ba8f-4770-9006-78e5dc225ae4">
Nov 09 04:23:41 user nova-compute[75378]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 04:23:41 user nova-compute[75378]:         </nova:port>
Nov 09 04:23:41 user nova-compute[75378]:       </nova:ports>
Nov 09 04:23:41 user nova-compute[75378]:     </nova:instance>
Nov 09 04:23:41 user nova-compute[75378]:   </metadata>
Nov 09 04:23:41 user nova-compute[75378]:   <sysinfo type="smbios">
Nov 09 04:23:41 user nova-compute[75378]:     <system>
Nov 09 04:23:41 user nova-compute[75378]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 04:23:41 user nova-compute[75378]:       <entry name="product">OpenStack Nova</entry>
Nov 09 04:23:41 user nova-compute[75378]:       <entry name="version">0.0.0</entry>
Nov 09 04:23:41 user nova-compute[75378]:       <entry name="serial">03989b0c-6de1-4ff3-b358-3bbc059bab0c</entry>
Nov 09 04:23:41 user nova-compute[75378]:       <entry name="uuid">03989b0c-6de1-4ff3-b358-3bbc059bab0c</entry>
Nov 09 04:23:41 user nova-compute[75378]:       <entry name="family">Virtual Machine</entry>
Nov 09 04:23:41 user nova-compute[75378]:     </system>
Nov 09 04:23:41 user nova-compute[75378]:   </sysinfo>
Nov 09 04:23:41 user nova-compute[75378]:   <os>
Nov 09 04:23:41 user nova-compute[75378]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 04:23:41 user nova-compute[75378]:     <boot dev="hd"/>
Nov 09 04:23:41 user nova-compute[75378]:     <smbios mode="sysinfo"/>
Nov 09 04:23:41 user nova-compute[75378]:   </os>
Nov 09 04:23:41 user nova-compute[75378]:   <features>
Nov 09 04:23:41 user nova-compute[75378]:     <acpi/>
Nov 09 04:23:41 user nova-compute[75378]:     <apic/>
Nov 09 04:23:41 user nova-compute[75378]:     <vmcoreinfo/>
Nov 09 04:23:41 user nova-compute[75378]:   </features>
Nov 09 04:23:41 user nova-compute[75378]:   <clock offset="utc">
Nov 09 04:23:41 user nova-compute[75378]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 04:23:41 user nova-compute[75378]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 04:23:41 user nova-compute[75378]:     <timer name="hpet" present="no"/>
Nov 09 04:23:41 user nova-compute[75378]:   </clock>
Nov 09 04:23:41 user nova-compute[75378]:   <cpu mode="custom" match="exact">
Nov 09 04:23:41 user nova-compute[75378]:     <model>Nehalem</model>
Nov 09 04:23:41 user nova-compute[75378]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 04:23:41 user nova-compute[75378]:   </cpu>
Nov 09 04:23:41 user nova-compute[75378]:   <devices>
Nov 09 04:23:41 user nova-compute[75378]:     <disk type="block" device="disk">
Nov 09 04:23:41 user nova-compute[75378]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 04:23:41 user nova-compute[75378]:       <source dev="/dev/sdc"/>
Nov 09 04:23:41 user nova-compute[75378]:       <target dev="vda" bus="virtio"/>
Nov 09 04:23:41 user nova-compute[75378]:       <serial>25a33332-f905-47b7-93ca-261193fe7d62</serial>
Nov 09 04:23:41 user nova-compute[75378]:     </disk>
Nov 09 04:23:41 user nova-compute[75378]:     <interface type="ethernet">
Nov 09 04:23:41 user nova-compute[75378]:       <mac address="fa:16:3e:b9:3c:78"/>
Nov 09 04:23:41 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:23:41 user nova-compute[75378]:       <mtu size="1442"/>
Nov 09 04:23:41 user nova-compute[75378]:       <target dev="tap6cac780c-ba"/>
Nov 09 04:23:41 user nova-compute[75378]:     </interface>
Nov 09 04:23:41 user nova-compute[75378]:     <serial type="pty">
Nov 09 04:23:41 user nova-compute[75378]:       <log file="/opt/stack/data/nova/instances/03989b0c-6de1-4ff3-b358-3bbc059bab0c/console.log" append="off"/>
Nov 09 04:23:41 user nova-compute[75378]:     </serial>
Nov 09 04:23:41 user nova-compute[75378]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 04:23:41 user nova-compute[75378]:     <video>
Nov 09 04:23:41 user nova-compute[75378]:       <model type="virtio"/>
Nov 09 04:23:41 user nova-compute[75378]:     </video>
Nov 09 04:23:41 user nova-compute[75378]:     <rng model="virtio">
Nov 09 04:23:41 user nova-compute[75378]:       <backend model="random">/dev/urandom</backend>
Nov 09 04:23:41 user nova-compute[75378]:     </rng>
Nov 09 04:23:41 user nova-compute[75378]:     <controller type="usb" index="0" model="none"/>
Nov 09 04:23:41 user nova-compute[75378]:     <memballoon model="virtio">
Nov 09 04:23:41 user nova-compute[75378]:       <stats period="10"/>
Nov 09 04:23:41 user nova-compute[75378]:     </memballoon>
Nov 09 04:23:41 user nova-compute[75378]:   </devices>
Nov 09 04:23:41 user nova-compute[75378]: </domain>
Nov 09 04:23:41 user nova-compute[75378]:  {{(pid=75378) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-728803294',display_name='tempest-TestVolumeBootPattern-server-728803294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-728803294',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIi6MoXfdtoHEdwPWb+lWBCIxxkWR94j+DvoRNdiCeJq2S7kvIBHTpDH0k237JeK83nJZ3VdWHYahvDy+qLUM0dmkr7n9qytWZXFGwnMeX/Mols0eY6D/GRmBaaR1kjt8w==',key_name='tempest-TestVolumeBootPattern-1437224047',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed5a4bfe6ce546d2acfbf7be75334d1a',ramdisk_id='',reservation_id='r-1yju8pdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1436829014',owner_user_name='tempest-TestVolumeBootPattern-1436829014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T04:23:17Z,user_data=None,user_id='23b841529aaf42c29a442ef9524422b2',uuid=03989b0c-6de1-4ff3-b358-3bbc059bab0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "address": "fa:16:3e:b9:3c:78", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cac780c-ba", "ovs_interfaceid": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converting VIF {"id": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "address": "fa:16:3e:b9:3c:78", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cac780c-ba", "ovs_interfaceid": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:3c:78,bridge_name='br-int',has_traffic_filtering=True,id=6cac780c-ba8f-4770-9006-78e5dc225ae4,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cac780c-ba') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG os_vif [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:3c:78,bridge_name='br-int',has_traffic_filtering=True,id=6cac780c-ba8f-4770-9006-78e5dc225ae4,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cac780c-ba') {{(pid=75378) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f54ebd5-69c5-5579-a635-26db4bdeea23', '_type': 'linux-noop'}}, row=False) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cac780c-ba, may_exist=True, interface_attrs={}) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6cac780c-ba, col_values=(('qos', UUID('ee2f5296-2962-4192-af10-2ce7df6c6ae9')),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6cac780c-ba, col_values=(('external_ids', {'iface-id': '6cac780c-ba8f-4770-9006-78e5dc225ae4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:3c:78', 'vm-uuid': '03989b0c-6de1-4ff3-b358-3bbc059bab0c'}),), if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:41 user nova-compute[75378]: INFO os_vif [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:3c:78,bridge_name='br-int',has_traffic_filtering=True,id=6cac780c-ba8f-4770-9006-78e5dc225ae4,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cac780c-ba')
Nov 09 04:23:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] No BDM found with device name vda, not building metadata. {{(pid=75378) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 04:23:41 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] No VIF found with MAC fa:16:3e:b9:3c:78, not building metadata {{(pid=75378) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 04:23:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-3d9efd6a-2125-4877-bcf6-7ee699e65ed4 req-a429123c-b037-4012-b059-fa8aadbb7878 service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Received event network-vif-plugged-6cac780c-ba8f-4770-9006-78e5dc225ae4 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:23:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3d9efd6a-2125-4877-bcf6-7ee699e65ed4 req-a429123c-b037-4012-b059-fa8aadbb7878 service nova] Acquiring lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:23:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3d9efd6a-2125-4877-bcf6-7ee699e65ed4 req-a429123c-b037-4012-b059-fa8aadbb7878 service nova] Lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:23:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-3d9efd6a-2125-4877-bcf6-7ee699e65ed4 req-a429123c-b037-4012-b059-fa8aadbb7878 service nova] Lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:23:43 user nova-compute[75378]: DEBUG nova.compute.manager [req-3d9efd6a-2125-4877-bcf6-7ee699e65ed4 req-a429123c-b037-4012-b059-fa8aadbb7878 service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] No waiting events found dispatching network-vif-plugged-6cac780c-ba8f-4770-9006-78e5dc225ae4 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:23:43 user nova-compute[75378]: WARNING nova.compute.manager [req-3d9efd6a-2125-4877-bcf6-7ee699e65ed4 req-a429123c-b037-4012-b059-fa8aadbb7878 service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Received unexpected event network-vif-plugged-6cac780c-ba8f-4770-9006-78e5dc225ae4 for instance with vm_state building and task_state spawning.
Nov 09 04:23:43 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:43 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:23:43 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid d9f6a6a9-e5bc-4174-be32-74d08af8cab8 {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 04:23:43 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Triggering sync for uuid 03989b0c-6de1-4ff3-b358-3bbc059bab0c {{(pid=75378) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 04:23:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:23:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:23:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:23:43 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:23:45 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Instance event wait completed in 0 seconds for  {{(pid=75378) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 04:23:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Guest created on hypervisor {{(pid=75378) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 04:23:45 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Instance spawned successfully.
Nov 09 04:23:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 04:23:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Found default for hw_cdrom_bus of ide {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:23:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Found default for hw_disk_bus of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:23:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Found default for hw_input_bus of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:23:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Found default for hw_pointer_model of None {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:23:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Found default for hw_video_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:23:45 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Found default for hw_vif_model of virtio {{(pid=75378) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 04:23:45 user nova-compute[75378]: INFO nova.compute.manager [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 09 04:23:45 user nova-compute[75378]: DEBUG nova.compute.manager [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Checking state {{(pid=75378) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 04:23:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-ee4ae1bc-aed9-41a9-8271-7a62b563f1b7 req-9cc7abc8-4ac6-4e6d-89f8-f03d0e0f4246 service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Received event network-vif-plugged-6cac780c-ba8f-4770-9006-78e5dc225ae4 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:23:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ee4ae1bc-aed9-41a9-8271-7a62b563f1b7 req-9cc7abc8-4ac6-4e6d-89f8-f03d0e0f4246 service nova] Acquiring lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:23:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ee4ae1bc-aed9-41a9-8271-7a62b563f1b7 req-9cc7abc8-4ac6-4e6d-89f8-f03d0e0f4246 service nova] Lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:23:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ee4ae1bc-aed9-41a9-8271-7a62b563f1b7 req-9cc7abc8-4ac6-4e6d-89f8-f03d0e0f4246 service nova] Lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:23:45 user nova-compute[75378]: DEBUG nova.compute.manager [req-ee4ae1bc-aed9-41a9-8271-7a62b563f1b7 req-9cc7abc8-4ac6-4e6d-89f8-f03d0e0f4246 service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] No waiting events found dispatching network-vif-plugged-6cac780c-ba8f-4770-9006-78e5dc225ae4 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:23:45 user nova-compute[75378]: WARNING nova.compute.manager [req-ee4ae1bc-aed9-41a9-8271-7a62b563f1b7 req-9cc7abc8-4ac6-4e6d-89f8-f03d0e0f4246 service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Received unexpected event network-vif-plugged-6cac780c-ba8f-4770-9006-78e5dc225ae4 for instance with vm_state building and task_state spawning.
Nov 09 04:23:45 user nova-compute[75378]: INFO nova.compute.manager [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Took 28.69 seconds to build instance.
Nov 09 04:23:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-4b939f79-fccc-4dbe-bccf-25457e38611b tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.784s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:23:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.909s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:23:45 user nova-compute[75378]: INFO nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 09 04:23:45 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:23:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:47 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:23:58 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:23:58 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:23:59 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:23:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:23:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Rebuilding the list of instances to heal {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 04:23:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-d9f6a6a9-e5bc-4174-be32-74d08af8cab8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:23:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-d9f6a6a9-e5bc-4174-be32-74d08af8cab8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:23:59 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 04:23:59 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lazy-loading 'info_cache' on Instance uuid d9f6a6a9-e5bc-4174-be32-74d08af8cab8 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:23:59 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Updating instance_info_cache with network_info: [{"id": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "address": "fa:16:3e:94:bc:e9", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8def4ce-2a", "ovs_interfaceid": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:23:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-d9f6a6a9-e5bc-4174-be32-74d08af8cab8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:23:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 04:24:00 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:24:01 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:24:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:24:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:24:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:24:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:24:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:24:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:24:02 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:24:03 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:24:03 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:24:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:24:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:24:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:24:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:24:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:24:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:24:03 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:24:03 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:24:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8739MB free_disk=25.098052978515625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:24:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:24:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:24:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance d9f6a6a9-e5bc-4174-be32-74d08af8cab8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:24:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 03989b0c-6de1-4ff3-b358-3bbc059bab0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:24:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:24:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:24:03 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:24:03 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:24:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:24:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:24:04 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:24:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:24:07 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:24:09 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:24:11 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:24:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:24:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:24:16 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:24:17 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:24:21 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:24:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:24:31 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:24:36 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:24:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:24:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:24:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:24:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:24:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:24:41 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:24:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:24:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:24:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:24:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:24:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:24:46 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:24:48 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:24:51 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:24:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:24:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:24:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:24:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:24:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:24:56 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:24:59 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:24:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:24:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-03989b0c-6de1-4ff3-b358-3bbc059bab0c" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:24:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-03989b0c-6de1-4ff3-b358-3bbc059bab0c" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:24:59 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 04:24:59 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Updating instance_info_cache with network_info: [{"id": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "address": "fa:16:3e:b9:3c:78", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cac780c-ba", "ovs_interfaceid": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:24:59 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-03989b0c-6de1-4ff3-b358-3bbc059bab0c" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:24:59 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 04:25:00 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:25:00 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:25:01 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:25:01 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:25:03 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:25:03 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:25:03 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:25:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:25:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:25:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:25:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:25:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:25:03 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:25:03 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:25:03 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:25:03 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8890MB free_disk=25.09699249267578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:25:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:25:03 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:25:04 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance d9f6a6a9-e5bc-4174-be32-74d08af8cab8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:25:04 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance 03989b0c-6de1-4ff3-b358-3bbc059bab0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:25:04 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:25:04 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:25:04 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:25:04 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:25:04 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:25:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.550s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:25:06 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:25:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:25:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:25:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:25:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:25:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:25:06 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:25:08 user nova-compute[75378]: DEBUG nova.compute.manager [req-c0732123-0722-4285-a00e-e5f3cbfc7d32 req-1fca4d86-e45c-4bb5-8622-b5b29f2d221b service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Received event network-changed-6cac780c-ba8f-4770-9006-78e5dc225ae4 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:25:08 user nova-compute[75378]: DEBUG nova.compute.manager [req-c0732123-0722-4285-a00e-e5f3cbfc7d32 req-1fca4d86-e45c-4bb5-8622-b5b29f2d221b service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Refreshing instance network info cache due to event network-changed-6cac780c-ba8f-4770-9006-78e5dc225ae4. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:25:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c0732123-0722-4285-a00e-e5f3cbfc7d32 req-1fca4d86-e45c-4bb5-8622-b5b29f2d221b service nova] Acquiring lock "refresh_cache-03989b0c-6de1-4ff3-b358-3bbc059bab0c" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:25:08 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c0732123-0722-4285-a00e-e5f3cbfc7d32 req-1fca4d86-e45c-4bb5-8622-b5b29f2d221b service nova] Acquired lock "refresh_cache-03989b0c-6de1-4ff3-b358-3bbc059bab0c" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:25:08 user nova-compute[75378]: DEBUG nova.network.neutron [req-c0732123-0722-4285-a00e-e5f3cbfc7d32 req-1fca4d86-e45c-4bb5-8622-b5b29f2d221b service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Refreshing network info cache for port 6cac780c-ba8f-4770-9006-78e5dc225ae4 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:25:09 user nova-compute[75378]: DEBUG nova.network.neutron [req-c0732123-0722-4285-a00e-e5f3cbfc7d32 req-1fca4d86-e45c-4bb5-8622-b5b29f2d221b service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Updated VIF entry in instance network info cache for port 6cac780c-ba8f-4770-9006-78e5dc225ae4. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:25:09 user nova-compute[75378]: DEBUG nova.network.neutron [req-c0732123-0722-4285-a00e-e5f3cbfc7d32 req-1fca4d86-e45c-4bb5-8622-b5b29f2d221b service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Updating instance_info_cache with network_info: [{"id": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "address": "fa:16:3e:b9:3c:78", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cac780c-ba", "ovs_interfaceid": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:25:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c0732123-0722-4285-a00e-e5f3cbfc7d32 req-1fca4d86-e45c-4bb5-8622-b5b29f2d221b service nova] Releasing lock "refresh_cache-03989b0c-6de1-4ff3-b358-3bbc059bab0c" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:25:09 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:25:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:25:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:25:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:25:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:25:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:25:09 user nova-compute[75378]: INFO nova.compute.manager [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Terminating instance
Nov 09 04:25:09 user nova-compute[75378]: DEBUG nova.compute.manager [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:25:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:25:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:25:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-6db9cc8c-1207-4bd0-a65a-b927478909c9 req-97be599e-b4a0-4836-ae2c-6526a041de68 service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Received event network-vif-unplugged-6cac780c-ba8f-4770-9006-78e5dc225ae4 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:25:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6db9cc8c-1207-4bd0-a65a-b927478909c9 req-97be599e-b4a0-4836-ae2c-6526a041de68 service nova] Acquiring lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:25:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6db9cc8c-1207-4bd0-a65a-b927478909c9 req-97be599e-b4a0-4836-ae2c-6526a041de68 service nova] Lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:25:09 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-6db9cc8c-1207-4bd0-a65a-b927478909c9 req-97be599e-b4a0-4836-ae2c-6526a041de68 service nova] Lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:25:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-6db9cc8c-1207-4bd0-a65a-b927478909c9 req-97be599e-b4a0-4836-ae2c-6526a041de68 service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] No waiting events found dispatching network-vif-unplugged-6cac780c-ba8f-4770-9006-78e5dc225ae4 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:25:09 user nova-compute[75378]: DEBUG nova.compute.manager [req-6db9cc8c-1207-4bd0-a65a-b927478909c9 req-97be599e-b4a0-4836-ae2c-6526a041de68 service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Received event network-vif-unplugged-6cac780c-ba8f-4770-9006-78e5dc225ae4 for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:25:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:25:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:25:10 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Instance destroyed successfully.
Nov 09 04:25:10 user nova-compute[75378]: DEBUG nova.objects.instance [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lazy-loading 'resources' on Instance uuid 03989b0c-6de1-4ff3-b358-3bbc059bab0c {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-728803294',display_name='tempest-TestVolumeBootPattern-server-728803294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-728803294',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIi6MoXfdtoHEdwPWb+lWBCIxxkWR94j+DvoRNdiCeJq2S7kvIBHTpDH0k237JeK83nJZ3VdWHYahvDy+qLUM0dmkr7n9qytWZXFGwnMeX/Mols0eY6D/GRmBaaR1kjt8w==',key_name='tempest-TestVolumeBootPattern-1437224047',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:23:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed5a4bfe6ce546d2acfbf7be75334d1a',ramdisk_id='',reservation_id='r-1yju8pdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1436829014',owner_user_name='tempest-TestVolumeBootPattern-1436829014-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T04:23:45Z,user_data=None,user_id='23b841529aaf42c29a442ef9524422b2',uuid=03989b0c-6de1-4ff3-b358-3bbc059bab0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "address": "fa:16:3e:b9:3c:78", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cac780c-ba", "ovs_interfaceid": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converting VIF {"id": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "address": "fa:16:3e:b9:3c:78", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cac780c-ba", "ovs_interfaceid": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:3c:78,bridge_name='br-int',has_traffic_filtering=True,id=6cac780c-ba8f-4770-9006-78e5dc225ae4,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cac780c-ba') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG os_vif [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:3c:78,bridge_name='br-int',has_traffic_filtering=True,id=6cac780c-ba8f-4770-9006-78e5dc225ae4,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cac780c-ba') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cac780c-ba, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee2f5296-2962-4192-af10-2ce7df6c6ae9) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:25:10 user nova-compute[75378]: INFO os_vif [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:3c:78,bridge_name='br-int',has_traffic_filtering=True,id=6cac780c-ba8f-4770-9006-78e5dc225ae4,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cac780c-ba')
Nov 09 04:25:10 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JxbhAwYQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:25:10 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:25:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[47be3c00-adca-434e-8584-b0e9a5cb868f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 04:25:10 user nova-compute[75378]: No targets found.
Nov 09 04:25:10 user nova-compute[75378]: iSNS:
Nov 09 04:25:10 user nova-compute[75378]: No targets found.
Nov 09 04:25:10 user nova-compute[75378]: STATIC:
Nov 09 04:25:10 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654
Nov 09 04:25:10 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:25:10 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:25:10 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62
Nov 09 04:25:10 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:25:10 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:25:10 user nova-compute[75378]: FIRMWARE:
Nov 09 04:25:10 user nova-compute[75378]: No targets found.
Nov 09 04:25:10 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 04:25:10 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 04:25:10 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[1085da23-f832-4fe4-9474-b53dfcf19fb6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd591ce8-246d-4c10-90da-715c2819ba97]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)
Nov 09 04:25:10 user nova-compute[75378]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 (non-flash)
Nov 09 04:25:10 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)
Nov 09 04:25:10 user nova-compute[75378]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 (non-flash)
Nov 09 04:25:10 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c7f6f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62'): ({'sdc'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Removing single pathed devices sdc {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef4b934-007e-404d-ac81-f829111f4d10]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dbd874-2ded-4ba4-8384-55d777dcb9e6]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Flushing IO for device /dev/sdc {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed17e92-5614-4099-8879-80ea9aa9744d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfde904-6f18-4616-b9a4-242ad2f338df]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] SCSI volumes sdc have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a71a4b-c2d6-4287-b997-3573baf69ebd]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[035dee4f-1097-4a6c-800b-67d517713305]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62, portal: 172.16.0.220,3260]
Nov 09 04:25:10 user nova-compute[75378]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62, portal: 172.16.0.220,3260] successful.
Nov 09 04:25:10 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a33332-f905-47b7-93ca-261193fe7d62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1a78f1-6aae-4f45-885d-9a2094a93c89]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] <== disconnect_volume: return (293ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 04:25:10 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Deleting instance files /opt/stack/data/nova/instances/03989b0c-6de1-4ff3-b358-3bbc059bab0c_del
Nov 09 04:25:10 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Deletion of /opt/stack/data/nova/instances/03989b0c-6de1-4ff3-b358-3bbc059bab0c_del complete
Nov 09 04:25:10 user nova-compute[75378]: INFO nova.compute.manager [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-9cce40a5-6c2e-445c-a3e1-123b0f9596dd req-c6ceef94-5183-4a53-b3bd-dc99851c98cd service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Received event network-changed-6cac780c-ba8f-4770-9006-78e5dc225ae4 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG nova.compute.manager [req-9cce40a5-6c2e-445c-a3e1-123b0f9596dd req-c6ceef94-5183-4a53-b3bd-dc99851c98cd service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Refreshing instance network info cache due to event network-changed-6cac780c-ba8f-4770-9006-78e5dc225ae4. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9cce40a5-6c2e-445c-a3e1-123b0f9596dd req-c6ceef94-5183-4a53-b3bd-dc99851c98cd service nova] Acquiring lock "refresh_cache-03989b0c-6de1-4ff3-b358-3bbc059bab0c" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9cce40a5-6c2e-445c-a3e1-123b0f9596dd req-c6ceef94-5183-4a53-b3bd-dc99851c98cd service nova] Acquired lock "refresh_cache-03989b0c-6de1-4ff3-b358-3bbc059bab0c" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:25:10 user nova-compute[75378]: DEBUG nova.network.neutron [req-9cce40a5-6c2e-445c-a3e1-123b0f9596dd req-c6ceef94-5183-4a53-b3bd-dc99851c98cd service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Refreshing network info cache for port 6cac780c-ba8f-4770-9006-78e5dc225ae4 {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:25:11 user nova-compute[75378]: DEBUG nova.network.neutron [req-9cce40a5-6c2e-445c-a3e1-123b0f9596dd req-c6ceef94-5183-4a53-b3bd-dc99851c98cd service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Updated VIF entry in instance network info cache for port 6cac780c-ba8f-4770-9006-78e5dc225ae4. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:25:11 user nova-compute[75378]: DEBUG nova.network.neutron [req-9cce40a5-6c2e-445c-a3e1-123b0f9596dd req-c6ceef94-5183-4a53-b3bd-dc99851c98cd service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Updating instance_info_cache with network_info: [{"id": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "address": "fa:16:3e:b9:3c:78", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cac780c-ba", "ovs_interfaceid": "6cac780c-ba8f-4770-9006-78e5dc225ae4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:25:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-9cce40a5-6c2e-445c-a3e1-123b0f9596dd req-c6ceef94-5183-4a53-b3bd-dc99851c98cd service nova] Releasing lock "refresh_cache-03989b0c-6de1-4ff3-b358-3bbc059bab0c" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:25:11 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:25:11 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Took 0.46 seconds to deallocate network for instance.
Nov 09 04:25:11 user nova-compute[75378]: DEBUG nova.compute.manager [req-015bea41-6df7-42d7-9b5c-c98f9010f5a7 req-cba49a68-1156-4eef-8053-e2ee55f3388a service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Received event network-vif-plugged-6cac780c-ba8f-4770-9006-78e5dc225ae4 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:25:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-015bea41-6df7-42d7-9b5c-c98f9010f5a7 req-cba49a68-1156-4eef-8053-e2ee55f3388a service nova] Acquiring lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:25:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-015bea41-6df7-42d7-9b5c-c98f9010f5a7 req-cba49a68-1156-4eef-8053-e2ee55f3388a service nova] Lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:25:11 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-015bea41-6df7-42d7-9b5c-c98f9010f5a7 req-cba49a68-1156-4eef-8053-e2ee55f3388a service nova] Lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:25:11 user nova-compute[75378]: DEBUG nova.compute.manager [req-015bea41-6df7-42d7-9b5c-c98f9010f5a7 req-cba49a68-1156-4eef-8053-e2ee55f3388a service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] No waiting events found dispatching network-vif-plugged-6cac780c-ba8f-4770-9006-78e5dc225ae4 {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:25:11 user nova-compute[75378]: WARNING nova.compute.manager [req-015bea41-6df7-42d7-9b5c-c98f9010f5a7 req-cba49a68-1156-4eef-8053-e2ee55f3388a service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Received unexpected event network-vif-plugged-6cac780c-ba8f-4770-9006-78e5dc225ae4 for instance with vm_state active and task_state deleting.
Nov 09 04:25:11 user nova-compute[75378]: DEBUG nova.compute.manager [req-015bea41-6df7-42d7-9b5c-c98f9010f5a7 req-cba49a68-1156-4eef-8053-e2ee55f3388a service nova] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Received event network-vif-deleted-6cac780c-ba8f-4770-9006-78e5dc225ae4 {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:25:12 user nova-compute[75378]: INFO nova.compute.manager [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: 03989b0c-6de1-4ff3-b358-3bbc059bab0c] Took 0.92 seconds to detach 1 volumes for instance.
Nov 09 04:25:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:25:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:25:12 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:25:12 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:25:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:25:12 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Deleted allocations for instance 03989b0c-6de1-4ff3-b358-3bbc059bab0c
Nov 09 04:25:12 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-08f441c2-6e9a-427a-b9d6-90b70bae26c9 tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "03989b0c-6de1-4ff3-b358-3bbc059bab0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.875s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:25:12 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:25:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:25:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:25:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:25:25 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:25:30 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:25:30 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:25:35 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:25:40 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:25:45 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:25:50 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:25:55 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:26:00 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:26:01 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:26:01 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:26:01 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Rebuilding the list of instances to heal {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 04:26:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "refresh_cache-d9f6a6a9-e5bc-4174-be32-74d08af8cab8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:26:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquired lock "refresh_cache-d9f6a6a9-e5bc-4174-be32-74d08af8cab8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:26:01 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Forcefully refreshing network info cache for instance {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 04:26:01 user nova-compute[75378]: DEBUG nova.objects.instance [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lazy-loading 'info_cache' on Instance uuid d9f6a6a9-e5bc-4174-be32-74d08af8cab8 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:26:01 user nova-compute[75378]: DEBUG nova.network.neutron [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Updating instance_info_cache with network_info: [{"id": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "address": "fa:16:3e:94:bc:e9", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8def4ce-2a", "ovs_interfaceid": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:26:01 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Releasing lock "refresh_cache-d9f6a6a9-e5bc-4174-be32-74d08af8cab8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:26:01 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Updated the network info_cache for instance {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 04:26:01 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:26:01 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:26:02 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:26:04 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:26:04 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:26:04 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:26:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:26:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:26:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:26:04 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:26:04 user nova-compute[75378]: DEBUG nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75378) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 04:26:04 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:26:04 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:26:04 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=8960MB free_disk=25.096050262451172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:26:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:26:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:26:04 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Instance d9f6a6a9-e5bc-4174-be32-74d08af8cab8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75378) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 04:26:04 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:26:04 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:26:04 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:26:04 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:26:04 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:26:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:26:05 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:26:07 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:26:10 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:26:11 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:26:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:26:15 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:26:20 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:26:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:26:23 user nova-compute[75378]: DEBUG nova.compute.manager [req-ad6c7d2d-e00c-4693-80bf-baf49fd74803 req-fe76eb4f-b0e1-4535-918b-c11d7d735b5e service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Received event network-changed-d8def4ce-2a93-4f67-a5b8-6e16ed28596f {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:26:23 user nova-compute[75378]: DEBUG nova.compute.manager [req-ad6c7d2d-e00c-4693-80bf-baf49fd74803 req-fe76eb4f-b0e1-4535-918b-c11d7d735b5e service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Refreshing instance network info cache due to event network-changed-d8def4ce-2a93-4f67-a5b8-6e16ed28596f. {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 04:26:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ad6c7d2d-e00c-4693-80bf-baf49fd74803 req-fe76eb4f-b0e1-4535-918b-c11d7d735b5e service nova] Acquiring lock "refresh_cache-d9f6a6a9-e5bc-4174-be32-74d08af8cab8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 04:26:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ad6c7d2d-e00c-4693-80bf-baf49fd74803 req-fe76eb4f-b0e1-4535-918b-c11d7d735b5e service nova] Acquired lock "refresh_cache-d9f6a6a9-e5bc-4174-be32-74d08af8cab8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 04:26:23 user nova-compute[75378]: DEBUG nova.network.neutron [req-ad6c7d2d-e00c-4693-80bf-baf49fd74803 req-fe76eb4f-b0e1-4535-918b-c11d7d735b5e service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Refreshing network info cache for port d8def4ce-2a93-4f67-a5b8-6e16ed28596f {{(pid=75378) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 04:26:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:26:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:26:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:26:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:26:23 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:26:23 user nova-compute[75378]: INFO nova.compute.manager [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Terminating instance
Nov 09 04:26:23 user nova-compute[75378]: DEBUG nova.compute.manager [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Start destroying the instance on the hypervisor. {{(pid=75378) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 04:26:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:26:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:26:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:26:23 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG nova.network.neutron [req-ad6c7d2d-e00c-4693-80bf-baf49fd74803 req-fe76eb4f-b0e1-4535-918b-c11d7d735b5e service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Updated VIF entry in instance network info cache for port d8def4ce-2a93-4f67-a5b8-6e16ed28596f. {{(pid=75378) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG nova.network.neutron [req-ad6c7d2d-e00c-4693-80bf-baf49fd74803 req-fe76eb4f-b0e1-4535-918b-c11d7d735b5e service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Updating instance_info_cache with network_info: [{"id": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "address": "fa:16:3e:94:bc:e9", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8def4ce-2a", "ovs_interfaceid": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-ad6c7d2d-e00c-4693-80bf-baf49fd74803 req-fe76eb4f-b0e1-4535-918b-c11d7d735b5e service nova] Releasing lock "refresh_cache-d9f6a6a9-e5bc-4174-be32-74d08af8cab8" {{(pid=75378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 04:26:24 user nova-compute[75378]: INFO nova.virt.libvirt.driver [-] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Instance destroyed successfully.
Nov 09 04:26:24 user nova-compute[75378]: DEBUG nova.objects.instance [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lazy-loading 'resources' on Instance uuid d9f6a6a9-e5bc-4174-be32-74d08af8cab8 {{(pid=75378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG nova.virt.libvirt.vif [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T04:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1873937445',display_name='tempest-TestVolumeBootPattern-server-1873937445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1873937445',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIi6MoXfdtoHEdwPWb+lWBCIxxkWR94j+DvoRNdiCeJq2S7kvIBHTpDH0k237JeK83nJZ3VdWHYahvDy+qLUM0dmkr7n9qytWZXFGwnMeX/Mols0eY6D/GRmBaaR1kjt8w==',key_name='tempest-TestVolumeBootPattern-1437224047',keypairs=<?>,launch_index=0,launched_at=2023-11-09T04:21:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed5a4bfe6ce546d2acfbf7be75334d1a',ramdisk_id='',reservation_id='r-xy09m7f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1436829014',owner_user_name='tempest-TestVolumeBootPattern-1436829014-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T04:21:32Z,user_data=None,user_id='23b841529aaf42c29a442ef9524422b2',uuid=d9f6a6a9-e5bc-4174-be32-74d08af8cab8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "address": "fa:16:3e:94:bc:e9", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8def4ce-2a", "ovs_interfaceid": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converting VIF {"id": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "address": "fa:16:3e:94:bc:e9", "network": {"id": "e82320d8-4085-4e41-b91f-255bb420037a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1239403421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed5a4bfe6ce546d2acfbf7be75334d1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8def4ce-2a", "ovs_interfaceid": "d8def4ce-2a93-4f67-a5b8-6e16ed28596f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG nova.network.os_vif_util [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:bc:e9,bridge_name='br-int',has_traffic_filtering=True,id=d8def4ce-2a93-4f67-a5b8-6e16ed28596f,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8def4ce-2a') {{(pid=75378) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG os_vif [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:bc:e9,bridge_name='br-int',has_traffic_filtering=True,id=d8def4ce-2a93-4f67-a5b8-6e16ed28596f,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8def4ce-2a') {{(pid=75378) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8def4ce-2a, bridge=br-int, if_exists=True) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ee610f7-4e9a-4cb7-bfa4-497f48003526) {{(pid=75378) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:26:24 user nova-compute[75378]: INFO os_vif [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:bc:e9,bridge_name='br-int',has_traffic_filtering=True,id=d8def4ce-2a93-4f67-a5b8-6e16ed28596f,network=Network(e82320d8-4085-4e41-b91f-255bb420037a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8def4ce-2a')
Nov 09 04:26:24 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] calling os-brick to detach iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff3b0539c30>, {'target_iqn': 'iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHaudejw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 04:26:24 user nova-compute[75378]: WARNING os_brick.initiator.connectors.base [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 04:26:24 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa27b45-a640-4f1d-a49b-f2e23169050c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 04:26:24 user nova-compute[75378]: No targets found.
Nov 09 04:26:24 user nova-compute[75378]: iSNS:
Nov 09 04:26:24 user nova-compute[75378]: No targets found.
Nov 09 04:26:24 user nova-compute[75378]: STATIC:
Nov 09 04:26:24 user nova-compute[75378]: Target: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654
Nov 09 04:26:24 user nova-compute[75378]:         Portal: 172.16.0.220:3260,-1
Nov 09 04:26:24 user nova-compute[75378]:                 Iface Name: default
Nov 09 04:26:24 user nova-compute[75378]: FIRMWARE:
Nov 09 04:26:24 user nova-compute[75378]: No targets found.
Nov 09 04:26:24 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 04:26:24 user nova-compute[75378]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 04:26:24 user nova-compute[75378]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75378) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654', 0)] {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[9875a9a8-cf4b-423c-8eff-5fe602d199df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[253c43f2-23e1-4518-9ade-a4f4c9142c1e]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)
Nov 09 04:26:24 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 (non-flash)
Nov 09 04:26:24 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff38c6b3130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654'): ({'sdb'}, set())}) {{(pid=75378) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Removing single pathed devices sdb {{(pid=75378) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd64f471-c422-445b-8af9-42966d469cad]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6960dc3-e938-4554-8565-121edca052f5]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Flushing IO for device /dev/sdb {{(pid=75378) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac914d57-a5c3-4527-8a14-19aee14ac63f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75378) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af150f4-08de-425c-a166-b356aafb495d]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG os_brick.initiator.linuxscsi [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] SCSI volumes sdb have been removed. {{(pid=75378) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654')] {{(pid=75378) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[7668a8e0-8e7a-45f0-bfd1-c2f2c386d4da]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11b3656-7db3-48f3-955a-85143b216d72]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654, portal: 172.16.0.220,3260]
Nov 09 04:26:24 user nova-compute[75378]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654, portal: 172.16.0.220,3260] successful.
Nov 09 04:26:24 user nova-compute[75378]:  stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07bcfba-dc74-4540-bc64-9e08f3eb8654 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9c1968-5331-496a-a6a3-422c805b0c1b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75378) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.base [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] <== disconnect_volume: return (285ms) None {{(pid=75378) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Disconnected iSCSI Volume {{(pid=75378) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 04:26:24 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Deleting instance files /opt/stack/data/nova/instances/d9f6a6a9-e5bc-4174-be32-74d08af8cab8_del
Nov 09 04:26:24 user nova-compute[75378]: INFO nova.virt.libvirt.driver [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Deletion of /opt/stack/data/nova/instances/d9f6a6a9-e5bc-4174-be32-74d08af8cab8_del complete
Nov 09 04:26:24 user nova-compute[75378]: INFO nova.compute.manager [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 09 04:26:24 user nova-compute[75378]: DEBUG oslo.service.loopingcall [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75378) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG nova.compute.manager [-] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Deallocating network for instance {{(pid=75378) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 04:26:24 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] deallocate_for_instance() {{(pid=75378) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 04:26:25 user nova-compute[75378]: DEBUG nova.network.neutron [-] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:26:25 user nova-compute[75378]: INFO nova.compute.manager [-] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Took 0.38 seconds to deallocate network for instance.
Nov 09 04:26:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-ed8f5fd6-9a83-44f0-9215-403b035691c3 req-7c2af3fa-cefd-4e0e-9830-1f865f49a59a service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Received event network-vif-deleted-d8def4ce-2a93-4f67-a5b8-6e16ed28596f {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:26:25 user nova-compute[75378]: INFO nova.compute.manager [req-ed8f5fd6-9a83-44f0-9215-403b035691c3 req-7c2af3fa-cefd-4e0e-9830-1f865f49a59a service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Neutron deleted interface d8def4ce-2a93-4f67-a5b8-6e16ed28596f; detaching it from the instance and deleting it from the info cache
Nov 09 04:26:25 user nova-compute[75378]: DEBUG nova.network.neutron [req-ed8f5fd6-9a83-44f0-9215-403b035691c3 req-7c2af3fa-cefd-4e0e-9830-1f865f49a59a service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Updating instance_info_cache with network_info: [] {{(pid=75378) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 04:26:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-ed8f5fd6-9a83-44f0-9215-403b035691c3 req-7c2af3fa-cefd-4e0e-9830-1f865f49a59a service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Detach interface failed, port_id=d8def4ce-2a93-4f67-a5b8-6e16ed28596f, reason: Instance d9f6a6a9-e5bc-4174-be32-74d08af8cab8 could not be found. {{(pid=75378) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 04:26:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-c9675797-e3cd-43d9-b6eb-dad37c3f6dbd req-d1522d48-08d4-4548-89e1-f63fcb7ddc21 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Received event network-vif-unplugged-d8def4ce-2a93-4f67-a5b8-6e16ed28596f {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:26:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c9675797-e3cd-43d9-b6eb-dad37c3f6dbd req-d1522d48-08d4-4548-89e1-f63fcb7ddc21 service nova] Acquiring lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:26:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c9675797-e3cd-43d9-b6eb-dad37c3f6dbd req-d1522d48-08d4-4548-89e1-f63fcb7ddc21 service nova] Lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:26:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c9675797-e3cd-43d9-b6eb-dad37c3f6dbd req-d1522d48-08d4-4548-89e1-f63fcb7ddc21 service nova] Lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:26:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-c9675797-e3cd-43d9-b6eb-dad37c3f6dbd req-d1522d48-08d4-4548-89e1-f63fcb7ddc21 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] No waiting events found dispatching network-vif-unplugged-d8def4ce-2a93-4f67-a5b8-6e16ed28596f {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:26:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-c9675797-e3cd-43d9-b6eb-dad37c3f6dbd req-d1522d48-08d4-4548-89e1-f63fcb7ddc21 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Received event network-vif-unplugged-d8def4ce-2a93-4f67-a5b8-6e16ed28596f for instance with task_state deleting. {{(pid=75378) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 04:26:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-c9675797-e3cd-43d9-b6eb-dad37c3f6dbd req-d1522d48-08d4-4548-89e1-f63fcb7ddc21 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Received event network-vif-plugged-d8def4ce-2a93-4f67-a5b8-6e16ed28596f {{(pid=75378) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 04:26:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c9675797-e3cd-43d9-b6eb-dad37c3f6dbd req-d1522d48-08d4-4548-89e1-f63fcb7ddc21 service nova] Acquiring lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:26:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c9675797-e3cd-43d9-b6eb-dad37c3f6dbd req-d1522d48-08d4-4548-89e1-f63fcb7ddc21 service nova] Lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:26:25 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [req-c9675797-e3cd-43d9-b6eb-dad37c3f6dbd req-d1522d48-08d4-4548-89e1-f63fcb7ddc21 service nova] Lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:26:25 user nova-compute[75378]: DEBUG nova.compute.manager [req-c9675797-e3cd-43d9-b6eb-dad37c3f6dbd req-d1522d48-08d4-4548-89e1-f63fcb7ddc21 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] No waiting events found dispatching network-vif-plugged-d8def4ce-2a93-4f67-a5b8-6e16ed28596f {{(pid=75378) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 04:26:25 user nova-compute[75378]: WARNING nova.compute.manager [req-c9675797-e3cd-43d9-b6eb-dad37c3f6dbd req-d1522d48-08d4-4548-89e1-f63fcb7ddc21 service nova] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Received unexpected event network-vif-plugged-d8def4ce-2a93-4f67-a5b8-6e16ed28596f for instance with vm_state active and task_state deleting.
Nov 09 04:26:26 user nova-compute[75378]: INFO nova.compute.manager [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] [instance: d9f6a6a9-e5bc-4174-be32-74d08af8cab8] Took 0.95 seconds to detach 1 volumes for instance.
Nov 09 04:26:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:26:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:26:26 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:26:26 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:26:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:26:26 user nova-compute[75378]: INFO nova.scheduler.client.report [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Deleted allocations for instance d9f6a6a9-e5bc-4174-be32-74d08af8cab8
Nov 09 04:26:26 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-8ef31ef9-76b2-4061-9336-15150ef9bfff tempest-TestVolumeBootPattern-1436829014 tempest-TestVolumeBootPattern-1436829014-project-member] Lock "d9f6a6a9-e5bc-4174-be32-74d08af8cab8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.812s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:26:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:26:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:26:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:26:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:26:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:26:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:26:59 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:27:02 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:27:02 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Starting heal instance info cache {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 04:27:02 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Rebuilding the list of instances to heal {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 04:27:02 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Didn't find any instances for network info cache update. {{(pid=75378) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 04:27:02 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:27:03 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:27:03 user nova-compute[75378]: DEBUG nova.compute.manager [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75378) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 04:27:04 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:27:04 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:27:04 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:27:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:27:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:27:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:27:04 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Auditing locally available compute resources for user (node: user) {{(pid=75378) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 04:27:04 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:27:04 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:27:04 user nova-compute[75378]: WARNING nova.virt.libvirt.driver [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 04:27:04 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Hypervisor/Node resource view: name=user free_ram=9090MB free_disk=25.09515380859375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75378) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 04:27:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 04:27:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 04:27:04 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 04:27:04 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75378) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 04:27:04 user nova-compute[75378]: DEBUG nova.compute.provider_tree [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed in ProviderTree for provider: 47051f37-c496-4978-8e02-d2f1a5bbf8b8 {{(pid=75378) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 04:27:04 user nova-compute[75378]: DEBUG nova.scheduler.client.report [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Inventory has not changed for provider 47051f37-c496-4978-8e02-d2f1a5bbf8b8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75378) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 04:27:04 user nova-compute[75378]: DEBUG nova.compute.resource_tracker [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Compute_service record updated for user:user {{(pid=75378) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 04:27:04 user nova-compute[75378]: DEBUG oslo_concurrency.lockutils [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=75378) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 04:27:09 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:27:09 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:27:12 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:27:14 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:27:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:27:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:27:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:27:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:27:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:27:14 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:27:19 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:27:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:27:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:27:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:27:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:27:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:27:24 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:27:26 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:27:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:27:29 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:27:32 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:27:34 user nova-compute[75378]: DEBUG oslo_service.periodic_task [None req-ffd61df0-8dbf-4e43-b947-e3efb119373b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75378) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 04:27:34 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:27:39 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:27:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:27:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:27:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:27:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:27:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:27:44 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:27:49 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:27:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 04:27:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 04:27:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75378) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 04:27:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:27:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75378) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 04:27:54 user nova-compute[75378]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75378) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}